-- Logs begin at Wed 2022-08-24 16:23:10 UTC, end at Wed 2022-08-24 17:33:38 UTC. -- Aug 24 16:55:18.614067 dv-cinder-851640-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 16:55:18.621427 dv-cinder-851640-4-smb devstack@keystone.service[81935]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 16:55:18.623416 dv-cinder-851640-4-smb devstack@keystone.service[81935]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 16:55:18 2022] *** Aug 24 16:55:18.623416 dv-cinder-851640-4-smb devstack@keystone.service[81935]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 16:55:18.623416 dv-cinder-851640-4-smb devstack@keystone.service[81935]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 16:55:18.623416 dv-cinder-851640-4-smb devstack@keystone.service[81935]: nodename: dv-cinder-851640-4-smb Aug 24 16:55:18.623416 dv-cinder-851640-4-smb devstack@keystone.service[81935]: machine: x86_64 Aug 24 16:55:18.623416 dv-cinder-851640-4-smb devstack@keystone.service[81935]: clock source: unix Aug 24 16:55:18.623416 dv-cinder-851640-4-smb devstack@keystone.service[81935]: pcre jit disabled Aug 24 16:55:18.623416 dv-cinder-851640-4-smb devstack@keystone.service[81935]: detected number of CPU cores: 4 Aug 24 16:55:18.623940 dv-cinder-851640-4-smb devstack@keystone.service[81935]: current working directory: / Aug 24 16:55:18.623940 dv-cinder-851640-4-smb devstack@keystone.service[81935]: detected binary path: /usr/bin/uwsgi-core Aug 24 16:55:18.623940 dv-cinder-851640-4-smb devstack@keystone.service[81935]: your processes number limit is 47680 Aug 24 16:55:18.623940 dv-cinder-851640-4-smb devstack@keystone.service[81935]: your memory page size is 4096 bytes Aug 24 16:55:18.623940 dv-cinder-851640-4-smb devstack@keystone.service[81935]: detected max file descriptor number: 2048 Aug 24 16:55:18.623940 dv-cinder-851640-4-smb devstack@keystone.service[81935]: lock engine: pthread robust mutexes Aug 24 16:55:18.623940 dv-cinder-851640-4-smb devstack@keystone.service[81935]: thunder lock: enabled Aug 24 16:55:18.623940 dv-cinder-851640-4-smb devstack@keystone.service[81935]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 16:55:18.623940 dv-cinder-851640-4-smb devstack@keystone.service[81935]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 16:55:18.664956 dv-cinder-851640-4-smb devstack@keystone.service[81935]: Python main interpreter initialized at 0x5576279a79c0 Aug 24 16:55:18.664956 dv-cinder-851640-4-smb devstack@keystone.service[81935]: python threads support enabled Aug 24 16:55:18.664956 dv-cinder-851640-4-smb devstack@keystone.service[81935]: your server socket listen backlog is limited to 100 connections Aug 24 16:55:18.664956 dv-cinder-851640-4-smb devstack@keystone.service[81935]: your mercy for graceful operations on workers is 90 seconds Aug 24 16:55:18.665336 dv-cinder-851640-4-smb devstack@keystone.service[81935]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 16:55:18.665436 dv-cinder-851640-4-smb devstack@keystone.service[81935]: *** Operational MODE: preforking *** Aug 24 16:55:18.665732 dv-cinder-851640-4-smb devstack@keystone.service[81935]: *** uWSGI is running in multiple interpreter mode *** Aug 24 16:55:18.665732 dv-cinder-851640-4-smb devstack@keystone.service[81935]: spawned uWSGI master process (pid: 81935) Aug 24 16:55:18.665943 dv-cinder-851640-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 16:55:18.667947 dv-cinder-851640-4-smb devstack@keystone.service[81935]: spawned uWSGI worker 1 (pid: 81946, cores: 1) Aug 24 16:55:18.667947 dv-cinder-851640-4-smb devstack@keystone.service[81935]: spawned uWSGI worker 2 (pid: 81947, cores: 1) Aug 24 16:55:18.667947 dv-cinder-851640-4-smb devstack@keystone.service[81935]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 16:55:23.036820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:55:23.036820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: from cryptography.utils import int_from_bytes Aug 24 16:55:23.037640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:55:23.037640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: from cryptography.utils import int_from_bytes Aug 24 16:55:23.038449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:55:23.038449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: from cryptography.utils import int_from_bytes Aug 24 16:55:23.038919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:55:23.038919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: from cryptography.utils import int_from_bytes Aug 24 16:55:23.088414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:55:23.088629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:55:23.088781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] command line args: [] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:55:23.088978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:55:23.089086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:55:23.089175 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:55:23.089250 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ================================================================================ {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:55:23.089356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] command line args: [] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:55:23.089477 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] admin_token = **** {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.089628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:55:23.089715 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] config_dir = [] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.089799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ================================================================================ {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:55:23.089905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.090051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] admin_token = **** {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.090137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] config_source = [] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.090252 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] debug = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.090335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] config_dir = [] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.090451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.090758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.090758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] config_source = [] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.090961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.091066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] debug = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.091175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.091274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.091409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.091514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.091514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.091711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.091816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.091920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] list_limit = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.091920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] log_config_append = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.092113 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.092213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.092377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] list_limit = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.092479 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] log_dir = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.092574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] log_config_append = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.092683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] log_file = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.092842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.092925 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.093006 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] log_dir = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.093006 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] log_file = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.093133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.093737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.093822 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.093888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.094016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.094016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.094219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.094303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.094383 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.094518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.094621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.094621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.094857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.094857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.095046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.095176 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.095254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.095371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.095447 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.095561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.095643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.095724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.095840 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.095963 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.096050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.096209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.096332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.096483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.096739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.096828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.096969 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] publish_errors = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.097142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.097225 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.097374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.097465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] publish_errors = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.097631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.097753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.097836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.097909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.098030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.098127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.098211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] standard_threads = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.098284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.098467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.098545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.098705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] standard_threads = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.098785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.098878 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.098962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.099041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] use_journal = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.099170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.099262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] use_json = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.099341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.099414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] use_stderr = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.099512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] use_journal = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.099598 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] use_syslog = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.099674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] use_json = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.099822 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.099903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] use_stderr = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.100013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.100094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] use_syslog = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.100219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.100319 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:55:23.100498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.100579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.100736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.100870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.100998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.101081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.101239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.101320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.101484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.101562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.101719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.101797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.101966 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.102071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.102205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.102284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.102452 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.102537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.102684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.102762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.102930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.103013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.103165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.103287 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.103410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.103499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.103644 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.103774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.103878 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.103969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.104130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.104208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.104404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.104504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.104646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.104735 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.104885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.105058 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.105144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.105205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.105368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.105524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.105628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.105708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.105891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.105988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.106175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.106266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.106408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.106494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.106638 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.106716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.106868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.106953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.107099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.107178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.107337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.107421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.107564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.107653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.107794 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.107873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.108044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.108181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.108330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.111578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.111709 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.111818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.111921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.112019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.112118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.112255 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.112359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.112459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.112571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.112717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.112844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.113007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.113130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.113239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.113390 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.113536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.113692 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.113834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.113975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.114133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.114291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.114291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.114436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.114519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.114642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.114736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.114812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.114932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.115009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.115081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.115209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.115287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.115371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.115445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.115562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.115639 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.115720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.115884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.115970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.116083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.116199 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.116317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.116406 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.116481 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.116548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.116619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.116738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.116824 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.116898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.117017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.117093 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.117165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.117283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.117369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.117444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.117561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.117661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.117750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.117833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.117907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.118033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.118119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.118244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.118323 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.118395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.118511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.118596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.118671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.118811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.118896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.119960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120186 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.120957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121469 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121820 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121904 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.121978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122129 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122280 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122353 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.122964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.123104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.123191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.123256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.123426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.123516 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.123655 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.123733 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.123889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.123968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.124125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.124203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.124391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.124592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.124714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.124795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.124930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.125012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.125193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.125274 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.125428 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] auth.external = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.125509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.125659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.125739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] auth.external = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.125890 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.125969 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.126174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.126274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.126401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] auth.password = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.126485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.126631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] auth.token = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.126712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] auth.password = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.126863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] auth.token = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.126941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.127095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.127175 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.127332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.127413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.127559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.127646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.127804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.127885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.128048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.128127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.128300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.128396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.128538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] credential.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.128620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.128774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] credential.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.128868 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.129049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.129167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.129354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.129449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.129532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.129614 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.129766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.129858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.130003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.130084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.130240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.130319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.130496 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.130586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.130734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.130841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.130977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.131057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.131234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.131429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.131510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.131582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.131739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.131821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.131980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.132070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.132246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.132344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.132489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] federation.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.132571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.132731 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.132821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] federation.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.132969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.133049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.133214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.133304 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.133442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.133532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.133678 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.133758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.133908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.133988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.134150 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.134241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.134385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.134465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.134630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.134717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.134864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.134952 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.135114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.135196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.135364 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.135461 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.135601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.135691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.135846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.135926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.136082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.136163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.136342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.140801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.140801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.141945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142159 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.142931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143034 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.143960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144192 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.144943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.145938 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.146048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.146144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.146272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.146373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.146500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.146604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.146735 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.146861 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.146969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.147099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.147224 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.147334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.147475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.147589 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.147715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.147841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.147954 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.148081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.148193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.148341 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.148452 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.148575 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.148694 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.148808 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.149049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.149189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.149301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.149533 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.149628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.149784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.150033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.150112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.150282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.150510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.150601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.150740 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.150975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.151054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.151210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.151306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.151446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.151589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.151748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.151971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.152105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.152258 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.152396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.152528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.152655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.152796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.152922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.153047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.153184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.153268 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.153437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.153567 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.153696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.153837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.153837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.154077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.154205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.154333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.154471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.154607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.154734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.154863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.154991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.155119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.155246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.155246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.155511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.155640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.155640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.156470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.156602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.156885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.157027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.157212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.157362 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.157528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.157706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.157844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.157976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.158105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.158233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.158361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.158489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] resource.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.158626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.158754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.158883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.159023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.159151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.159279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.159417 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.159497 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.159571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.159643 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.159759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.159840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.160009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.160093 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.160274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.160358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.160561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.160726 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.160821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] role.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.161040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] role.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.161199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] resource.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.161280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.161509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.161657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.161746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.161997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.162077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.162246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.162486 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.162566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.162731 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.162813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.163033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.163230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.163311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.163385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.163469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.163544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.163717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.163799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.163965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.164045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.164214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.164331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] role.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.164495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.164577 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] role.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.164739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.168890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169231 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169460 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.169928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170447 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.170965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.171096 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.171167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.171247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.171339 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.171419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.171576 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.171660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.171781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.171870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.171989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] token.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.172067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.172184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.172324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.172401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.172494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.172571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.172645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.172717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.172838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.172915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.172997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.173071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.173161 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.173240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.173361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.173477 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.173564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.173641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.173713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.173785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.173856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.173928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] token.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174822 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.174976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.connection = **** {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175287 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175806 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.175950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.176949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.177023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.177095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.177167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.177239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.connection = **** {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.177319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.177472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.177557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.177654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.177737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.177856 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.177937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.178057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.178148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.178224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81947) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:55:23.178298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.178520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.178759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.178997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.179251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.179490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.179736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.179974 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.180263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.180532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.180782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.181016 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.181260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.181498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:55:23.181670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81946) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:55:23.211857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.212090 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.212347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.213568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.213802 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.214030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.221815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.223363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.249671 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.249897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.252440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.252677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.307564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.308618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.372454 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.372690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.374302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.374541 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.538418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.538651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.538878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.539148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.539371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.539483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.539590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.539722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.542082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.542082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.542082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.542082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.564825 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.564953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.565088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.565173 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.565326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.565417 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.565549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.565641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.565774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.565857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.565995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.566086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.566215 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.566298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.577563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.578290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.610554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.610748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.610841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.610920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.611088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.611206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.611291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.611378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.611456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.611530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.611635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.611721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.611852 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81946) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.611940 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81947) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:55:23.629180 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.629391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:55:23.629740 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.629835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.629942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:55:23.630028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:55:23.630219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.630303 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.630508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:55:23.630647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.630764 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.630987 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.631079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.631253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.631530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.631797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.641240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.641509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.641777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.641914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.642061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.642144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.642340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.642628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.649167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.649606 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.652112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.652431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.652519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.652719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.661419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.661543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.661618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.661695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.661769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.661842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.661931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.662008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.662082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.662156 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.662229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.662229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.662362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.662362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.662483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.662556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.662638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.662638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.677671 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.678453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.679114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.679407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.679922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.680211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.684027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.684370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.684654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.685079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.685367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.685662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.691832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.692121 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.692955 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.693243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.696280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.696572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.696857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.697142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.697401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.697487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.697686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.697768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.697960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.698053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.698234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.698326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.698510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.698791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.699067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.699339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.716088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.716446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.717162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.717450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.730099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.730221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.730342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.730342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.730487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.730487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.730624 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.730698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.731162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.732114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.734535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.734843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.735128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.735422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.735505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.735704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.735800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.735993 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.736086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.736323 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.736622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.736913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.752546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.752830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.753108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.753244 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.753372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.753535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.753820 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.754089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.760221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.760948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.761744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.762020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.762448 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.762729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.764696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.764982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.765872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.766142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.766229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.766429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.766514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.766728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.767024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.767307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.777721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.778004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.778284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.778564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.778645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.781633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.781808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.781894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.781971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.782046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.782120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.782120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.782120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.782120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.794833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.795891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.797811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.799022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.800706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.801924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.802125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.803361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.803566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.803850 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.804147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.804869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.805151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.805489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.810617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.812471 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.812598 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.814197 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.815838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.816129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.816452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.816742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.827449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.827449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.827449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.827449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.828319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.828319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.828319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.828515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.828515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.828515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.832701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81947) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.832985 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.833272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.833551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.833836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.833918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81946) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:55:23.834118 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.834202 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.834392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.834477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.834661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.834745 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.834940 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.835029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.835216 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.835300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.835488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.835581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.835759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.835843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.836039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.836121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.836326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81947) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.836416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.836620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.836904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.837184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.837449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81946) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:55:23.870315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5576279a79c0 pid: 81947 (default app) Aug 24 16:55:23.871648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5576279a79c0 pid: 81946 (default app) Aug 24 16:55:23.873862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f6cc5-cdc2-47bf-b9e4-ccd621ce8387 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:23.874145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f6cc5-cdc2-47bf-b9e4-ccd621ce8387 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:23.874926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f6cc5-cdc2-47bf-b9e4-ccd621ce8387 None None] PATH_INFO: `/v3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:23.879130 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Wed Aug 24 16:55:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:31.717373 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d3c0-d92f-4a15-ad81-a6c4323402ac None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:31.717899 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d3c0-d92f-4a15-ad81-a6c4323402ac None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:31.717899 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036d3c0-d92f-4a15-ad81-a6c4323402ac None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:31.722782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:55:31.729349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc78b-00d8-4e07-a62d-841e9f29075c None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:31.729769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc78b-00d8-4e07-a62d-841e9f29075c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:31.729862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc78b-00d8-4e07-a62d-841e9f29075c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:31.799981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: INFO dbcounter [None req-e7dbc78b-00d8-4e07-a62d-841e9f29075c None None] Registered counter for database keystone Aug 24 16:55:31.821692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG oslo_db.sqlalchemy.engines [None req-e7dbc78b-00d8-4e07-a62d-841e9f29075c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81947) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:55:31.827889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writer thread running {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:55:32.012086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG passlib.handlers.bcrypt [None req-e7dbc78b-00d8-4e07-a62d-841e9f29075c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81947) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 16:55:32.012513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG passlib.handlers.bcrypt [None req-e7dbc78b-00d8-4e07-a62d-841e9f29075c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81947) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 16:55:32.068463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-e7dbc78b-00d8-4e07-a62d-841e9f29075c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:32.070113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e7dbc78b-00d8-4e07-a62d-841e9f29075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:32.201422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 16:55:32.701895 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036d3c0-d92f-4a15-ad81-a6c4323402ac None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:32.771251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: INFO dbcounter [None req-f036d3c0-d92f-4a15-ad81-a6c4323402ac None None] Registered counter for database keystone Aug 24 16:55:32.791602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG oslo_db.sqlalchemy.engines [None req-f036d3c0-d92f-4a15-ad81-a6c4323402ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81946) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:55:32.798590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writer thread running {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:55:32.919844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036d3c0-d92f-4a15-ad81-a6c4323402ac None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:32.924398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5327f-69a0-457f-abbe-c713de529e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:32.925020 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5327f-69a0-457f-abbe-c713de529e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:32.925301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5327f-69a0-457f-abbe-c713de529e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:32.925573 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5327f-69a0-457f-abbe-c713de529e4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:32.935107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5327f-69a0-457f-abbe-c713de529e4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:32.989048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: WARNING keystone.common.rbac_enforcer.enforcer [None req-14d5327f-69a0-457f-abbe-c713de529e4d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 16:55:32.989400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5327f-69a0-457f-abbe-c713de529e4d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:32.999669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Aug 24 16:55:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:33.005629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbc78b-00d8-4e07-a62d-841e9f29075c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:33.020403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbc78b-00d8-4e07-a62d-841e9f29075c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:33.024735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b9718-426a-4488-b2cc-ff9c4e7cdbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:33.025817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b9718-426a-4488-b2cc-ff9c4e7cdbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:33.026095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b9718-426a-4488-b2cc-ff9c4e7cdbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:33.026366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b9718-426a-4488-b2cc-ff9c4e7cdbb0 admin admin] PATH_INFO: `/v3/projects/79cea13f947a4452b851eb72104e1d0d` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:33.027926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b9718-426a-4488-b2cc-ff9c4e7cdbb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=79cea13f947a4452b851eb72104e1d0d)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:33.081683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bb4b9718-426a-4488-b2cc-ff9c4e7cdbb0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 16:55:33.082018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b9718-426a-4488-b2cc-ff9c4e7cdbb0 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:33.086579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Aug 24 16:55:33 2022] GET /identity/v3/projects/79cea13f947a4452b851eb72104e1d0d => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:34.991831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c1e5d-2a26-4eed-81fb-b9c4dadf1345 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:34.992401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c1e5d-2a26-4eed-81fb-b9c4dadf1345 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:34.992401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c1e5d-2a26-4eed-81fb-b9c4dadf1345 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:34.996549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:35.002669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359eab0-87f3-4e54-ada7-3806088f7a35 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:35.003153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359eab0-87f3-4e54-ada7-3806088f7a35 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:35.003237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359eab0-87f3-4e54-ada7-3806088f7a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:35.023882 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b359eab0-87f3-4e54-ada7-3806088f7a35 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:35.025488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b359eab0-87f3-4e54-ada7-3806088f7a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:35.034007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 16:55:35.312316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c1e5d-2a26-4eed-81fb-b9c4dadf1345 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:35.324743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c1e5d-2a26-4eed-81fb-b9c4dadf1345 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:35.330812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206efcfd-ebfd-44c3-892b-86f8e2f7b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:35.331434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206efcfd-ebfd-44c3-892b-86f8e2f7b837 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:35.331707 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206efcfd-ebfd-44c3-892b-86f8e2f7b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:35.331979 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206efcfd-ebfd-44c3-892b-86f8e2f7b837 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:35.340166 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206efcfd-ebfd-44c3-892b-86f8e2f7b837 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:35.341948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206efcfd-ebfd-44c3-892b-86f8e2f7b837 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:35.351836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Aug 24 16:55:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:55:35.357668 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359eab0-87f3-4e54-ada7-3806088f7a35 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:35.366725 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359eab0-87f3-4e54-ada7-3806088f7a35 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:35.371119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d10533-6dcd-4312-b76c-34e706b58f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:35.371746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d10533-6dcd-4312-b76c-34e706b58f90 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:35.372030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d10533-6dcd-4312-b76c-34e706b58f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:35.372335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d10533-6dcd-4312-b76c-34e706b58f90 admin admin] PATH_INFO: `/v3/users/d69fc1cd23224254975fe218cabc2f20` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:35.373662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d10533-6dcd-4312-b76c-34e706b58f90 admin admin] RBAC: Authorizing `identity:get_user(user_id=d69fc1cd23224254975fe218cabc2f20)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:35.375483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d10533-6dcd-4312-b76c-34e706b58f90 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:35.377134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Wed Aug 24 16:55:35 2022] GET /identity/v3/users/d69fc1cd23224254975fe218cabc2f20 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:37.387784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe699-3bdd-42f9-ab39-6333ab2319e7 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:37.388333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe699-3bdd-42f9-ab39-6333ab2319e7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:37.388333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe699-3bdd-42f9-ab39-6333ab2319e7 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:37.389718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:37.392367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37852a41-7cc5-406e-8858-caaceafcea27 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:37.392770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37852a41-7cc5-406e-8858-caaceafcea27 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:37.393223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37852a41-7cc5-406e-8858-caaceafcea27 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:37.394633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:55:37.395361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8b95-93a5-48e4-8da9-a9d994be06da None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:37.395656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8b95-93a5-48e4-8da9-a9d994be06da None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:37.395989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b8b95-93a5-48e4-8da9-a9d994be06da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:37.399781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424319b-0480-4ef1-bc40-e44ce3afc8b4 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:37.400136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424319b-0480-4ef1-bc40-e44ce3afc8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:37.400375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424319b-0480-4ef1-bc40-e44ce3afc8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:37.418728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0424319b-0480-4ef1-bc40-e44ce3afc8b4 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:37.420017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0424319b-0480-4ef1-bc40-e44ce3afc8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:37.438880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG passlib.handlers.bcrypt [None req-ba6b8b95-93a5-48e4-8da9-a9d994be06da None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81946) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 16:55:37.439293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG passlib.handlers.bcrypt [None req-ba6b8b95-93a5-48e4-8da9-a9d994be06da None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81946) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 16:55:37.485853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ba6b8b95-93a5-48e4-8da9-a9d994be06da None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:37.487484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ba6b8b95-93a5-48e4-8da9-a9d994be06da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:37.499440 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:55:37.587530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:55:37.772677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424319b-0480-4ef1-bc40-e44ce3afc8b4 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:37.796002 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:37.857807 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b8b95-93a5-48e4-8da9-a9d994be06da None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:37.877896 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424319b-0480-4ef1-bc40-e44ce3afc8b4 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:37.914231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea7d90-db61-4e82-b5d8-c9e62db68d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:37.914853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea7d90-db61-4e82-b5d8-c9e62db68d1e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:37.915133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea7d90-db61-4e82-b5d8-c9e62db68d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:37.915408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea7d90-db61-4e82-b5d8-c9e62db68d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:37.967728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b8b95-93a5-48e4-8da9-a9d994be06da None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:37.970146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:37.986943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea7d90-db61-4e82-b5d8-c9e62db68d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:37.988466 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea7d90-db61-4e82-b5d8-c9e62db68d1e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:38.005650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bce0a9-d0df-4f27-94f7-2db266eacfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:38.006760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bce0a9-d0df-4f27-94f7-2db266eacfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:38.007041 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bce0a9-d0df-4f27-94f7-2db266eacfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:38.007318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bce0a9-d0df-4f27-94f7-2db266eacfd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:38.011754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:38.019753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bce0a9-d0df-4f27-94f7-2db266eacfd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-36bce0a9-d0df-4f27-94f7-2db266eacfd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:55:38.029100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:38.030009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:55:38.030892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:55:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:55:38.035960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bce0a9-d0df-4f27-94f7-2db266eacfd6 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:38.089974 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:55:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:38.095606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea7d90-db61-4e82-b5d8-c9e62db68d1e None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:38.136660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bce0a9-d0df-4f27-94f7-2db266eacfd6 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:38.169804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789273c-8716-47b1-8931-6c3aed29dfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:38.170423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789273c-8716-47b1-8931-6c3aed29dfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:38.170681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789273c-8716-47b1-8931-6c3aed29dfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:38.170947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789273c-8716-47b1-8931-6c3aed29dfa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:38.171610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789273c-8716-47b1-8931-6c3aed29dfa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:38.171910 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789273c-8716-47b1-8931-6c3aed29dfa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:38.174032 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789273c-8716-47b1-8931-6c3aed29dfa0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:38.186079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 8/16] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:55:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:55:38.192981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789273c-8716-47b1-8931-6c3aed29dfa0 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:38.197073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea7d90-db61-4e82-b5d8-c9e62db68d1e None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:38.220119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:38.220604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:38.231720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b91f3d-d493-4074-ae11-2bf1a892971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:38.232396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b91f3d-d493-4074-ae11-2bf1a892971d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:38.235205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b91f3d-d493-4074-ae11-2bf1a892971d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:38.235205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b91f3d-d493-4074-ae11-2bf1a892971d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:38.244524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b91f3d-d493-4074-ae11-2bf1a892971d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:38.246008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b91f3d-d493-4074-ae11-2bf1a892971d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-f3b91f3d-d493-4074-ae11-2bf1a892971d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:55:38.266502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:38.267723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:55:38.268594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:55:38.268594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:55:38.268594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:55:38.268594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:55:38.273481 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b91f3d-d493-4074-ae11-2bf1a892971d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:38.299488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789273c-8716-47b1-8931-6c3aed29dfa0 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:38.335063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6071f-1529-409e-82da-73f62f4956d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:38.335781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6071f-1529-409e-82da-73f62f4956d8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:38.336131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6071f-1529-409e-82da-73f62f4956d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:38.336528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6071f-1529-409e-82da-73f62f4956d8 None admin] PATH_INFO: `/v3/users/d69fc1cd23224254975fe218cabc2f20` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:38.338037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6071f-1529-409e-82da-73f62f4956d8 None admin] RBAC: Authorizing `identity:get_user(user_id=d69fc1cd23224254975fe218cabc2f20)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:38.339499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6071f-1529-409e-82da-73f62f4956d8 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:38.341115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:55:38 2022] GET /identity/v3/users/d69fc1cd23224254975fe218cabc2f20 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:55:38.346858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6071f-1529-409e-82da-73f62f4956d8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:38.378323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b91f3d-d493-4074-ae11-2bf1a892971d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:38.412069 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4c36f-0afb-4538-9f9c-b344bf7bfd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:38.412751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4c36f-0afb-4538-9f9c-b344bf7bfd54 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:38.412886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4c36f-0afb-4538-9f9c-b344bf7bfd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:38.413127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4c36f-0afb-4538-9f9c-b344bf7bfd54 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:38.413769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4c36f-0afb-4538-9f9c-b344bf7bfd54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:38.414065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4c36f-0afb-4538-9f9c-b344bf7bfd54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:38.415448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4c36f-0afb-4538-9f9c-b344bf7bfd54 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:38.433084 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:55:38.445029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:38.452985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6071f-1529-409e-82da-73f62f4956d8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:38.494327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9e05b-1438-4d36-9f21-4adc5b2d0cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:38.494997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e05b-1438-4d36-9f21-4adc5b2d0cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:38.495275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e05b-1438-4d36-9f21-4adc5b2d0cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:38.495551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9e05b-1438-4d36-9f21-4adc5b2d0cc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:38.496825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9e05b-1438-4d36-9f21-4adc5b2d0cc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:38.498356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9e05b-1438-4d36-9f21-4adc5b2d0cc4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:38.499999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:55:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:38.506739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4c36f-0afb-4538-9f9c-b344bf7bfd54 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:38.543999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:38.615296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4c36f-0afb-4538-9f9c-b344bf7bfd54 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:38.653157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d456cf2-7cd4-400b-ad53-76a0be7cff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:38.653785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d456cf2-7cd4-400b-ad53-76a0be7cff1e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:38.654068 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d456cf2-7cd4-400b-ad53-76a0be7cff1e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:38.654343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d456cf2-7cd4-400b-ad53-76a0be7cff1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:38.655083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d456cf2-7cd4-400b-ad53-76a0be7cff1e None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.domain.id=default, user.id=d69fc1cd23224254975fe218cabc2f20) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:38.655452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d456cf2-7cd4-400b-ad53-76a0be7cff1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:38.657459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d456cf2-7cd4-400b-ad53-76a0be7cff1e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:38.664841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Aug 24 16:55:38 2022] GET /identity/v3/role_assignments?user.id=d69fc1cd23224254975fe218cabc2f20&scope.domain.id=default&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:40.602410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8285f-105b-45f6-bf82-92d12a0bc69f None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:40.603437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8285f-105b-45f6-bf82-92d12a0bc69f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:40.603926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8285f-105b-45f6-bf82-92d12a0bc69f None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:40.605489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:40.611871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b537-3c6b-4b87-9f4d-6203e32cf1a6 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:40.612726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b537-3c6b-4b87-9f4d-6203e32cf1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:40.613196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b537-3c6b-4b87-9f4d-6203e32cf1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:40.637207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-65f3b537-3c6b-4b87-9f4d-6203e32cf1a6 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:40.638763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-65f3b537-3c6b-4b87-9f4d-6203e32cf1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:40.721126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:55:40.868952 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb581c-d074-4ae8-aff3-d439d71a4a90 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:40.869561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb581c-d074-4ae8-aff3-d439d71a4a90 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:40.870052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb581c-d074-4ae8-aff3-d439d71a4a90 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:40.871965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:40.878283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4136094-b913-4fe0-9288-6f06180e5412 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:40.878829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4136094-b913-4fe0-9288-6f06180e5412 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:40.879297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4136094-b913-4fe0-9288-6f06180e5412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:40.904432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-e4136094-b913-4fe0-9288-6f06180e5412 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:40.905977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e4136094-b913-4fe0-9288-6f06180e5412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:40.934908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cbc15-e05c-4023-8f78-a770c6f1937f None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:40.935202 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cbc15-e05c-4023-8f78-a770c6f1937f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:40.935467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cbc15-e05c-4023-8f78-a770c6f1937f None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:40.936974 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 13/25] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:55:40.942235 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880a87b-398c-46d1-8c4f-8bbb7ffd8588 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:40.942524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880a87b-398c-46d1-8c4f-8bbb7ffd8588 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:40.942764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:40.942862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880a87b-398c-46d1-8c4f-8bbb7ffd8588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:40.963738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-2880a87b-398c-46d1-8c4f-8bbb7ffd8588 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:40.965154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2880a87b-398c-46d1-8c4f-8bbb7ffd8588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:41.010049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 13/26] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:55:41.077765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 14/27] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:55:41.197961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4136094-b913-4fe0-9288-6f06180e5412 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:41.339905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4136094-b913-4fe0-9288-6f06180e5412 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:41.379676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b263cab-8a66-491f-af8b-bd9a93a28514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:41.380346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263cab-8a66-491f-af8b-bd9a93a28514 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:41.380628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263cab-8a66-491f-af8b-bd9a93a28514 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:41.380900 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b263cab-8a66-491f-af8b-bd9a93a28514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:41.392612 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b263cab-8a66-491f-af8b-bd9a93a28514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:41.394111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b263cab-8a66-491f-af8b-bd9a93a28514 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:41.414107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880a87b-398c-46d1-8c4f-8bbb7ffd8588 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-1b263cab-8a66-491f-af8b-bd9a93a28514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:55:41.414558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:41.415374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:55:41.416146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:55:41.416146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:55:41.416146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:55:41.416146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 14/28] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:55:41.422912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b263cab-8a66-491f-af8b-bd9a93a28514 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:41.446488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:41.579730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:41.591203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880a87b-398c-46d1-8c4f-8bbb7ffd8588 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:41.611409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b263cab-8a66-491f-af8b-bd9a93a28514 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:41.656909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29109ec-816e-41e2-8586-349ee741ab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:41.658292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29109ec-816e-41e2-8586-349ee741ab05 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:41.658762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29109ec-816e-41e2-8586-349ee741ab05 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:41.659222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29109ec-816e-41e2-8586-349ee741ab05 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:41.660092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29109ec-816e-41e2-8586-349ee741ab05 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:41.661679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29109ec-816e-41e2-8586-349ee741ab05 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:41.680210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0deefe-c8be-4b00-8dad-1ac4395cae94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:41.688419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0deefe-c8be-4b00-8dad-1ac4395cae94 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:41.688419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0deefe-c8be-4b00-8dad-1ac4395cae94 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:41.688419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0deefe-c8be-4b00-8dad-1ac4395cae94 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:41.688419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0deefe-c8be-4b00-8dad-1ac4395cae94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:41.688419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0deefe-c8be-4b00-8dad-1ac4395cae94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:41.688419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0deefe-c8be-4b00-8dad-1ac4395cae94 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:41.699157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:55:41.700467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0deefe-c8be-4b00-8dad-1ac4395cae94 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:41.775854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:41.815814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0deefe-c8be-4b00-8dad-1ac4395cae94 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:41.852690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf771935-17f1-4bc0-89f9-88c235e4bc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:41.853593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf771935-17f1-4bc0-89f9-88c235e4bc47 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:41.854062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf771935-17f1-4bc0-89f9-88c235e4bc47 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:41.854515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf771935-17f1-4bc0-89f9-88c235e4bc47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:41.867914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf771935-17f1-4bc0-89f9-88c235e4bc47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-cf771935-17f1-4bc0-89f9-88c235e4bc47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:55:41.874217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:41.875876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:55:41.877692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:55:41.879621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 16/30] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:55:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:55:41.880575 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf771935-17f1-4bc0-89f9-88c235e4bc47 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:41.912627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 15/31] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Aug 24 16:55:41 2022] POST /identity/v3/roles => generated 219 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:55:41.920715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ccc7a-a6d2-44da-b329-5761b6208197 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:41.921265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ccc7a-a6d2-44da-b329-5761b6208197 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:41.921671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ccc7a-a6d2-44da-b329-5761b6208197 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:41.924525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 16/32] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:41.925153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ccc7a-a6d2-44da-b329-5761b6208197 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:42.009774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf771935-17f1-4bc0-89f9-88c235e4bc47 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:42.077777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08f90e-edc6-486a-b2c4-15e30035f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:42.080022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f90e-edc6-486a-b2c4-15e30035f084 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:42.080617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:42.084254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f90e-edc6-486a-b2c4-15e30035f084 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:42.084254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08f90e-edc6-486a-b2c4-15e30035f084 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:42.084254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08f90e-edc6-486a-b2c4-15e30035f084 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:42.084254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08f90e-edc6-486a-b2c4-15e30035f084 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:42.157584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ccc7a-a6d2-44da-b329-5761b6208197 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:42.212376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c98342-6e3d-4052-aa2a-582d63389437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:42.213075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c98342-6e3d-4052-aa2a-582d63389437 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:42.213336 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c98342-6e3d-4052-aa2a-582d63389437 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:42.213628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c98342-6e3d-4052-aa2a-582d63389437 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:42.214304 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c98342-6e3d-4052-aa2a-582d63389437 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:42.214608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c98342-6e3d-4052-aa2a-582d63389437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:42.216132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c98342-6e3d-4052-aa2a-582d63389437 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:42.226808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 17/33] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:55:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:42.228244 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7119db-d230-4b0d-a7d6-9040103d7659 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:42.228496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7119db-d230-4b0d-a7d6-9040103d7659 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:42.228774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7119db-d230-4b0d-a7d6-9040103d7659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:42.265357 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0f7119db-d230-4b0d-a7d6-9040103d7659 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:42.267364 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0f7119db-d230-4b0d-a7d6-9040103d7659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:42.279138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:42.358236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 18/34] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:42.359628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7119db-d230-4b0d-a7d6-9040103d7659 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:42.360865 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 17/35] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:55:41 2022] POST /identity/v3/projects => generated 301 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:55:42.400755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24295d-44b5-4e81-b268-3f9649a628ac None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:42.401369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24295d-44b5-4e81-b268-3f9649a628ac None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:42.401660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24295d-44b5-4e81-b268-3f9649a628ac None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:42.403282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 18/36] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:55:42.409482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0441e-cdd7-435b-9351-c1b26491ffd6 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:42.409779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0441e-cdd7-435b-9351-c1b26491ffd6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:42.410003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0441e-cdd7-435b-9351-c1b26491ffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:42.450324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-35f0441e-cdd7-435b-9351-c1b26491ffd6 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:42.451923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-35f0441e-cdd7-435b-9351-c1b26491ffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:42.554661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7119db-d230-4b0d-a7d6-9040103d7659 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:42.556002 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 19/37] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:42.558421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474f96-1406-498d-95ff-55bf4c23f3e5 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:42.559718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474f96-1406-498d-95ff-55bf4c23f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:42.560010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474f96-1406-498d-95ff-55bf4c23f3e5 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:42.561425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 20/38] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:42.567781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3707b-e6ea-41f1-a195-8be0eef4bb56 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:42.568074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3707b-e6ea-41f1-a195-8be0eef4bb56 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:42.568430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3707b-e6ea-41f1-a195-8be0eef4bb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:42.592388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-82c3707b-e6ea-41f1-a195-8be0eef4bb56 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:42.593630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-82c3707b-e6ea-41f1-a195-8be0eef4bb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:42.605239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea5fb7-7e94-43e5-ba1e-8be4523a18bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:42.605935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea5fb7-7e94-43e5-ba1e-8be4523a18bc None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:42.606268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea5fb7-7e94-43e5-ba1e-8be4523a18bc None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:42.606629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea5fb7-7e94-43e5-ba1e-8be4523a18bc None admin] PATH_INFO: `/v3/users/d69fc1cd23224254975fe218cabc2f20` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:42.607851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea5fb7-7e94-43e5-ba1e-8be4523a18bc None admin] RBAC: Authorizing `identity:get_user(user_id=d69fc1cd23224254975fe218cabc2f20)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:42.610279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea5fb7-7e94-43e5-ba1e-8be4523a18bc None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:42.612071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 19/39] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:55:42 2022] GET /identity/v3/users/d69fc1cd23224254975fe218cabc2f20 => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:42.617209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea5fb7-7e94-43e5-ba1e-8be4523a18bc None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:42.634678 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:42.674289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 21/40] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:55:42.675044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3707b-e6ea-41f1-a195-8be0eef4bb56 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:42.731925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea5fb7-7e94-43e5-ba1e-8be4523a18bc None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:42.774859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48755d98-5351-4baf-8035-c66961cf7dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:42.775826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48755d98-5351-4baf-8035-c66961cf7dbd None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:42.776314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48755d98-5351-4baf-8035-c66961cf7dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:42.776768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48755d98-5351-4baf-8035-c66961cf7dbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:42.778246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48755d98-5351-4baf-8035-c66961cf7dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:42.780032 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48755d98-5351-4baf-8035-c66961cf7dbd None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:42.782291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 20/41] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:55:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:42.788343 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48755d98-5351-4baf-8035-c66961cf7dbd None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:42.837544 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:42.883465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:42.898668 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3707b-e6ea-41f1-a195-8be0eef4bb56 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:42.904644 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48755d98-5351-4baf-8035-c66961cf7dbd None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:42.935675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6168de-6de3-409b-8fe9-90f0fa56bd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:42.936260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6168de-6de3-409b-8fe9-90f0fa56bd6f None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:42.936542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6168de-6de3-409b-8fe9-90f0fa56bd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:42.936826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6168de-6de3-409b-8fe9-90f0fa56bd6f None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:42.938073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6168de-6de3-409b-8fe9-90f0fa56bd6f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:42.940058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6168de-6de3-409b-8fe9-90f0fa56bd6f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:42.945099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2857e37-3dfc-435a-b43c-6595497c07d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:42.945770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857e37-3dfc-435a-b43c-6595497c07d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:42.946058 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857e37-3dfc-435a-b43c-6595497c07d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:42.946345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2857e37-3dfc-435a-b43c-6595497c07d0 None admin] PATH_INFO: `/v3/domains/default/users/d69fc1cd23224254975fe218cabc2f20/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:42.948362 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2857e37-3dfc-435a-b43c-6595497c07d0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d69fc1cd23224254975fe218cabc2f20, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:42.949810 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2857e37-3dfc-435a-b43c-6595497c07d0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:43.089794 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Aug 24 16:55:42 2022] POST /identity/v3/roles => generated 225 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:55:43.090697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6168de-6de3-409b-8fe9-90f0fa56bd6f None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:43.134403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 21/43] 10.222.0.20 () {58 vars in 1361 bytes} [Wed Aug 24 16:55:42 2022] PUT /identity/v3/domains/default/users/d69fc1cd23224254975fe218cabc2f20/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:55:43.144721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2857e37-3dfc-435a-b43c-6595497c07d0 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:43.235204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6168de-6de3-409b-8fe9-90f0fa56bd6f None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:43.237632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:43.271468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2857e37-3dfc-435a-b43c-6595497c07d0 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:43.283662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07d95e-a8fa-4378-8ab4-b688c2a90df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:43.284484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07d95e-a8fa-4378-8ab4-b688c2a90df9 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:43.284770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07d95e-a8fa-4378-8ab4-b688c2a90df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:43.285049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07d95e-a8fa-4378-8ab4-b688c2a90df9 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:43.285735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07d95e-a8fa-4378-8ab4-b688c2a90df9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:43.287284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07d95e-a8fa-4378-8ab4-b688c2a90df9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:43.322771 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e239f5-06e5-4318-af93-ed7393a7269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:43.323420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e239f5-06e5-4318-af93-ed7393a7269b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:43.323700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e239f5-06e5-4318-af93-ed7393a7269b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:43.323983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e239f5-06e5-4318-af93-ed7393a7269b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:43.325218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e239f5-06e5-4318-af93-ed7393a7269b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:43.326696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e239f5-06e5-4318-af93-ed7393a7269b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:43.328408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 22/44] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:55:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:43.334400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e239f5-06e5-4318-af93-ed7393a7269b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:43.348483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:43.387188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 23/45] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Aug 24 16:55:43 2022] POST /identity/v3/roles => generated 223 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:55:43.445019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e239f5-06e5-4318-af93-ed7393a7269b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:43.484651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5e9af-ecfc-4b48-b312-5e7e99a7a11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:43.485351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e9af-ecfc-4b48-b312-5e7e99a7a11b None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:43.485585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e9af-ecfc-4b48-b312-5e7e99a7a11b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:43.485864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e9af-ecfc-4b48-b312-5e7e99a7a11b None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:43.486531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5e9af-ecfc-4b48-b312-5e7e99a7a11b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:43.487992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e5e9af-ecfc-4b48-b312-5e7e99a7a11b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:43.611181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:55:43 2022] POST /identity/v3/projects => generated 312 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:55:45.131767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b7d02-07a1-4abe-9cbe-8cddc623571d None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:45.132348 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b7d02-07a1-4abe-9cbe-8cddc623571d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:45.132432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b7d02-07a1-4abe-9cbe-8cddc623571d None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:45.133740 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:45.139212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b525cd7-ee64-49d6-80f1-732810c5dc8d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:45.139609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b525cd7-ee64-49d6-80f1-732810c5dc8d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:45.139775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b525cd7-ee64-49d6-80f1-732810c5dc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:45.158741 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8b525cd7-ee64-49d6-80f1-732810c5dc8d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:45.159998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8b525cd7-ee64-49d6-80f1-732810c5dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:45.215652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:45.227521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:45.494866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b7d02-07a1-4abe-9cbe-8cddc623571d None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:45.563282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a112e1e-1197-4c57-991f-5ded8798d4ef None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:45.563577 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a112e1e-1197-4c57-991f-5ded8798d4ef None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:45.563861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a112e1e-1197-4c57-991f-5ded8798d4ef None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:45.565259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 25/49] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:55:45.570399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb2265-32ed-45e7-963f-48e8e8be122d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:45.570681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb2265-32ed-45e7-963f-48e8e8be122d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:45.570958 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb2265-32ed-45e7-963f-48e8e8be122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:45.588688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5afb2265-32ed-45e7-963f-48e8e8be122d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:45.589895 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5afb2265-32ed-45e7-963f-48e8e8be122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:45.607201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b7d02-07a1-4abe-9cbe-8cddc623571d None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:45.641903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1331b39-f03c-4740-93a2-58146d5262f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:45.642594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1331b39-f03c-4740-93a2-58146d5262f9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:45.642878 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1331b39-f03c-4740-93a2-58146d5262f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:45.643153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1331b39-f03c-4740-93a2-58146d5262f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:45.653777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1331b39-f03c-4740-93a2-58146d5262f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:55:45.656043 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 26/50] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-d1331b39-f03c-4740-93a2-58146d5262f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:55:45.659306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:45.660184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:55:45.661025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 25/51] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:55:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:55:45.666243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb2265-32ed-45e7-963f-48e8e8be122d None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:45.766589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb2265-32ed-45e7-963f-48e8e8be122d None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:45.786066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:45.800298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae69611-3377-4236-8849-d30bfd0b963c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:45.800890 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae69611-3377-4236-8849-d30bfd0b963c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:45.801174 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae69611-3377-4236-8849-d30bfd0b963c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:45.801451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae69611-3377-4236-8849-d30bfd0b963c None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:45.802120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae69611-3377-4236-8849-d30bfd0b963c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:45.802421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae69611-3377-4236-8849-d30bfd0b963c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:45.803814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae69611-3377-4236-8849-d30bfd0b963c None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:45.811640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 27/52] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:55:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:45.818295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1331b39-f03c-4740-93a2-58146d5262f9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:45.842754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:45.920360 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1331b39-f03c-4740-93a2-58146d5262f9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:45.926575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae69611-3377-4236-8849-d30bfd0b963c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:45.956479 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8ab5c-23d6-49c0-a43d-8e6fa34b501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:45.957181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8ab5c-23d6-49c0-a43d-8e6fa34b501e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:45.957473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8ab5c-23d6-49c0-a43d-8e6fa34b501e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:45.957749 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8ab5c-23d6-49c0-a43d-8e6fa34b501e None admin] PATH_INFO: `/v3/users/d69fc1cd23224254975fe218cabc2f20` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:45.958944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8ab5c-23d6-49c0-a43d-8e6fa34b501e None admin] RBAC: Authorizing `identity:get_user(user_id=d69fc1cd23224254975fe218cabc2f20)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:45.960486 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8ab5c-23d6-49c0-a43d-8e6fa34b501e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:45.962156 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:55:45 2022] GET /identity/v3/users/d69fc1cd23224254975fe218cabc2f20 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:45.967734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8ab5c-23d6-49c0-a43d-8e6fa34b501e None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:46.067425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:46.077405 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8ab5c-23d6-49c0-a43d-8e6fa34b501e None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:46.114830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb203666-67fd-40b0-b381-6c5d67aa446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:46.115483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb203666-67fd-40b0-b381-6c5d67aa446a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:46.115771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb203666-67fd-40b0-b381-6c5d67aa446a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:46.116052 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb203666-67fd-40b0-b381-6c5d67aa446a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:46.117256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb203666-67fd-40b0-b381-6c5d67aa446a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:46.118835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb203666-67fd-40b0-b381-6c5d67aa446a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:46.120448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 27/54] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:55:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:55:46.126238 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb203666-67fd-40b0-b381-6c5d67aa446a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:46.136084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae69611-3377-4236-8849-d30bfd0b963c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:46.170701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394dcbd-f603-4098-a142-0e81286059fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:46.171416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394dcbd-f603-4098-a142-0e81286059fd None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:46.172344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394dcbd-f603-4098-a142-0e81286059fd None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:46.172623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394dcbd-f603-4098-a142-0e81286059fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:46.173773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394dcbd-f603-4098-a142-0e81286059fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:46.175337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394dcbd-f603-4098-a142-0e81286059fd None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:46.176956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:55:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:55:46.182712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394dcbd-f603-4098-a142-0e81286059fd None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:46.230204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb203666-67fd-40b0-b381-6c5d67aa446a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:46.233288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:46.265729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17e07-35e2-443c-a960-721fecf70ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:46.266756 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17e07-35e2-443c-a960-721fecf70ede None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:46.267271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17e07-35e2-443c-a960-721fecf70ede None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:46.267774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17e07-35e2-443c-a960-721fecf70ede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:46.269154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f17e07-35e2-443c-a960-721fecf70ede None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.domain.id=default, user.id=d69fc1cd23224254975fe218cabc2f20) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:46.269728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f17e07-35e2-443c-a960-721fecf70ede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:46.271880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f17e07-35e2-443c-a960-721fecf70ede None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:46.277762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 28/56] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Aug 24 16:55:46 2022] GET /identity/v3/role_assignments?user.id=d69fc1cd23224254975fe218cabc2f20&scope.domain.id=default&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:55:46.286421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394dcbd-f603-4098-a142-0e81286059fd None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:46.325062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd5cd5-4e3a-4660-87b1-6e545258caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:46.325616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd5cd5-4e3a-4660-87b1-6e545258caed None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:46.325898 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd5cd5-4e3a-4660-87b1-6e545258caed None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:46.326176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd5cd5-4e3a-4660-87b1-6e545258caed None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:46.326855 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd5cd5-4e3a-4660-87b1-6e545258caed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:46.328446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd5cd5-4e3a-4660-87b1-6e545258caed None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:46.416680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 29/57] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Aug 24 16:55:46 2022] POST /identity/v3/projects => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:55:48.354248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496916-d41e-40f5-a93a-12f3472b3955 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:48.354748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496916-d41e-40f5-a93a-12f3472b3955 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:48.354859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06496916-d41e-40f5-a93a-12f3472b3955 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:48.356161 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 29/58] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:48.361854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb8635-2ffd-41a8-8a48-c60ed03b09a5 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:48.362271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb8635-2ffd-41a8-8a48-c60ed03b09a5 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:48.362416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb8635-2ffd-41a8-8a48-c60ed03b09a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:48.380679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4cdb8635-2ffd-41a8-8a48-c60ed03b09a5 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:48.381904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4cdb8635-2ffd-41a8-8a48-c60ed03b09a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:48.449350 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 30/59] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:48.727928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06496916-d41e-40f5-a93a-12f3472b3955 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:48.753474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:48.829074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06496916-d41e-40f5-a93a-12f3472b3955 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:48.862555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea15fbf-7146-4734-a41b-21030d22fe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:48.863187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea15fbf-7146-4734-a41b-21030d22fe35 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:48.863472 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea15fbf-7146-4734-a41b-21030d22fe35 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:48.863823 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea15fbf-7146-4734-a41b-21030d22fe35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:48.864984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea15fbf-7146-4734-a41b-21030d22fe35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:48.866471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea15fbf-7146-4734-a41b-21030d22fe35 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:48.868055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 30/60] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:55:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:48.873932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb8635-2ffd-41a8-8a48-c60ed03b09a5 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:48.905652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:48.976073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb8635-2ffd-41a8-8a48-c60ed03b09a5 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:49.009446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f31a0-c909-461a-a932-8cb625b68be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:49.009994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f31a0-c909-461a-a932-8cb625b68be7 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:49.010278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f31a0-c909-461a-a932-8cb625b68be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:49.010556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f31a0-c909-461a-a932-8cb625b68be7 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:49.011218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f31a0-c909-461a-a932-8cb625b68be7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:49.012710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f31a0-c909-461a-a932-8cb625b68be7 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:49.123293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 31/61] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:55:48 2022] POST /identity/v3/users => generated 275 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:55:52.158104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63031aab-9c25-496d-b6d0-927315a5f4af None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:52.159137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63031aab-9c25-496d-b6d0-927315a5f4af None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:52.159616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63031aab-9c25-496d-b6d0-927315a5f4af None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:52.161578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 31/62] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:52.167326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30caaf-c20c-48d7-a372-2b2079905458 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:52.168354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30caaf-c20c-48d7-a372-2b2079905458 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:52.168926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30caaf-c20c-48d7-a372-2b2079905458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:52.191774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-3d30caaf-c20c-48d7-a372-2b2079905458 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:52.193321 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3d30caaf-c20c-48d7-a372-2b2079905458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:52.298735 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 32/63] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:55:52.431049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6418c-f77e-4bcc-ae35-4edb243acbb7 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:52.431634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6418c-f77e-4bcc-ae35-4edb243acbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:52.432099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6418c-f77e-4bcc-ae35-4edb243acbb7 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:52.433673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 32/64] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:52.440214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd96f-ab95-4ab3-aca3-2c3623cdd3b8 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:52.440769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd96f-ab95-4ab3-aca3-2c3623cdd3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:52.441274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dd96f-ab95-4ab3-aca3-2c3623cdd3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:52.469286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-287dd96f-ab95-4ab3-aca3-2c3623cdd3b8 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:52.470870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-287dd96f-ab95-4ab3-aca3-2c3623cdd3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:52.486130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:52.512134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26d27-0c31-4228-8b3c-d2b46c85ba55 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:52.512476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26d27-0c31-4228-8b3c-d2b46c85ba55 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:52.512715 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec26d27-0c31-4228-8b3c-d2b46c85ba55 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:52.514043 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 33/65] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:55:52.519751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b815869-65b1-4167-a04a-c06295493698 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:52.520030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b815869-65b1-4167-a04a-c06295493698 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:52.520330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b815869-65b1-4167-a04a-c06295493698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:52.545578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-1b815869-65b1-4167-a04a-c06295493698 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:52.547449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1b815869-65b1-4167-a04a-c06295493698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:52.591659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 33/66] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:52.632323 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ec5e-932e-46b5-a15f-c5cb615bd5a5 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:52.632758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ec5e-932e-46b5-a15f-c5cb615bd5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:52.633033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46ec5e-932e-46b5-a15f-c5cb615bd5a5 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:52.634588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 34/67] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:52.642231 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46ec5e-932e-46b5-a15f-c5cb615bd5a5 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:52.664683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 34/68] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:55:52.666611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fb703-39f6-40be-8d5e-7e54e1163f85 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:52.666914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fb703-39f6-40be-8d5e-7e54e1163f85 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:52.667192 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fb703-39f6-40be-8d5e-7e54e1163f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:52.692722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-603fb703-39f6-40be-8d5e-7e54e1163f85 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:52.694880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-603fb703-39f6-40be-8d5e-7e54e1163f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:52.722362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:52.768072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46ec5e-932e-46b5-a15f-c5cb615bd5a5 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:52.791821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 35/69] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:52.793493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c981-9aba-4f99-9314-1c5b8637d045 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:52.793785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c981-9aba-4f99-9314-1c5b8637d045 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:52.794058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98c981-9aba-4f99-9314-1c5b8637d045 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:52.796366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 36/70] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:52.801332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98868012-61e3-4be0-81d2-fad64acdc4ae None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:52.801803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98868012-61e3-4be0-81d2-fad64acdc4ae None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:52.802211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98868012-61e3-4be0-81d2-fad64acdc4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:52.821883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68d169-026f-470f-ae73-8da50dcf36e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:52.822800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d169-026f-470f-ae73-8da50dcf36e7 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:52.823939 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d169-026f-470f-ae73-8da50dcf36e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:52.824384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d169-026f-470f-ae73-8da50dcf36e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:52.840499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-98868012-61e3-4be0-81d2-fad64acdc4ae None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:52.841961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-98868012-61e3-4be0-81d2-fad64acdc4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:52.847142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68d169-026f-470f-ae73-8da50dcf36e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-1a68d169-026f-470f-ae73-8da50dcf36e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:55:52.852146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:52.853177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:55:52.854177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:55:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:55:52.861458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68d169-026f-470f-ae73-8da50dcf36e7 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:52.892521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:52.919206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 37/72] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:52.920074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98868012-61e3-4be0-81d2-fad64acdc4ae None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.005775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68d169-026f-470f-ae73-8da50dcf36e7 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.048243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:53.055524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f6998-b631-4bcc-8cf1-5b9145063e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:53.056140 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f6998-b631-4bcc-8cf1-5b9145063e28 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:53.056442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f6998-b631-4bcc-8cf1-5b9145063e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:53.056714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f6998-b631-4bcc-8cf1-5b9145063e28 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:53.057391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f6998-b631-4bcc-8cf1-5b9145063e28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:53.057689 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f6998-b631-4bcc-8cf1-5b9145063e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:53.059074 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f6998-b631-4bcc-8cf1-5b9145063e28 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:53.067738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:55:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:53.068588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f6998-b631-4bcc-8cf1-5b9145063e28 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.076141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98868012-61e3-4be0-81d2-fad64acdc4ae None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.120898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63e30f-91cb-4cca-b273-d4a40fa535f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:53.121705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63e30f-91cb-4cca-b273-d4a40fa535f1 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:53.121992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63e30f-91cb-4cca-b273-d4a40fa535f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:53.122627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63e30f-91cb-4cca-b273-d4a40fa535f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:53.134022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff63e30f-91cb-4cca-b273-d4a40fa535f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-ff63e30f-91cb-4cca-b273-d4a40fa535f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:55:53.138814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:53.139646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:55:53.140916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 38/74] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:55:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:55:53.141627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63e30f-91cb-4cca-b273-d4a40fa535f1 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.152083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:53.186895 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f6998-b631-4bcc-8cf1-5b9145063e28 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.227060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57bbd0-c961-4d9e-9236-02daf354a95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:53.227701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57bbd0-c961-4d9e-9236-02daf354a95d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:53.227984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57bbd0-c961-4d9e-9236-02daf354a95d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:53.228287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57bbd0-c961-4d9e-9236-02daf354a95d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:53.238932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57bbd0-c961-4d9e-9236-02daf354a95d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-7e57bbd0-c961-4d9e-9236-02daf354a95d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:55:53.244962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:53.245905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:55:53.246653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:55:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:55:53.247297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57bbd0-c961-4d9e-9236-02daf354a95d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.247886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63e30f-91cb-4cca-b273-d4a40fa535f1 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.311096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a839-d8db-449a-817a-0bded8850fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:53.311096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a839-d8db-449a-817a-0bded8850fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:53.311096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a839-d8db-449a-817a-0bded8850fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:53.311096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a839-d8db-449a-817a-0bded8850fa7 None admin] PATH_INFO: `/v3/users/d69fc1cd23224254975fe218cabc2f20` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:53.312100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398a839-d8db-449a-817a-0bded8850fa7 None admin] RBAC: Authorizing `identity:get_user(user_id=d69fc1cd23224254975fe218cabc2f20)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:53.312100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398a839-d8db-449a-817a-0bded8850fa7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:53.312100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 39/76] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:55:53 2022] GET /identity/v3/users/d69fc1cd23224254975fe218cabc2f20 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:53.312100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a839-d8db-449a-817a-0bded8850fa7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.312100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:53.364531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57bbd0-c961-4d9e-9236-02daf354a95d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.394395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:53.400034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6ab8c-6ba5-4c59-be62-af4d6121baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:53.400701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ab8c-6ba5-4c59-be62-af4d6121baa1 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:53.400987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ab8c-6ba5-4c59-be62-af4d6121baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:53.401265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ab8c-6ba5-4c59-be62-af4d6121baa1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:53.403947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a839-d8db-449a-817a-0bded8850fa7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.412544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6ab8c-6ba5-4c59-be62-af4d6121baa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-91e6ab8c-6ba5-4c59-be62-af4d6121baa1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:55:53.417295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:53.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 38/77] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:55:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:55:53.420925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6ab8c-6ba5-4c59-be62-af4d6121baa1 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.445642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64996b-caaa-41e3-9736-f55ffec2d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:53.446256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64996b-caaa-41e3-9736-f55ffec2d182 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:53.446533 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64996b-caaa-41e3-9736-f55ffec2d182 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:53.446871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64996b-caaa-41e3-9736-f55ffec2d182 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:53.447536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64996b-caaa-41e3-9736-f55ffec2d182 None admin] RBAC: Adding query filter params (name=member) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:53.447835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64996b-caaa-41e3-9736-f55ffec2d182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:53.449239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64996b-caaa-41e3-9736-f55ffec2d182 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:53.461493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 40/78] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:55:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:53.462309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64996b-caaa-41e3-9736-f55ffec2d182 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.522109 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6ab8c-6ba5-4c59-be62-af4d6121baa1 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.534830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:53.555643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56c84a-9251-4232-889d-1b5796bf0bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:53.556294 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56c84a-9251-4232-889d-1b5796bf0bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:53.556581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56c84a-9251-4232-889d-1b5796bf0bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:53.559156 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56c84a-9251-4232-889d-1b5796bf0bc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:53.559156 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56c84a-9251-4232-889d-1b5796bf0bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:53.559488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56c84a-9251-4232-889d-1b5796bf0bc7 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:53.561079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 39/79] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:55:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:53.562485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56c84a-9251-4232-889d-1b5796bf0bc7 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.568308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64996b-caaa-41e3-9736-f55ffec2d182 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.603708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f44c09-95a5-49af-957a-dcb46cb80fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:53.604376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44c09-95a5-49af-957a-dcb46cb80fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:53.604659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44c09-95a5-49af-957a-dcb46cb80fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:53.604933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f44c09-95a5-49af-957a-dcb46cb80fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:53.605625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f44c09-95a5-49af-957a-dcb46cb80fb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:53.605929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f44c09-95a5-49af-957a-dcb46cb80fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:53.607320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f44c09-95a5-49af-957a-dcb46cb80fb0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:53.617223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 41/80] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:55:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:53.617967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f44c09-95a5-49af-957a-dcb46cb80fb0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.626789 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:53.669716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56c84a-9251-4232-889d-1b5796bf0bc7 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.706593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d07431-2ad5-4b8a-9575-6f9f8ec48597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:53.707207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d07431-2ad5-4b8a-9575-6f9f8ec48597 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:53.707498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d07431-2ad5-4b8a-9575-6f9f8ec48597 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:53.707776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d07431-2ad5-4b8a-9575-6f9f8ec48597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:53.729756 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f44c09-95a5-49af-957a-dcb46cb80fb0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.759613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:53.764897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b65eed-2165-4978-85d1-0eb858837233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:53.766215 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b65eed-2165-4978-85d1-0eb858837233 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:53.766563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b65eed-2165-4978-85d1-0eb858837233 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:53.766849 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b65eed-2165-4978-85d1-0eb858837233 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:53.767507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b65eed-2165-4978-85d1-0eb858837233 None admin] RBAC: Adding query filter params (name=member) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:53.767826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b65eed-2165-4978-85d1-0eb858837233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:53.769246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b65eed-2165-4978-85d1-0eb858837233 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:53.777761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d07431-2ad5-4b8a-9575-6f9f8ec48597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:53.777918 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 42/81] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:55:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:53.778653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b65eed-2165-4978-85d1-0eb858837233 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.779233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d07431-2ad5-4b8a-9575-6f9f8ec48597 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:53.837215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:53.880832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 40/82] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:55:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:53.881674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d07431-2ad5-4b8a-9575-6f9f8ec48597 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.884570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b65eed-2165-4978-85d1-0eb858837233 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.919522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8feef-7ed9-46cc-9e3f-3e124dd51e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:53.920158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8feef-7ed9-46cc-9e3f-3e124dd51e2a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:53.920465 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8feef-7ed9-46cc-9e3f-3e124dd51e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:53.920748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8feef-7ed9-46cc-9e3f-3e124dd51e2a None admin] PATH_INFO: `/v3/users/e79e9344a59f4e098f27e679467d3246` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:53.934915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8feef-7ed9-46cc-9e3f-3e124dd51e2a None admin] RBAC: Authorizing `identity:get_user(user_id=e79e9344a59f4e098f27e679467d3246)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:53.936424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8feef-7ed9-46cc-9e3f-3e124dd51e2a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:53.939019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 43/83] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:55:53 2022] GET /identity/v3/users/e79e9344a59f4e098f27e679467d3246 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:53.939743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8feef-7ed9-46cc-9e3f-3e124dd51e2a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:53.986111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d07431-2ad5-4b8a-9575-6f9f8ec48597 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:53.995559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:54.021569 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eecdf-d017-4cc1-a761-63e323595f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:54.022181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eecdf-d017-4cc1-a761-63e323595f0d None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:54.022461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eecdf-d017-4cc1-a761-63e323595f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:54.022735 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220eecdf-d017-4cc1-a761-63e323595f0d None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:54.023395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eecdf-d017-4cc1-a761-63e323595f0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:54.024869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220eecdf-d017-4cc1-a761-63e323595f0d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:54.054167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8feef-7ed9-46cc-9e3f-3e124dd51e2a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:54.089319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03b741-e4d6-4234-a487-d17c6bd95e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:54.089927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b741-e4d6-4234-a487-d17c6bd95e73 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:54.090173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b741-e4d6-4234-a487-d17c6bd95e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:54.090448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b741-e4d6-4234-a487-d17c6bd95e73 None admin] PATH_INFO: `/v3/users/e79e9344a59f4e098f27e679467d3246` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:54.091620 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03b741-e4d6-4234-a487-d17c6bd95e73 None admin] RBAC: Authorizing `identity:get_user(user_id=e79e9344a59f4e098f27e679467d3246)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:54.093131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03b741-e4d6-4234-a487-d17c6bd95e73 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:54.095075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 44/84] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:55:53 2022] GET /identity/v3/users/e79e9344a59f4e098f27e679467d3246 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:54.095919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03b741-e4d6-4234-a487-d17c6bd95e73 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:54.112118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 41/85] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:55:53 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:55:54.115300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eecdf-d017-4cc1-a761-63e323595f0d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:54.134762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:54.210221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03b741-e4d6-4234-a487-d17c6bd95e73 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:54.233198 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220eecdf-d017-4cc1-a761-63e323595f0d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:54.234385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:54.249801 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93558db4-4889-4055-af98-5ac7604c57c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:54.250635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93558db4-4889-4055-af98-5ac7604c57c2 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:54.250712 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93558db4-4889-4055-af98-5ac7604c57c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:54.252294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93558db4-4889-4055-af98-5ac7604c57c2 None admin] PATH_INFO: `/v3/users/e79e9344a59f4e098f27e679467d3246` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:54.252294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93558db4-4889-4055-af98-5ac7604c57c2 None admin] RBAC: Authorizing `identity:get_user(user_id=e79e9344a59f4e098f27e679467d3246)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:54.253698 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93558db4-4889-4055-af98-5ac7604c57c2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:54.255500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 45/86] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:55:54 2022] GET /identity/v3/users/e79e9344a59f4e098f27e679467d3246 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:54.256161 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93558db4-4889-4055-af98-5ac7604c57c2 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:54.278883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec27e8-26fe-4c3d-9030-8f502cfa91f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:54.279533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec27e8-26fe-4c3d-9030-8f502cfa91f2 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:54.279819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec27e8-26fe-4c3d-9030-8f502cfa91f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:54.280095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec27e8-26fe-4c3d-9030-8f502cfa91f2 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:54.282460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec27e8-26fe-4c3d-9030-8f502cfa91f2 None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:54.287385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec27e8-26fe-4c3d-9030-8f502cfa91f2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:54.289144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 42/87] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:55:54 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:54.289925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec27e8-26fe-4c3d-9030-8f502cfa91f2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:54.390916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93558db4-4889-4055-af98-5ac7604c57c2 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:54.391325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:54.416117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec27e8-26fe-4c3d-9030-8f502cfa91f2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:54.438876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f94bf-45e2-4469-a58b-e71c57fabb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:54.439843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f94bf-45e2-4469-a58b-e71c57fabb67 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:54.440129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f94bf-45e2-4469-a58b-e71c57fabb67 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:54.440440 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f94bf-45e2-4469-a58b-e71c57fabb67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:54.459759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d3ced-c7a8-41f5-9f39-5c40b38b1acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:54.460421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d3ced-c7a8-41f5-9f39-5c40b38b1acf None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:54.460694 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d3ced-c7a8-41f5-9f39-5c40b38b1acf None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:54.460971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d3ced-c7a8-41f5-9f39-5c40b38b1acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:54.507012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:54.521811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f94bf-45e2-4469-a58b-e71c57fabb67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:54.523309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f94bf-45e2-4469-a58b-e71c57fabb67 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:54.555126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d3ced-c7a8-41f5-9f39-5c40b38b1acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:54.557381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d3ced-c7a8-41f5-9f39-5c40b38b1acf None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:54.649525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 46/88] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:54.649759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:54.650915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f94bf-45e2-4469-a58b-e71c57fabb67 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:54.676468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 43/89] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:54.677363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d3ced-c7a8-41f5-9f39-5c40b38b1acf None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:54.771717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:54.788024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f94bf-45e2-4469-a58b-e71c57fabb67 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:54.791241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d3ced-c7a8-41f5-9f39-5c40b38b1acf None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:54.828722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85531bc6-627f-4856-904a-9cfa52d12508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:54.829427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d36a38-e75c-4c4e-83f8-f2c1aa04c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:54.829852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85531bc6-627f-4856-904a-9cfa52d12508 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:54.830172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d36a38-e75c-4c4e-83f8-f2c1aa04c8af None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:54.830532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d36a38-e75c-4c4e-83f8-f2c1aa04c8af None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:54.830632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85531bc6-627f-4856-904a-9cfa52d12508 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:54.830900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d36a38-e75c-4c4e-83f8-f2c1aa04c8af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:54.831277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85531bc6-627f-4856-904a-9cfa52d12508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:54.831786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d36a38-e75c-4c4e-83f8-f2c1aa04c8af None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=e4665e2f75a74d40883dbd9e329b0586, user.id=d69fc1cd23224254975fe218cabc2f20) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:54.832217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d36a38-e75c-4c4e-83f8-f2c1aa04c8af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:54.833948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d36a38-e75c-4c4e-83f8-f2c1aa04c8af None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:54.848391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 44/90] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:55:54 2022] GET /identity/v3/role_assignments?user.id=d69fc1cd23224254975fe218cabc2f20&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:54.849499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d36a38-e75c-4c4e-83f8-f2c1aa04c8af None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:54.922872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:54.959675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85531bc6-627f-4856-904a-9cfa52d12508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:54.962369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85531bc6-627f-4856-904a-9cfa52d12508 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:55.067015 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d36a38-e75c-4c4e-83f8-f2c1aa04c8af None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:55.069820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:55.085086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 47/91] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:55:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:55.086603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85531bc6-627f-4856-904a-9cfa52d12508 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:55.197040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50b51c-9faa-4a66-9633-6e21033f1ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:55.197619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b51c-9faa-4a66-9633-6e21033f1ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:55.197904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b51c-9faa-4a66-9633-6e21033f1ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:55.198182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50b51c-9faa-4a66-9633-6e21033f1ba5 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:55.199709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85531bc6-627f-4856-904a-9cfa52d12508 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:55.204975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50b51c-9faa-4a66-9633-6e21033f1ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:55.206453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50b51c-9faa-4a66-9633-6e21033f1ba5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:55.208574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 45/92] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:55:54 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:55.209363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50b51c-9faa-4a66-9633-6e21033f1ba5 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:55.239372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee9d58-dffa-4abc-b912-5fedd5a872a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:55.240395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee9d58-dffa-4abc-b912-5fedd5a872a0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:55.240857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee9d58-dffa-4abc-b912-5fedd5a872a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:55.241309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee9d58-dffa-4abc-b912-5fedd5a872a0 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:55.243101 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee9d58-dffa-4abc-b912-5fedd5a872a0 None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:55.244779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee9d58-dffa-4abc-b912-5fedd5a872a0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:55.246986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 48/93] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:55:55 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:55.248115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee9d58-dffa-4abc-b912-5fedd5a872a0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:55.320621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:55.370903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee9d58-dffa-4abc-b912-5fedd5a872a0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:55.418722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7a7e0-c84b-48d0-804a-b1b7dcc1ae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:55.419893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7a7e0-c84b-48d0-804a-b1b7dcc1ae7e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:55.420765 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7a7e0-c84b-48d0-804a-b1b7dcc1ae7e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:55.421765 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7a7e0-c84b-48d0-804a-b1b7dcc1ae7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:55.422761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7a7e0-c84b-48d0-804a-b1b7dcc1ae7e None admin] RBAC: Adding query filter params (role.id=24cce6d670834e3ba65b942574313d0a, scope.project.id=e4665e2f75a74d40883dbd9e329b0586, user.id=e79e9344a59f4e098f27e679467d3246) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:55.423253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7a7e0-c84b-48d0-804a-b1b7dcc1ae7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:55.425492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7a7e0-c84b-48d0-804a-b1b7dcc1ae7e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:55.431778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 49/94] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:55:55 2022] GET /identity/v3/role_assignments?user.id=e79e9344a59f4e098f27e679467d3246&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=24cce6d670834e3ba65b942574313d0a => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:55.432990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7a7e0-c84b-48d0-804a-b1b7dcc1ae7e None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:55.459813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50b51c-9faa-4a66-9633-6e21033f1ba5 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:55.489967 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:55.531365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3868d-0769-44e0-996c-b800d66bc1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:55.532203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3868d-0769-44e0-996c-b800d66bc1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:55.532598 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3868d-0769-44e0-996c-b800d66bc1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:55.532947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3868d-0769-44e0-996c-b800d66bc1a5 None admin] PATH_INFO: `/v3/projects/14a69497189c4f9a8f7f67f8da320f21` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:55.536166 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3868d-0769-44e0-996c-b800d66bc1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=14a69497189c4f9a8f7f67f8da320f21)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:55.537882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3868d-0769-44e0-996c-b800d66bc1a5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:55.540394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 46/95] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:55:55 2022] GET /identity/v3/projects/14a69497189c4f9a8f7f67f8da320f21 => generated 312 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:55.545985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3868d-0769-44e0-996c-b800d66bc1a5 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:55.567929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7a7e0-c84b-48d0-804a-b1b7dcc1ae7e None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:55.596719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:55.612414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0908f-20bb-4474-ac09-41db2883242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:55.613865 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0908f-20bb-4474-ac09-41db2883242a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:55.614661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0908f-20bb-4474-ac09-41db2883242a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:55.615152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0908f-20bb-4474-ac09-41db2883242a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:55.616404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0908f-20bb-4474-ac09-41db2883242a None admin] RBAC: Adding query filter params (role.id=2837bb5c87054ea7a046150d413d2561, scope.project.id=e4665e2f75a74d40883dbd9e329b0586, user.id=e79e9344a59f4e098f27e679467d3246) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:55.616936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0908f-20bb-4474-ac09-41db2883242a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:55.619500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0908f-20bb-4474-ac09-41db2883242a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:55.627711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 50/96] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:55:55 2022] GET /identity/v3/role_assignments?user.id=e79e9344a59f4e098f27e679467d3246&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=2837bb5c87054ea7a046150d413d2561 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:55.721282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3868d-0769-44e0-996c-b800d66bc1a5 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:55.761930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b3e74-e256-47e4-a912-fc3228969462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:55.762676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b3e74-e256-47e4-a912-fc3228969462 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:55.762964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b3e74-e256-47e4-a912-fc3228969462 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:55.763240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b3e74-e256-47e4-a912-fc3228969462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:55.764002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b3e74-e256-47e4-a912-fc3228969462 None admin] RBAC: Adding query filter params (role.id=24cce6d670834e3ba65b942574313d0a, scope.project.id=14a69497189c4f9a8f7f67f8da320f21, user.id=e79e9344a59f4e098f27e679467d3246) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:55.764343 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b3e74-e256-47e4-a912-fc3228969462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:55.766381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b3e74-e256-47e4-a912-fc3228969462 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:55.772871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 47/97] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:55:55 2022] GET /identity/v3/role_assignments?user.id=e79e9344a59f4e098f27e679467d3246&scope.project.id=14a69497189c4f9a8f7f67f8da320f21&role.id=24cce6d670834e3ba65b942574313d0a => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:56.595685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16666b-7d81-4e5f-baf8-bd3d2fc48b51 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:56.596167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16666b-7d81-4e5f-baf8-bd3d2fc48b51 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:56.596167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16666b-7d81-4e5f-baf8-bd3d2fc48b51 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:56.597988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 51/98] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:56.603562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fb201-a557-4e06-b4b4-ed7457cf2bf3 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:56.603998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fb201-a557-4e06-b4b4-ed7457cf2bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:56.604138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fb201-a557-4e06-b4b4-ed7457cf2bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:56.623336 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-670fb201-a557-4e06-b4b4-ed7457cf2bf3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:56.624746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-670fb201-a557-4e06-b4b4-ed7457cf2bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:56.673264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:56.701107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 48/99] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:56.779806 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66cc03-c046-43e4-a4a7-c1c948143da6 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:56.780101 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66cc03-c046-43e4-a4a7-c1c948143da6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:56.780910 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66cc03-c046-43e4-a4a7-c1c948143da6 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:56.782647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 52/100] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:56.791109 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375904b0-feeb-4893-8044-eb5d26fc44d9 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:56.791399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375904b0-feeb-4893-8044-eb5d26fc44d9 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:56.791684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375904b0-feeb-4893-8044-eb5d26fc44d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:56.812000 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-375904b0-feeb-4893-8044-eb5d26fc44d9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:56.813570 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-375904b0-feeb-4893-8044-eb5d26fc44d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:56.887227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 49/101] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:57.042941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66cc03-c046-43e4-a4a7-c1c948143da6 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:57.169284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66cc03-c046-43e4-a4a7-c1c948143da6 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:57.204982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5a55c-2007-440d-86e3-934f4c2c973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:57.205628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5a55c-2007-440d-86e3-934f4c2c973c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:57.205910 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5a55c-2007-440d-86e3-934f4c2c973c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:57.206187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5a55c-2007-440d-86e3-934f4c2c973c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:57.216660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5a55c-2007-440d-86e3-934f4c2c973c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-cfc5a55c-2007-440d-86e3-934f4c2c973c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:55:57.222690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:57.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:55:57.226726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 53/102] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:55:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:55:57.233853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375904b0-feeb-4893-8044-eb5d26fc44d9 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:57.263283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5a55c-2007-440d-86e3-934f4c2c973c None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:57.391209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:57.490418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375904b0-feeb-4893-8044-eb5d26fc44d9 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:57.498300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:57.521776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5a55c-2007-440d-86e3-934f4c2c973c None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:57.547725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d8030-77fa-46b4-8fb2-9ce01ceb7818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:57.548368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8030-77fa-46b4-8fb2-9ce01ceb7818 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:57.548648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8030-77fa-46b4-8fb2-9ce01ceb7818 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:57.548919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d8030-77fa-46b4-8fb2-9ce01ceb7818 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:57.549590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d8030-77fa-46b4-8fb2-9ce01ceb7818 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:57.549892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d8030-77fa-46b4-8fb2-9ce01ceb7818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:57.551280 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d8030-77fa-46b4-8fb2-9ce01ceb7818 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:57.568033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 50/103] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:55:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:55:57.570876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e25fb3-2122-4d48-9f68-bd7ffbc9cb05 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:57.571924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e25fb3-2122-4d48-9f68-bd7ffbc9cb05 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:57.574134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e25fb3-2122-4d48-9f68-bd7ffbc9cb05 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:57.577285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 51/104] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:57.579222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e25fb3-2122-4d48-9f68-bd7ffbc9cb05 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:57.584963 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565b0d1-e895-4e8d-9987-f712e5f28bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:57.585607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b0d1-e895-4e8d-9987-f712e5f28bfb None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:57.585885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b0d1-e895-4e8d-9987-f712e5f28bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:57.586158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565b0d1-e895-4e8d-9987-f712e5f28bfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:57.588083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565b0d1-e895-4e8d-9987-f712e5f28bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:57.589572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565b0d1-e895-4e8d-9987-f712e5f28bfb None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:57.591355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 54/105] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:55:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:55:57.602192 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe425ea-d3fa-4cba-b00d-abd98bf9593c None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:57.602787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe425ea-d3fa-4cba-b00d-abd98bf9593c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:57.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe425ea-d3fa-4cba-b00d-abd98bf9593c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:57.625833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-1fe425ea-d3fa-4cba-b00d-abd98bf9593c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:57.627115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1fe425ea-d3fa-4cba-b00d-abd98bf9593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:57.749617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e25fb3-2122-4d48-9f68-bd7ffbc9cb05 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:57.788057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 55/106] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:57.788762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe425ea-d3fa-4cba-b00d-abd98bf9593c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:57.790255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50b3e-7420-4ed6-93dd-7b236d840be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:57.790887 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50b3e-7420-4ed6-93dd-7b236d840be2 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:57.791167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50b3e-7420-4ed6-93dd-7b236d840be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:57.791442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e50b3e-7420-4ed6-93dd-7b236d840be2 None admin] PATH_INFO: `/v3/users/dd979face29840c3a24441467f722da8` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:57.808502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e50b3e-7420-4ed6-93dd-7b236d840be2 None admin] RBAC: Authorizing `identity:get_user(user_id=dd979face29840c3a24441467f722da8)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:57.810199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e50b3e-7420-4ed6-93dd-7b236d840be2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:57.812297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 52/107] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:55:57 2022] GET /identity/v3/users/dd979face29840c3a24441467f722da8 => generated 289 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:57.818423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50b3e-7420-4ed6-93dd-7b236d840be2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:57.852165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:57.897928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:57.966005 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe425ea-d3fa-4cba-b00d-abd98bf9593c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:57.995483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e50b3e-7420-4ed6-93dd-7b236d840be2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:58.013032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35694b-e84c-42f6-8ecc-c46ebb352393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:58.013905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35694b-e84c-42f6-8ecc-c46ebb352393 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.014370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35694b-e84c-42f6-8ecc-c46ebb352393 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.015368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35694b-e84c-42f6-8ecc-c46ebb352393 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.016616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35694b-e84c-42f6-8ecc-c46ebb352393 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:58.018225 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35694b-e84c-42f6-8ecc-c46ebb352393 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:58.039334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83dd64-9d9f-4ff8-9f8d-dae4379af327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:58.044290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83dd64-9d9f-4ff8-9f8d-dae4379af327 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.044290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83dd64-9d9f-4ff8-9f8d-dae4379af327 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.044290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83dd64-9d9f-4ff8-9f8d-dae4379af327 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.108974 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 56/108] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:55:57 2022] POST /identity/v3/projects => generated 302 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:55:58.118217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83dd64-9d9f-4ff8-9f8d-dae4379af327 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:58.119709 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83dd64-9d9f-4ff8-9f8d-dae4379af327 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:58.151776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:58.227316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35694b-e84c-42f6-8ecc-c46ebb352393 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:58.234470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 53/109] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:55:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:55:58.239938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83dd64-9d9f-4ff8-9f8d-dae4379af327 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:58.351340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83dd64-9d9f-4ff8-9f8d-dae4379af327 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:58.384643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:58.396679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de26d0b-96ba-47a5-9ff5-bf93a4113c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:58.398559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de26d0b-96ba-47a5-9ff5-bf93a4113c8f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.399075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de26d0b-96ba-47a5-9ff5-bf93a4113c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.399355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de26d0b-96ba-47a5-9ff5-bf93a4113c8f None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.403035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de26d0b-96ba-47a5-9ff5-bf93a4113c8f None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:58.405718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de26d0b-96ba-47a5-9ff5-bf93a4113c8f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:58.406926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 54/110] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:55:58 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:58.418311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de26d0b-96ba-47a5-9ff5-bf93a4113c8f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:58.436248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:58.449437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35694b-e84c-42f6-8ecc-c46ebb352393 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:58.533236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aa7f7-e22f-40e0-ab88-cc25b4f39416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:58.534168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa7f7-e22f-40e0-ab88-cc25b4f39416 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.534607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa7f7-e22f-40e0-ab88-cc25b4f39416 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.535037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aa7f7-e22f-40e0-ab88-cc25b4f39416 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.565296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72aa7f7-e22f-40e0-ab88-cc25b4f39416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-b72aa7f7-e22f-40e0-ab88-cc25b4f39416 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:55:58.570169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:58.571244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:55:58.572201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 57/111] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:55:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:55:58.581273 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aa7f7-e22f-40e0-ab88-cc25b4f39416 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:58.597798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de26d0b-96ba-47a5-9ff5-bf93a4113c8f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:58.635803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc7233-6946-49ca-9fb0-a88b2e5ab104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:58.636728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc7233-6946-49ca-9fb0-a88b2e5ab104 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.637169 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc7233-6946-49ca-9fb0-a88b2e5ab104 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.637598 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc7233-6946-49ca-9fb0-a88b2e5ab104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.638497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc7233-6946-49ca-9fb0-a88b2e5ab104 None admin] RBAC: Adding query filter params (role.id=4913cb9f208f4c4892f61e1433923571, scope.project.id=e4665e2f75a74d40883dbd9e329b0586, user.id=dd979face29840c3a24441467f722da8) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:58.638970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc7233-6946-49ca-9fb0-a88b2e5ab104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:58.640836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc7233-6946-49ca-9fb0-a88b2e5ab104 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:58.647063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:55:58 2022] GET /identity/v3/role_assignments?user.id=dd979face29840c3a24441467f722da8&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=4913cb9f208f4c4892f61e1433923571 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:58.652660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c520230-764b-49d3-aa18-22b5eb88e1d2 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.653204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c520230-764b-49d3-aa18-22b5eb88e1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.653723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c520230-764b-49d3-aa18-22b5eb88e1d2 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.655375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 56/113] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:58.666142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17607a29-ea8f-4767-9908-bd8f0f1ed391 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.666682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17607a29-ea8f-4767-9908-bd8f0f1ed391 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.667105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17607a29-ea8f-4767-9908-bd8f0f1ed391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.713292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-17607a29-ea8f-4767-9908-bd8f0f1ed391 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:58.713747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aa7f7-e22f-40e0-ab88-cc25b4f39416 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:58.715269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-17607a29-ea8f-4767-9908-bd8f0f1ed391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:58.765536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8cbd5-685d-489b-b8ac-560520c11e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:58.766422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8cbd5-685d-489b-b8ac-560520c11e0e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.766711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8cbd5-685d-489b-b8ac-560520c11e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.766985 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8cbd5-685d-489b-b8ac-560520c11e0e None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.767694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8cbd5-685d-489b-b8ac-560520c11e0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:58.768105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8cbd5-685d-489b-b8ac-560520c11e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:58.769619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8cbd5-685d-489b-b8ac-560520c11e0e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:58.788832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:58.789986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 58/114] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:55:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:58.791350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412197d8-5726-4169-b3f5-ceb57cda8e4a None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.791645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412197d8-5726-4169-b3f5-ceb57cda8e4a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.791927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412197d8-5726-4169-b3f5-ceb57cda8e4a None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.793320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 59/115] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:58.801277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412197d8-5726-4169-b3f5-ceb57cda8e4a None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:58.805334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 57/116] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 16:55:58.806831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f3fae-ac66-43bc-9b25-697f7afbafb9 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.807297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f3fae-ac66-43bc-9b25-697f7afbafb9 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.807726 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f3fae-ac66-43bc-9b25-697f7afbafb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.850908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-385f3fae-ac66-43bc-9b25-697f7afbafb9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:58.850908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-385f3fae-ac66-43bc-9b25-697f7afbafb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:58.851182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:58.932710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 58/117] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:58.934033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415919f-3a46-4827-af87-b739545c4dba None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.934320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415919f-3a46-4827-af87-b739545c4dba None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.934592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415919f-3a46-4827-af87-b739545c4dba None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.935868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 59/118] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:55:58.942033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d4c7-fbb6-442e-9af4-cccd4317cb96 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:58.942324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d4c7-fbb6-442e-9af4-cccd4317cb96 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:58.942600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390d4c7-fbb6-442e-9af4-cccd4317cb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:58.982358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8390d4c7-fbb6-442e-9af4-cccd4317cb96 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:55:58.983649 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8390d4c7-fbb6-442e-9af4-cccd4317cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:55:59.008718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412197d8-5726-4169-b3f5-ceb57cda8e4a None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:59.051489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089a3ae-5a95-476a-b6a8-9461d855e43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:59.052133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089a3ae-5a95-476a-b6a8-9461d855e43e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:59.052446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089a3ae-5a95-476a-b6a8-9461d855e43e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:59.052727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089a3ae-5a95-476a-b6a8-9461d855e43e None admin] PATH_INFO: `/v3/users/d69fc1cd23224254975fe218cabc2f20` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:59.056897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089a3ae-5a95-476a-b6a8-9461d855e43e None admin] RBAC: Authorizing `identity:get_user(user_id=d69fc1cd23224254975fe218cabc2f20)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:59.058421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089a3ae-5a95-476a-b6a8-9461d855e43e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:59.063195 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 60/119] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:55:58 2022] GET /identity/v3/users/d69fc1cd23224254975fe218cabc2f20 => generated 247 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:59.070059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089a3ae-5a95-476a-b6a8-9461d855e43e None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:59.118422 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 60/120] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:55:59.195273 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:59.202090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390d4c7-fbb6-442e-9af4-cccd4317cb96 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:59.232945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089a3ae-5a95-476a-b6a8-9461d855e43e None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:59.302299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55538fc-f05c-4091-96a1-6eb72db6a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:59.303188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55538fc-f05c-4091-96a1-6eb72db6a0ee None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:59.303613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55538fc-f05c-4091-96a1-6eb72db6a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:59.304032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55538fc-f05c-4091-96a1-6eb72db6a0ee None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:59.304572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:59.305601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55538fc-f05c-4091-96a1-6eb72db6a0ee None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:59.307202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55538fc-f05c-4091-96a1-6eb72db6a0ee None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:59.309050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 61/121] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:55:59 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:55:59.316473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55538fc-f05c-4091-96a1-6eb72db6a0ee None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:59.414323 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390d4c7-fbb6-442e-9af4-cccd4317cb96 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:59.446672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55538fc-f05c-4091-96a1-6eb72db6a0ee None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:59.493319 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d83a21-785c-4a9b-a565-1a2d55cf0724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:59.494178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d83a21-785c-4a9b-a565-1a2d55cf0724 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:59.494586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d83a21-785c-4a9b-a565-1a2d55cf0724 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:59.494945 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d83a21-785c-4a9b-a565-1a2d55cf0724 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:59.496950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97438fe4-216c-4743-b3b0-c7ea093202ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:59.497959 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97438fe4-216c-4743-b3b0-c7ea093202ed None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:59.498477 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97438fe4-216c-4743-b3b0-c7ea093202ed None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:59.498984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97438fe4-216c-4743-b3b0-c7ea093202ed None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586/users/d69fc1cd23224254975fe218cabc2f20/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:59.501705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97438fe4-216c-4743-b3b0-c7ea093202ed None admin] RBAC: Authorizing `identity:create_grant(project_id=e4665e2f75a74d40883dbd9e329b0586, user_id=d69fc1cd23224254975fe218cabc2f20, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:59.503328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97438fe4-216c-4743-b3b0-c7ea093202ed None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d83a21-785c-4a9b-a565-1a2d55cf0724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-e6d83a21-785c-4a9b-a565-1a2d55cf0724 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:59.520324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:59.527460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:55:59.528548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 61/122] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:55:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:55:59.529486 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d83a21-785c-4a9b-a565-1a2d55cf0724 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:59.583333 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 62/123] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:55:59 2022] PUT /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586/users/d69fc1cd23224254975fe218cabc2f20/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:55:59.584687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97438fe4-216c-4743-b3b0-c7ea093202ed None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:59.640696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:59.641663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d83a21-785c-4a9b-a565-1a2d55cf0724 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:59.653224 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:55:59.682438 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fac51a-2fa8-46f7-9b87-f09c271add71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:59.683110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fac51a-2fa8-46f7-9b87-f09c271add71 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:59.683400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fac51a-2fa8-46f7-9b87-f09c271add71 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:59.683682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fac51a-2fa8-46f7-9b87-f09c271add71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:59.696019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fac51a-2fa8-46f7-9b87-f09c271add71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-b3fac51a-2fa8-46f7-9b87-f09c271add71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:55:59.701033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:55:59.701851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:55:59.702646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 62/124] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:55:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:55:59.703859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fac51a-2fa8-46f7-9b87-f09c271add71 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:59.759982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97438fe4-216c-4743-b3b0-c7ea093202ed None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:59.831073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8a343-c25d-453e-adc9-1ace3b7715b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:59.831710 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8a343-c25d-453e-adc9-1ace3b7715b2 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:59.831995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8a343-c25d-453e-adc9-1ace3b7715b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:59.832335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8a343-c25d-453e-adc9-1ace3b7715b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:55:59.833129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8a343-c25d-453e-adc9-1ace3b7715b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:55:59.833441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8a343-c25d-453e-adc9-1ace3b7715b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:55:59.835031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8a343-c25d-453e-adc9-1ace3b7715b2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:55:59.844724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 63/125] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:55:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:55:59.845655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8a343-c25d-453e-adc9-1ace3b7715b2 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:55:59.900629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fac51a-2fa8-46f7-9b87-f09c271add71 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:55:59.974249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ddf9f-8374-4973-9e5d-c9e7bc6e00c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:55:59.974827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ddf9f-8374-4973-9e5d-c9e7bc6e00c3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:55:59.975111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ddf9f-8374-4973-9e5d-c9e7bc6e00c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:55:59.975391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ddf9f-8374-4973-9e5d-c9e7bc6e00c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:00.000597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:00.000914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ddf9f-8374-4973-9e5d-c9e7bc6e00c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-313ddf9f-8374-4973-9e5d-c9e7bc6e00c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:00.007817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:00.015457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 63/126] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:55:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:00.016324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ddf9f-8374-4973-9e5d-c9e7bc6e00c3 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:00.059483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8a343-c25d-453e-adc9-1ace3b7715b2 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:00.080613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:00.121768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1193cb-a56b-46c8-b188-283a41ad7e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:00.122391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1193cb-a56b-46c8-b188-283a41ad7e9e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:00.122672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1193cb-a56b-46c8-b188-283a41ad7e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:00.122947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1193cb-a56b-46c8-b188-283a41ad7e9e None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:00.123931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1193cb-a56b-46c8-b188-283a41ad7e9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:00.124883 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1193cb-a56b-46c8-b188-283a41ad7e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:00.126297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1193cb-a56b-46c8-b188-283a41ad7e9e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:00.135626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 64/127] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:55:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:00.136482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1193cb-a56b-46c8-b188-283a41ad7e9e None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:00.236204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ddf9f-8374-4973-9e5d-c9e7bc6e00c3 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:00.316606 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871296b-5dde-40b8-8144-430b95596287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:00.317255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871296b-5dde-40b8-8144-430b95596287 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:00.317636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871296b-5dde-40b8-8144-430b95596287 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:00.317914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871296b-5dde-40b8-8144-430b95596287 None admin] PATH_INFO: `/v3/users/e79e9344a59f4e098f27e679467d3246` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:00.320091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871296b-5dde-40b8-8144-430b95596287 None admin] RBAC: Authorizing `identity:get_user(user_id=e79e9344a59f4e098f27e679467d3246)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:00.321588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871296b-5dde-40b8-8144-430b95596287 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:00.323345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 64/128] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:00 2022] GET /identity/v3/users/e79e9344a59f4e098f27e679467d3246 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:00.323917 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871296b-5dde-40b8-8144-430b95596287 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:00.332097 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1193cb-a56b-46c8-b188-283a41ad7e9e None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:00.410330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb47c0-e36f-4a49-88df-9a404cf2ea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:00.410966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb47c0-e36f-4a49-88df-9a404cf2ea83 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:00.411254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb47c0-e36f-4a49-88df-9a404cf2ea83 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:00.411531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb47c0-e36f-4a49-88df-9a404cf2ea83 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:00.412213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb47c0-e36f-4a49-88df-9a404cf2ea83 None admin] RBAC: Adding query filter params (name=member) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:00.412547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb47c0-e36f-4a49-88df-9a404cf2ea83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:00.413951 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb47c0-e36f-4a49-88df-9a404cf2ea83 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:00.421885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:00.439028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 65/129] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:00.440027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb47c0-e36f-4a49-88df-9a404cf2ea83 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:00.464662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:00.476946 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871296b-5dde-40b8-8144-430b95596287 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:00.543832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664cbee-fb00-4128-bd3e-3ac3156750d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:00.548136 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cbee-fb00-4128-bd3e-3ac3156750d5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:00.548457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cbee-fb00-4128-bd3e-3ac3156750d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:00.548733 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cbee-fb00-4128-bd3e-3ac3156750d5 None admin] PATH_INFO: `/v3/users/e79e9344a59f4e098f27e679467d3246` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:00.549931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664cbee-fb00-4128-bd3e-3ac3156750d5 None admin] RBAC: Authorizing `identity:get_user(user_id=e79e9344a59f4e098f27e679467d3246)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:00.551516 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664cbee-fb00-4128-bd3e-3ac3156750d5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:00.557296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 65/130] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:00 2022] GET /identity/v3/users/e79e9344a59f4e098f27e679467d3246 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:00.559993 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664cbee-fb00-4128-bd3e-3ac3156750d5 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:00.650117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb47c0-e36f-4a49-88df-9a404cf2ea83 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:00.736495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cba34-3071-4dfc-9f6a-7dca39d8dc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:00.737220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cba34-3071-4dfc-9f6a-7dca39d8dc16 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:00.737501 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cba34-3071-4dfc-9f6a-7dca39d8dc16 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:00.737777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71cba34-3071-4dfc-9f6a-7dca39d8dc16 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:00.738965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cba34-3071-4dfc-9f6a-7dca39d8dc16 None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:00.740646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71cba34-3071-4dfc-9f6a-7dca39d8dc16 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:00.742614 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 66/131] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:00 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:00.743458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cba34-3071-4dfc-9f6a-7dca39d8dc16 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:00.745475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664cbee-fb00-4128-bd3e-3ac3156750d5 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:00.794312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868e5d5-26cf-497a-b593-b4cbd577abb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:00.794882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e5d5-26cf-497a-b593-b4cbd577abb1 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:00.795165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e5d5-26cf-497a-b593-b4cbd577abb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:00.795438 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868e5d5-26cf-497a-b593-b4cbd577abb1 None admin] PATH_INFO: `/v3/users/e79e9344a59f4e098f27e679467d3246` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:00.798244 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868e5d5-26cf-497a-b593-b4cbd577abb1 None admin] RBAC: Authorizing `identity:get_user(user_id=e79e9344a59f4e098f27e679467d3246)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:00.799961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868e5d5-26cf-497a-b593-b4cbd577abb1 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:00.801600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 66/132] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:00 2022] GET /identity/v3/users/e79e9344a59f4e098f27e679467d3246 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:00.802347 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868e5d5-26cf-497a-b593-b4cbd577abb1 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:00.874099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:00.902393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:00.963283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71cba34-3071-4dfc-9f6a-7dca39d8dc16 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:00.964107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868e5d5-26cf-497a-b593-b4cbd577abb1 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:01.004784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20c2aa-e126-4d63-bc03-49acdf4ef21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:01.005416 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20c2aa-e126-4d63-bc03-49acdf4ef21e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:01.005698 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20c2aa-e126-4d63-bc03-49acdf4ef21e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:01.005972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20c2aa-e126-4d63-bc03-49acdf4ef21e None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:01.006255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace58c88-7bb3-461a-8c94-d28ff66e9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:01.006915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58c88-7bb3-461a-8c94-d28ff66e9ed2 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:01.007077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20c2aa-e126-4d63-bc03-49acdf4ef21e None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:01.007249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58c88-7bb3-461a-8c94-d28ff66e9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:01.007530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace58c88-7bb3-461a-8c94-d28ff66e9ed2 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586/users/e79e9344a59f4e098f27e679467d3246/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:01.008588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20c2aa-e126-4d63-bc03-49acdf4ef21e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:01.009549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace58c88-7bb3-461a-8c94-d28ff66e9ed2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4665e2f75a74d40883dbd9e329b0586, user_id=e79e9344a59f4e098f27e679467d3246, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:01.010361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 67/133] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:00 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:01.011398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace58c88-7bb3-461a-8c94-d28ff66e9ed2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:01.013247 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20c2aa-e126-4d63-bc03-49acdf4ef21e None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:01.112950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 67/134] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:56:00 2022] PUT /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586/users/e79e9344a59f4e098f27e679467d3246/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:01.114343 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef5812-440c-497a-914b-9eb49dc244c2 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:01.114633 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef5812-440c-497a-914b-9eb49dc244c2 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:01.115043 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef5812-440c-497a-914b-9eb49dc244c2 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:01.116566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 68/135] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:01.123470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4109-e412-42d6-a2f9-b743a3afa84a None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:01.123470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4109-e412-42d6-a2f9-b743a3afa84a None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:01.123470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a4109-e412-42d6-a2f9-b743a3afa84a None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:01.123740 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20c2aa-e126-4d63-bc03-49acdf4ef21e None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:01.123814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 69/136] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:01.129005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4109-e412-42d6-a2f9-b743a3afa84a None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:01.165048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f397b5a-9402-4e17-a188-4c595eaa3de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:01.165833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f397b5a-9402-4e17-a188-4c595eaa3de1 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:01.166059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f397b5a-9402-4e17-a188-4c595eaa3de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:01.166347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f397b5a-9402-4e17-a188-4c595eaa3de1 None admin] PATH_INFO: `/v3/projects/14a69497189c4f9a8f7f67f8da320f21` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:01.167763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f397b5a-9402-4e17-a188-4c595eaa3de1 None admin] RBAC: Authorizing `identity:get_project(project_id=14a69497189c4f9a8f7f67f8da320f21)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:01.169395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f397b5a-9402-4e17-a188-4c595eaa3de1 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:01.172403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 68/137] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:01 2022] GET /identity/v3/projects/14a69497189c4f9a8f7f67f8da320f21 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:01.173916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda2cb6-8b81-4713-9f1a-70849b00e9ce None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:01.174195 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda2cb6-8b81-4713-9f1a-70849b00e9ce None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:01.174475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda2cb6-8b81-4713-9f1a-70849b00e9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:01.181466 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:01.195568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-7bda2cb6-8b81-4713-9f1a-70849b00e9ce None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:01.196994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7bda2cb6-8b81-4713-9f1a-70849b00e9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:01.274304 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:01.278815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 69/138] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:01.279996 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87241f3-6921-4991-8b70-6d7694f64b45 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:01.280855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87241f3-6921-4991-8b70-6d7694f64b45 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:01.283995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87241f3-6921-4991-8b70-6d7694f64b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:01.295039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228a4109-e412-42d6-a2f9-b743a3afa84a None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:01.310661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-e87241f3-6921-4991-8b70-6d7694f64b45 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:01.313093 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e87241f3-6921-4991-8b70-6d7694f64b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:01.338383 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9346a84-cf02-40b5-9d70-6729a9826bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:01.339214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9346a84-cf02-40b5-9d70-6729a9826bac None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:01.339599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9346a84-cf02-40b5-9d70-6729a9826bac None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:01.340001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9346a84-cf02-40b5-9d70-6729a9826bac None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586/users/e79e9344a59f4e098f27e679467d3246/roles/2837bb5c87054ea7a046150d413d2561` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:01.342455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9346a84-cf02-40b5-9d70-6729a9826bac None admin] RBAC: Authorizing `identity:create_grant(project_id=e4665e2f75a74d40883dbd9e329b0586, user_id=e79e9344a59f4e098f27e679467d3246, role_id=2837bb5c87054ea7a046150d413d2561)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:01.344618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9346a84-cf02-40b5-9d70-6729a9826bac None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:01.392912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 70/139] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:01.393658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87241f3-6921-4991-8b70-6d7694f64b45 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:01.448487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 70/140] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:56:01 2022] PUT /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586/users/e79e9344a59f4e098f27e679467d3246/roles/2837bb5c87054ea7a046150d413d2561 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:01.480327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:01.537879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87241f3-6921-4991-8b70-6d7694f64b45 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:01.587803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934105f-0b0d-4880-9a9c-449d3de00c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:01.588538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934105f-0b0d-4880-9a9c-449d3de00c6b None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:01.588824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934105f-0b0d-4880-9a9c-449d3de00c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:01.589102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934105f-0b0d-4880-9a9c-449d3de00c6b None admin] PATH_INFO: `/v3/projects/14a69497189c4f9a8f7f67f8da320f21/users/e79e9344a59f4e098f27e679467d3246/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:01.594324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934105f-0b0d-4880-9a9c-449d3de00c6b None admin] RBAC: Authorizing `identity:create_grant(project_id=14a69497189c4f9a8f7f67f8da320f21, user_id=e79e9344a59f4e098f27e679467d3246, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:01.595820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934105f-0b0d-4880-9a9c-449d3de00c6b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:01.653984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9346a84-cf02-40b5-9d70-6729a9826bac None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:01.684821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 71/141] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:56:01 2022] PUT /identity/v3/projects/14a69497189c4f9a8f7f67f8da320f21/users/e79e9344a59f4e098f27e679467d3246/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:01.785778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934105f-0b0d-4880-9a9c-449d3de00c6b None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:01.797458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9346a84-cf02-40b5-9d70-6729a9826bac None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:01.877297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883f24f-3a24-424c-a603-a3b217c0f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:01.878391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883f24f-3a24-424c-a603-a3b217c0f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:01.878914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883f24f-3a24-424c-a603-a3b217c0f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:01.879389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883f24f-3a24-424c-a603-a3b217c0f2f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:01.880824 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883f24f-3a24-424c-a603-a3b217c0f2f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:01.888265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883f24f-3a24-424c-a603-a3b217c0f2f8 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:01.891653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 71/142] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:01.896950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883f24f-3a24-424c-a603-a3b217c0f2f8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:01.925714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934105f-0b0d-4880-9a9c-449d3de00c6b None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:01.944663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:01.966563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef63ab9-125c-4e66-9076-4fe28cfb20f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:01.967639 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef63ab9-125c-4e66-9076-4fe28cfb20f5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:01.968147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef63ab9-125c-4e66-9076-4fe28cfb20f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:01.968781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef63ab9-125c-4e66-9076-4fe28cfb20f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:01.972461 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:01.981565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef63ab9-125c-4e66-9076-4fe28cfb20f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-8ef63ab9-125c-4e66-9076-4fe28cfb20f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:01.986917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:01.987803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:01.988586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:01.990917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 72/143] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:56:02.002662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef63ab9-125c-4e66-9076-4fe28cfb20f5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:02.072147 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883f24f-3a24-424c-a603-a3b217c0f2f8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:02.117381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d596ab-4c6e-484a-a15d-1458ccd3996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:02.118203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d596ab-4c6e-484a-a15d-1458ccd3996b None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:02.118376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d596ab-4c6e-484a-a15d-1458ccd3996b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:02.119172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d596ab-4c6e-484a-a15d-1458ccd3996b None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:02.119607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d596ab-4c6e-484a-a15d-1458ccd3996b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:02.121724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d596ab-4c6e-484a-a15d-1458ccd3996b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:02.145587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef63ab9-125c-4e66-9076-4fe28cfb20f5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:02.185267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772739bf-4a2a-42fc-be03-d5a7fc32fdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:02.186239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772739bf-4a2a-42fc-be03-d5a7fc32fdd3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:02.187251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772739bf-4a2a-42fc-be03-d5a7fc32fdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:02.188007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772739bf-4a2a-42fc-be03-d5a7fc32fdd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:02.188922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772739bf-4a2a-42fc-be03-d5a7fc32fdd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:02.189429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772739bf-4a2a-42fc-be03-d5a7fc32fdd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:02.191069 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772739bf-4a2a-42fc-be03-d5a7fc32fdd3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:02.200651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 73/144] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:02.202401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea508c-6210-4053-a3cd-d20e9a9af3e4 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:02.202923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea508c-6210-4053-a3cd-d20e9a9af3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:02.203388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea508c-6210-4053-a3cd-d20e9a9af3e4 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:02.205219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 74/145] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:02.206179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea508c-6210-4053-a3cd-d20e9a9af3e4 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:02.231454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 72/146] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:56:01 2022] POST /identity/v3/users => generated 283 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:56:02.232760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb1c6-e4a9-4153-a098-1f859a52844f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:02.233121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb1c6-e4a9-4153-a098-1f859a52844f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:02.233982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb1c6-e4a9-4153-a098-1f859a52844f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:02.261623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:02.269777 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-39dcb1c6-e4a9-4153-a098-1f859a52844f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:02.271146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-39dcb1c6-e4a9-4153-a098-1f859a52844f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:02.370335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea508c-6210-4053-a3cd-d20e9a9af3e4 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:02.426014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 73/147] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:02.436761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e21b6-d68b-4618-a6b8-0bac40deef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:02.438139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e21b6-d68b-4618-a6b8-0bac40deef73 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:02.438632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e21b6-d68b-4618-a6b8-0bac40deef73 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:02.439102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e21b6-d68b-4618-a6b8-0bac40deef73 None admin] PATH_INFO: `/v3/users/dd979face29840c3a24441467f722da8` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:02.440475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e21b6-d68b-4618-a6b8-0bac40deef73 None admin] RBAC: Authorizing `identity:get_user(user_id=dd979face29840c3a24441467f722da8)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:02.442132 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e21b6-d68b-4618-a6b8-0bac40deef73 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:02.443929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 75/148] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:02 2022] GET /identity/v3/users/dd979face29840c3a24441467f722da8 => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:02.449723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcb1c6-e4a9-4153-a098-1f859a52844f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:02.459468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:02.570600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcb1c6-e4a9-4153-a098-1f859a52844f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:02.606532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2724db-3fae-4efd-8075-e3904ab21c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:02.607504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2724db-3fae-4efd-8075-e3904ab21c73 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:02.608142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2724db-3fae-4efd-8075-e3904ab21c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:02.609254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2724db-3fae-4efd-8075-e3904ab21c73 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:02.610666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2724db-3fae-4efd-8075-e3904ab21c73 None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:02.612327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2724db-3fae-4efd-8075-e3904ab21c73 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:02.614153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 74/149] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:02 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:02.619893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e21b6-d68b-4618-a6b8-0bac40deef73 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:02.739543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e21b6-d68b-4618-a6b8-0bac40deef73 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:02.755523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:02.783086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653e2c-ae6f-4013-83f8-e274b3da5c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:02.784130 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653e2c-ae6f-4013-83f8-e274b3da5c95 None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:02.784721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653e2c-ae6f-4013-83f8-e274b3da5c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:02.785251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3653e2c-ae6f-4013-83f8-e274b3da5c95 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586/users/dd979face29840c3a24441467f722da8/roles/4913cb9f208f4c4892f61e1433923571` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:02.787419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3653e2c-ae6f-4013-83f8-e274b3da5c95 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4665e2f75a74d40883dbd9e329b0586, user_id=dd979face29840c3a24441467f722da8, role_id=4913cb9f208f4c4892f61e1433923571)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:02.789131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3653e2c-ae6f-4013-83f8-e274b3da5c95 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:02.861534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 76/150] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:56:02 2022] PUT /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586/users/dd979face29840c3a24441467f722da8/roles/4913cb9f208f4c4892f61e1433923571 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:56:02.912162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2724db-3fae-4efd-8075-e3904ab21c73 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:03.020073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:03.056975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2724db-3fae-4efd-8075-e3904ab21c73 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:03.096519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528c918-d09a-47a7-984d-324f13036f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:03.097171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c918-d09a-47a7-984d-324f13036f1c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:03.097431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c918-d09a-47a7-984d-324f13036f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:03.097703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528c918-d09a-47a7-984d-324f13036f1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:03.109739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528c918-d09a-47a7-984d-324f13036f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-0528c918-d09a-47a7-984d-324f13036f1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:03.116327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:03.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:03.117994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 75/151] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:56:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:03.123282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653e2c-ae6f-4013-83f8-e274b3da5c95 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:03.255908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3653e2c-ae6f-4013-83f8-e274b3da5c95 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:03.301606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667858c-154e-40d2-bd6d-15b0bf158968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:03.302246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667858c-154e-40d2-bd6d-15b0bf158968 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:03.302560 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667858c-154e-40d2-bd6d-15b0bf158968 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:03.302873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667858c-154e-40d2-bd6d-15b0bf158968 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:03.303639 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667858c-154e-40d2-bd6d-15b0bf158968 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:03.303966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667858c-154e-40d2-bd6d-15b0bf158968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:03.305419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667858c-154e-40d2-bd6d-15b0bf158968 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:03.316597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 77/152] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:03.322368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528c918-d09a-47a7-984d-324f13036f1c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:03.441085 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528c918-d09a-47a7-984d-324f13036f1c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:03.482756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ec2cc-1e18-416b-a847-9c646efe25ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:03.483961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ec2cc-1e18-416b-a847-9c646efe25ca None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:03.484257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ec2cc-1e18-416b-a847-9c646efe25ca None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:03.484545 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ec2cc-1e18-416b-a847-9c646efe25ca None admin] PATH_INFO: `/v3/users/d69fc1cd23224254975fe218cabc2f20` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:03.485737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ec2cc-1e18-416b-a847-9c646efe25ca None admin] RBAC: Authorizing `identity:get_user(user_id=d69fc1cd23224254975fe218cabc2f20)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:03.487222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ec2cc-1e18-416b-a847-9c646efe25ca None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:03.489182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 76/153] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:03 2022] GET /identity/v3/users/d69fc1cd23224254975fe218cabc2f20 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:03.494670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667858c-154e-40d2-bd6d-15b0bf158968 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:03.533070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:03.608118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f30e76-974a-4fb1-a949-bc978477d5fe None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:03.611060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f30e76-974a-4fb1-a949-bc978477d5fe None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:03.611060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f30e76-974a-4fb1-a949-bc978477d5fe None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:03.611060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 77/154] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:56:03.618789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667858c-154e-40d2-bd6d-15b0bf158968 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:03.619724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34404de-eb50-4abc-863a-88e1f205b89b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:03.620217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34404de-eb50-4abc-863a-88e1f205b89b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:03.620912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34404de-eb50-4abc-863a-88e1f205b89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:03.640599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:03.646852 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e34404de-eb50-4abc-863a-88e1f205b89b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:03.649514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e34404de-eb50-4abc-863a-88e1f205b89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:03.689570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc585e44-d0df-4fe3-a630-f57e648f65e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:03.690543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc585e44-d0df-4fe3-a630-f57e648f65e9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:03.691010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc585e44-d0df-4fe3-a630-f57e648f65e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:03.691468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc585e44-d0df-4fe3-a630-f57e648f65e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:03.794393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 78/155] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:03.809253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc585e44-d0df-4fe3-a630-f57e648f65e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:03.811135 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc585e44-d0df-4fe3-a630-f57e648f65e9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:03.857296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:03.940282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 78/156] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:03.946273 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34404de-eb50-4abc-863a-88e1f205b89b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:04.073577 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34404de-eb50-4abc-863a-88e1f205b89b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:04.118763 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:04.125099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f127f-2a37-4d3b-a4df-7a3adbc3f914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:04.125799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f127f-2a37-4d3b-a4df-7a3adbc3f914 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:04.126074 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f127f-2a37-4d3b-a4df-7a3adbc3f914 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:04.126361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f127f-2a37-4d3b-a4df-7a3adbc3f914 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:04.128915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f127f-2a37-4d3b-a4df-7a3adbc3f914 None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:04.130363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f127f-2a37-4d3b-a4df-7a3adbc3f914 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:04.134941 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 79/157] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:03 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:04.138124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc585e44-d0df-4fe3-a630-f57e648f65e9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:04.256858 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc585e44-d0df-4fe3-a630-f57e648f65e9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:04.300157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd6853-ad24-42ea-bae1-5e0fab55ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:04.300810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd6853-ad24-42ea-bae1-5e0fab55ea9e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:04.301090 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd6853-ad24-42ea-bae1-5e0fab55ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:04.301361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd6853-ad24-42ea-bae1-5e0fab55ea9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:04.302098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd6853-ad24-42ea-bae1-5e0fab55ea9e None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=e4665e2f75a74d40883dbd9e329b0586, user.id=d69fc1cd23224254975fe218cabc2f20) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:04.302404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd6853-ad24-42ea-bae1-5e0fab55ea9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:04.310190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd6853-ad24-42ea-bae1-5e0fab55ea9e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:04.313083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:04.317694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 79/158] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:04 2022] GET /identity/v3/role_assignments?user.id=d69fc1cd23224254975fe218cabc2f20&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:04.527781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f127f-2a37-4d3b-a4df-7a3adbc3f914 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:04.652408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f127f-2a37-4d3b-a4df-7a3adbc3f914 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:04.694223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7488711-de3e-4822-9027-13d85d6d738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:04.694851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7488711-de3e-4822-9027-13d85d6d738b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:04.695127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7488711-de3e-4822-9027-13d85d6d738b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:04.695396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7488711-de3e-4822-9027-13d85d6d738b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:04.717173 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7488711-de3e-4822-9027-13d85d6d738b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-e7488711-de3e-4822-9027-13d85d6d738b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:04.723652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:04.724542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:04.725415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 80/159] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:04.730745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd6853-ad24-42ea-bae1-5e0fab55ea9e None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:04.853884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd6853-ad24-42ea-bae1-5e0fab55ea9e None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:04.896149 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e683cf-e094-4d03-9220-70ad576f9607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:04.896810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e683cf-e094-4d03-9220-70ad576f9607 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:04.897086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e683cf-e094-4d03-9220-70ad576f9607 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:04.897355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e683cf-e094-4d03-9220-70ad576f9607 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:04.898087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e683cf-e094-4d03-9220-70ad576f9607 None admin] RBAC: Adding query filter params (name=member) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:04.898384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e683cf-e094-4d03-9220-70ad576f9607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:04.899864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e683cf-e094-4d03-9220-70ad576f9607 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:04.910651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 80/160] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:04.916861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7488711-de3e-4822-9027-13d85d6d738b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:05.006826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:05.055939 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7488711-de3e-4822-9027-13d85d6d738b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:05.100382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba037bc-eb32-4c01-960a-d4bcb0b86e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:05.101013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba037bc-eb32-4c01-960a-d4bcb0b86e53 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:05.101288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba037bc-eb32-4c01-960a-d4bcb0b86e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:05.101553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba037bc-eb32-4c01-960a-d4bcb0b86e53 None admin] PATH_INFO: `/v3/users/e79e9344a59f4e098f27e679467d3246` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:05.102704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba037bc-eb32-4c01-960a-d4bcb0b86e53 None admin] RBAC: Authorizing `identity:get_user(user_id=e79e9344a59f4e098f27e679467d3246)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:05.104296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba037bc-eb32-4c01-960a-d4bcb0b86e53 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:05.105973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 81/161] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:04 2022] GET /identity/v3/users/e79e9344a59f4e098f27e679467d3246 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:05.112034 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e683cf-e094-4d03-9220-70ad576f9607 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:05.211699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:05.266556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e683cf-e094-4d03-9220-70ad576f9607 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:05.317560 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34d116-00ae-4ac6-b28d-dca1dae3bc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:05.318191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34d116-00ae-4ac6-b28d-dca1dae3bc0d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:05.318474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34d116-00ae-4ac6-b28d-dca1dae3bc0d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:05.318752 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34d116-00ae-4ac6-b28d-dca1dae3bc0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:05.375855 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b8209-1468-4c2e-b2a0-09fd21dc9736 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:05.376387 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b8209-1468-4c2e-b2a0-09fd21dc9736 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:05.376387 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b8209-1468-4c2e-b2a0-09fd21dc9736 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:05.377925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 82/162] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:05.385879 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ba0c-e8be-4044-8c9c-7d20da75d67b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:05.386154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ba0c-e8be-4044-8c9c-7d20da75d67b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:05.386425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1ba0c-e8be-4044-8c9c-7d20da75d67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:05.399724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34d116-00ae-4ac6-b28d-dca1dae3bc0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:05.401378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34d116-00ae-4ac6-b28d-dca1dae3bc0d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:05.427688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-22c1ba0c-e8be-4044-8c9c-7d20da75d67b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:05.428923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-22c1ba0c-e8be-4044-8c9c-7d20da75d67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:05.470040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:05.506778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 81/163] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:05.513497 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34d116-00ae-4ac6-b28d-dca1dae3bc0d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:05.610696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 83/164] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:05.637488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34d116-00ae-4ac6-b28d-dca1dae3bc0d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:05.679785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e87ec7-2b98-4a44-9cd1-9a1b027095bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:05.680455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e87ec7-2b98-4a44-9cd1-9a1b027095bb None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:05.680737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e87ec7-2b98-4a44-9cd1-9a1b027095bb None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:05.681007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e87ec7-2b98-4a44-9cd1-9a1b027095bb None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:05.682140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e87ec7-2b98-4a44-9cd1-9a1b027095bb None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:05.683584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e87ec7-2b98-4a44-9cd1-9a1b027095bb None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:05.685558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 82/165] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:05 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:05.691745 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1ba0c-e8be-4044-8c9c-7d20da75d67b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:05.706464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15168df8-a781-45f2-8eb7-97dede2b6bd3 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:05.706769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15168df8-a781-45f2-8eb7-97dede2b6bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:05.707029 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15168df8-a781-45f2-8eb7-97dede2b6bd3 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:05.708468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 83/166] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:56:05.721289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff025-4341-4466-a86a-ee5cea8d52c9 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:05.721289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff025-4341-4466-a86a-ee5cea8d52c9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:05.721289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff025-4341-4466-a86a-ee5cea8d52c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:05.741698 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-712ff025-4341-4466-a86a-ee5cea8d52c9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:05.743290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-712ff025-4341-4466-a86a-ee5cea8d52c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:05.770757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:05.839245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 84/167] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:05.843178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:05.918999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1ba0c-e8be-4044-8c9c-7d20da75d67b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:05.972911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08179c-f0ba-4032-9991-0675a3af0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:05.973523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08179c-f0ba-4032-9991-0675a3af0b92 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:05.973799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08179c-f0ba-4032-9991-0675a3af0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:05.974067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08179c-f0ba-4032-9991-0675a3af0b92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:05.974801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08179c-f0ba-4032-9991-0675a3af0b92 None admin] RBAC: Adding query filter params (role.id=24cce6d670834e3ba65b942574313d0a, scope.project.id=e4665e2f75a74d40883dbd9e329b0586, user.id=e79e9344a59f4e098f27e679467d3246) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:05.975103 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08179c-f0ba-4032-9991-0675a3af0b92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:05.976891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08179c-f0ba-4032-9991-0675a3af0b92 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:05.977319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf58b5-27f7-4c41-9d94-61bbfe15d67d None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:05.977605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf58b5-27f7-4c41-9d94-61bbfe15d67d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:05.977883 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf58b5-27f7-4c41-9d94-61bbfe15d67d None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:05.979233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 85/168] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:56:05.989846 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 84/169] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:05 2022] GET /identity/v3/role_assignments?user.id=e79e9344a59f4e098f27e679467d3246&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=24cce6d670834e3ba65b942574313d0a => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:05.991027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a7a7-38da-4cad-85c1-487870d220db None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:05.991315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a7a7-38da-4cad-85c1-487870d220db None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:05.991589 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a7a7-38da-4cad-85c1-487870d220db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:06.026749 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-3f86a7a7-38da-4cad-85c1-487870d220db None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:06.027962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3f86a7a7-38da-4cad-85c1-487870d220db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:06.119180 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 86/170] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:06.167330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08179c-f0ba-4032-9991-0675a3af0b92 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:06.333359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08179c-f0ba-4032-9991-0675a3af0b92 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:06.368610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:06.386290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454fc04-786f-463f-b809-06bf562c9643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:06.388358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454fc04-786f-463f-b809-06bf562c9643 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:06.388358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454fc04-786f-463f-b809-06bf562c9643 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:06.388358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454fc04-786f-463f-b809-06bf562c9643 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:06.403572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454fc04-786f-463f-b809-06bf562c9643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-5454fc04-786f-463f-b809-06bf562c9643 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:06.409375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:06.410253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:06.411089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:06.413799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 85/171] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:56:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:06.419628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86a7a7-38da-4cad-85c1-487870d220db None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:06.480406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454fc04-786f-463f-b809-06bf562c9643 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:06.558965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86a7a7-38da-4cad-85c1-487870d220db None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:06.572626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:06.597077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56ab65-c300-4246-9290-517a4807684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:06.597748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ab65-c300-4246-9290-517a4807684d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:06.598033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ab65-c300-4246-9290-517a4807684d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:06.598309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56ab65-c300-4246-9290-517a4807684d None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:06.598996 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56ab65-c300-4246-9290-517a4807684d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:06.599299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56ab65-c300-4246-9290-517a4807684d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:06.600730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56ab65-c300-4246-9290-517a4807684d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:06.610220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 87/172] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:06.615868 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56ab65-c300-4246-9290-517a4807684d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:06.672888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454fc04-786f-463f-b809-06bf562c9643 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:06.721102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d9843-38dc-4854-9403-5169bd692cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:06.722005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d9843-38dc-4854-9403-5169bd692cda None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:06.722467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d9843-38dc-4854-9403-5169bd692cda None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:06.722949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d9843-38dc-4854-9403-5169bd692cda None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:06.729530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56ab65-c300-4246-9290-517a4807684d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:06.735559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d9843-38dc-4854-9403-5169bd692cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-144d9843-38dc-4854-9403-5169bd692cda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:06.741496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:06.742574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:06.743612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:06.745553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 86/173] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:56:06.746491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d9843-38dc-4854-9403-5169bd692cda None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:06.767674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4638be-a8ca-40ab-bf7a-bd60bc76763f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:06.768359 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4638be-a8ca-40ab-bf7a-bd60bc76763f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:06.768713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4638be-a8ca-40ab-bf7a-bd60bc76763f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:06.769426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4638be-a8ca-40ab-bf7a-bd60bc76763f None admin] PATH_INFO: `/v3/users/e79e9344a59f4e098f27e679467d3246` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:06.770882 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4638be-a8ca-40ab-bf7a-bd60bc76763f None admin] RBAC: Authorizing `identity:get_user(user_id=e79e9344a59f4e098f27e679467d3246)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:06.772889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4638be-a8ca-40ab-bf7a-bd60bc76763f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:06.776316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 88/174] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:06 2022] GET /identity/v3/users/e79e9344a59f4e098f27e679467d3246 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:06.777796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dec3d-0f21-4849-a405-9768f8a841f2 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:06.778240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dec3d-0f21-4849-a405-9768f8a841f2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:06.778710 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dec3d-0f21-4849-a405-9768f8a841f2 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:06.782317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 89/175] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:06.785301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dec3d-0f21-4849-a405-9768f8a841f2 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:06.809578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:06.818760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:06.888377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d9843-38dc-4854-9403-5169bd692cda None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:06.925596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf0775-9738-4e54-9c8b-daafe7f0ae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:06.926188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf0775-9738-4e54-9c8b-daafe7f0ae3c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:06.926468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf0775-9738-4e54-9c8b-daafe7f0ae3c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:06.926737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf0775-9738-4e54-9c8b-daafe7f0ae3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:06.938228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf0775-9738-4e54-9c8b-daafe7f0ae3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-05cf0775-9738-4e54-9c8b-daafe7f0ae3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:06.943461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:06.944499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 87/176] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:06.945643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf0775-9738-4e54-9c8b-daafe7f0ae3c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:07.001048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dec3d-0f21-4849-a405-9768f8a841f2 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:07.050173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f1fc5-cad5-4bfd-a186-71c49dda22e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:07.050793 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f1fc5-cad5-4bfd-a186-71c49dda22e5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.051074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f1fc5-cad5-4bfd-a186-71c49dda22e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.051346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f1fc5-cad5-4bfd-a186-71c49dda22e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.052024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f1fc5-cad5-4bfd-a186-71c49dda22e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:07.052359 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f1fc5-cad5-4bfd-a186-71c49dda22e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:07.054321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f1fc5-cad5-4bfd-a186-71c49dda22e5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:07.066704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 90/177] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:07.067850 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ca84-0333-4a61-bd63-fbf7acf50634 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.068135 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ca84-0333-4a61-bd63-fbf7acf50634 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.068456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ca84-0333-4a61-bd63-fbf7acf50634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.089367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf0775-9738-4e54-9c8b-daafe7f0ae3c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:07.091060 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b6a8ca84-0333-4a61-bd63-fbf7acf50634 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:07.091964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:07.093660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b6a8ca84-0333-4a61-bd63-fbf7acf50634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:07.138900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a10492-3c89-4ccc-a559-61fa0cd679c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:07.139735 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a10492-3c89-4ccc-a559-61fa0cd679c3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.140749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a10492-3c89-4ccc-a559-61fa0cd679c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.141037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a10492-3c89-4ccc-a559-61fa0cd679c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.177669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 91/178] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:07.178830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8ca84-0333-4a61-bd63-fbf7acf50634 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:07.194395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:07.226923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a10492-3c89-4ccc-a559-61fa0cd679c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:07.228844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a10492-3c89-4ccc-a559-61fa0cd679c3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:07.316426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8ca84-0333-4a61-bd63-fbf7acf50634 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:07.343605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 88/179] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:07.344634 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a10492-3c89-4ccc-a559-61fa0cd679c3 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:07.346961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:07.357922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8786d-0214-4581-abd2-8530b2526494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:07.359316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8786d-0214-4581-abd2-8530b2526494 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.359757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8786d-0214-4581-abd2-8530b2526494 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.360030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8786d-0214-4581-abd2-8530b2526494 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.366208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8786d-0214-4581-abd2-8530b2526494 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:07.366208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8786d-0214-4581-abd2-8530b2526494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:07.366208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8786d-0214-4581-abd2-8530b2526494 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:07.372069 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 92/180] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:07.373328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d7d4-3fae-4ea2-8a1c-50412c2d0847 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.373629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d7d4-3fae-4ea2-8a1c-50412c2d0847 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.374649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1d7d4-3fae-4ea2-8a1c-50412c2d0847 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.376061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 93/181] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:07.376914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339e440-c5d6-4afe-8a41-cc7805890d82 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.377157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339e440-c5d6-4afe-8a41-cc7805890d82 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.377462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339e440-c5d6-4afe-8a41-cc7805890d82 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.378676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 94/182] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:07.380259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339e440-c5d6-4afe-8a41-cc7805890d82 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:07.456026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:07.463204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a10492-3c89-4ccc-a559-61fa0cd679c3 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:07.489125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339e440-c5d6-4afe-8a41-cc7805890d82 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:07.497794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237aadd5-0071-432b-8188-ff4e76b13fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:07.498419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aadd5-0071-432b-8188-ff4e76b13fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.498747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aadd5-0071-432b-8188-ff4e76b13fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.499117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237aadd5-0071-432b-8188-ff4e76b13fd4 None admin] PATH_INFO: `/v3/users/e79e9344a59f4e098f27e679467d3246` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.500311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237aadd5-0071-432b-8188-ff4e76b13fd4 None admin] RBAC: Authorizing `identity:get_user(user_id=e79e9344a59f4e098f27e679467d3246)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:07.501763 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237aadd5-0071-432b-8188-ff4e76b13fd4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:07.503334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 89/183] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:07 2022] GET /identity/v3/users/e79e9344a59f4e098f27e679467d3246 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:07.505083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237aadd5-0071-432b-8188-ff4e76b13fd4 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:07.524090 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618a0e-1363-4ea5-b45c-8bc262e4770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:07.524763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618a0e-1363-4ea5-b45c-8bc262e4770b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.525041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618a0e-1363-4ea5-b45c-8bc262e4770b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.525313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618a0e-1363-4ea5-b45c-8bc262e4770b None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.526431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d618a0e-1363-4ea5-b45c-8bc262e4770b None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:07.527893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d618a0e-1363-4ea5-b45c-8bc262e4770b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:07.529559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 95/184] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:07 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:07.531462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4d2d1-945b-4405-80d0-b261aa16961a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.531674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4d2d1-945b-4405-80d0-b261aa16961a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.531953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4d2d1-945b-4405-80d0-b261aa16961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.550287 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-d2b4d2d1-945b-4405-80d0-b261aa16961a None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:07.551492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d2b4d2d1-945b-4405-80d0-b261aa16961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:07.575125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:07.607103 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237aadd5-0071-432b-8188-ff4e76b13fd4 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:07.619618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 96/185] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:07.627317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9934a78-de5e-46c8-9bd7-fff3777987e0 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.627317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9934a78-de5e-46c8-9bd7-fff3777987e0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.627317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9934a78-de5e-46c8-9bd7-fff3777987e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.641432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d2e3-b942-4462-9663-7ac14707bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:07.642490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d2e3-b942-4462-9663-7ac14707bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.642773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d2e3-b942-4462-9663-7ac14707bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.643049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688d2e3-b942-4462-9663-7ac14707bbb5 None admin] PATH_INFO: `/v3/users/dd979face29840c3a24441467f722da8` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.644188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688d2e3-b942-4462-9663-7ac14707bbb5 None admin] RBAC: Authorizing `identity:get_user(user_id=dd979face29840c3a24441467f722da8)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:07.645658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688d2e3-b942-4462-9663-7ac14707bbb5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:07.647457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 90/186] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:07 2022] GET /identity/v3/users/dd979face29840c3a24441467f722da8 => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:07.647561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-e9934a78-de5e-46c8-9bd7-fff3777987e0 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:07.648841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e9934a78-de5e-46c8-9bd7-fff3777987e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:07.649304 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d2e3-b942-4462-9663-7ac14707bbb5 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:07.718592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:07.732264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 97/187] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:07.732264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9934a78-de5e-46c8-9bd7-fff3777987e0 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:07.777312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688d2e3-b942-4462-9663-7ac14707bbb5 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:07.822230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9742c7-7904-43fa-bad1-0c2d07b2fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:07.822869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9742c7-7904-43fa-bad1-0c2d07b2fd59 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.823155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9742c7-7904-43fa-bad1-0c2d07b2fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.823431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9742c7-7904-43fa-bad1-0c2d07b2fd59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.836939 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:07.841827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9742c7-7904-43fa-bad1-0c2d07b2fd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:07.843583 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9934a78-de5e-46c8-9bd7-fff3777987e0 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-ef9742c7-7904-43fa-bad1-0c2d07b2fd59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:07.847624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:07.848512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:07.849275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:07.851242 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 91/188] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:56:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:07.852340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9742c7-7904-43fa-bad1-0c2d07b2fd59 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:07.882987 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441577b1-373d-4241-a70a-d59ad594d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:07.883586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441577b1-373d-4241-a70a-d59ad594d458 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.883804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441577b1-373d-4241-a70a-d59ad594d458 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.884080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441577b1-373d-4241-a70a-d59ad594d458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.957222 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:07.959245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441577b1-373d-4241-a70a-d59ad594d458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:07.960783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441577b1-373d-4241-a70a-d59ad594d458 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:07.961570 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9742c7-7904-43fa-bad1-0c2d07b2fd59 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:07.997207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f2f47-f8f5-4cab-b14a-5393c36c3e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:07.997785 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2f47-f8f5-4cab-b14a-5393c36c3e80 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:07.998058 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2f47-f8f5-4cab-b14a-5393c36c3e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:07.998324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2f47-f8f5-4cab-b14a-5393c36c3e80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:07.999314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f2f47-f8f5-4cab-b14a-5393c36c3e80 None admin] RBAC: Adding query filter params (role.id=2837bb5c87054ea7a046150d413d2561, scope.project.id=e4665e2f75a74d40883dbd9e329b0586, user.id=e79e9344a59f4e098f27e679467d3246) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:07.999677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f2f47-f8f5-4cab-b14a-5393c36c3e80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:08.001111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f2f47-f8f5-4cab-b14a-5393c36c3e80 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:08.016257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 92/189] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:07 2022] GET /identity/v3/role_assignments?user.id=e79e9344a59f4e098f27e679467d3246&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=2837bb5c87054ea7a046150d413d2561 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:08.016257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f2f47-f8f5-4cab-b14a-5393c36c3e80 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:08.093281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 98/190] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:08.094620 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441577b1-373d-4241-a70a-d59ad594d458 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:08.102028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:08.148469 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f2f47-f8f5-4cab-b14a-5393c36c3e80 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:08.189493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b4f53-1bd8-41a8-a06f-23d8a3af14d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:08.190198 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4f53-1bd8-41a8-a06f-23d8a3af14d2 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:08.190472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4f53-1bd8-41a8-a06f-23d8a3af14d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:08.190743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b4f53-1bd8-41a8-a06f-23d8a3af14d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:08.209120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:08.212796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441577b1-373d-4241-a70a-d59ad594d458 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:08.250210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f747e-f579-4888-abf6-81f47d43b594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:08.250802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f747e-f579-4888-abf6-81f47d43b594 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:08.251075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f747e-f579-4888-abf6-81f47d43b594 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:08.251342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f747e-f579-4888-abf6-81f47d43b594 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:08.252004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f747e-f579-4888-abf6-81f47d43b594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:08.252352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f747e-f579-4888-abf6-81f47d43b594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:08.253813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f747e-f579-4888-abf6-81f47d43b594 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:08.262065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 99/191] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:08.262859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f747e-f579-4888-abf6-81f47d43b594 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:08.279027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b4f53-1bd8-41a8-a06f-23d8a3af14d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:08.281268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b4f53-1bd8-41a8-a06f-23d8a3af14d2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:08.345363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:08.362942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f747e-f579-4888-abf6-81f47d43b594 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:08.387672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 93/192] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:08.388613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b4f53-1bd8-41a8-a06f-23d8a3af14d2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:08.402487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161176f3-8398-4dd2-b480-c2eb4fb3dbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:08.403098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161176f3-8398-4dd2-b480-c2eb4fb3dbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:08.403380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161176f3-8398-4dd2-b480-c2eb4fb3dbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:08.403650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161176f3-8398-4dd2-b480-c2eb4fb3dbe0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:08.404781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161176f3-8398-4dd2-b480-c2eb4fb3dbe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:08.406855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161176f3-8398-4dd2-b480-c2eb4fb3dbe0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:08.408451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 100/193] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:08.409203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161176f3-8398-4dd2-b480-c2eb4fb3dbe0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:08.439704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:08.492245 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b4f53-1bd8-41a8-a06f-23d8a3af14d2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:08.513483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161176f3-8398-4dd2-b480-c2eb4fb3dbe0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:08.527243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11be45-4882-4bee-a97f-13e35e956dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:08.527870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11be45-4882-4bee-a97f-13e35e956dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:08.528153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11be45-4882-4bee-a97f-13e35e956dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:08.528498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11be45-4882-4bee-a97f-13e35e956dc2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:08.538439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11be45-4882-4bee-a97f-13e35e956dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-6c11be45-4882-4bee-a97f-13e35e956dc2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:08.543184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:08.544203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 94/194] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:56:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:08.549736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11be45-4882-4bee-a97f-13e35e956dc2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:08.553078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032596df-c26e-4f54-9de3-b32fa3ffb3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:08.553722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032596df-c26e-4f54-9de3-b32fa3ffb3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:08.554004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032596df-c26e-4f54-9de3-b32fa3ffb3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:08.554271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032596df-c26e-4f54-9de3-b32fa3ffb3e8 None admin] PATH_INFO: `/v3/projects/14a69497189c4f9a8f7f67f8da320f21` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:08.555406 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032596df-c26e-4f54-9de3-b32fa3ffb3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=14a69497189c4f9a8f7f67f8da320f21)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:08.556913 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032596df-c26e-4f54-9de3-b32fa3ffb3e8 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:08.558715 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 101/195] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:08 2022] GET /identity/v3/projects/14a69497189c4f9a8f7f67f8da320f21 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:08.559302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032596df-c26e-4f54-9de3-b32fa3ffb3e8 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:08.575738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:08.653794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11be45-4882-4bee-a97f-13e35e956dc2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:08.658139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:08.661496 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032596df-c26e-4f54-9de3-b32fa3ffb3e8 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:08.688909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24b054-6a10-40bc-a938-1068d7558069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:08.689543 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24b054-6a10-40bc-a938-1068d7558069 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:08.689826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24b054-6a10-40bc-a938-1068d7558069 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:08.690098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24b054-6a10-40bc-a938-1068d7558069 None admin] PATH_INFO: `/v3/users/03327f326b1046fea97ce4efaa4f9eaa` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:08.695879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01214249-2f9c-4315-aedc-9fa70bf1736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:08.696534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01214249-2f9c-4315-aedc-9fa70bf1736f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:08.696811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01214249-2f9c-4315-aedc-9fa70bf1736f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:08.697080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01214249-2f9c-4315-aedc-9fa70bf1736f None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:08.698189 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01214249-2f9c-4315-aedc-9fa70bf1736f None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:08.699644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01214249-2f9c-4315-aedc-9fa70bf1736f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:08.701296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 102/196] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:08 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:08.702637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01214249-2f9c-4315-aedc-9fa70bf1736f None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:08.707708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24b054-6a10-40bc-a938-1068d7558069 None admin] RBAC: Authorizing `identity:get_user(user_id=03327f326b1046fea97ce4efaa4f9eaa)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:08.709272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24b054-6a10-40bc-a938-1068d7558069 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:08.710940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 95/197] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:08 2022] GET /identity/v3/users/03327f326b1046fea97ce4efaa4f9eaa => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:08.711698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24b054-6a10-40bc-a938-1068d7558069 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:08.791509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:08.810317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24b054-6a10-40bc-a938-1068d7558069 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:08.812295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01214249-2f9c-4315-aedc-9fa70bf1736f None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:08.846153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce6470-f9b3-4962-aa2c-cb84bee0a621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:08.846537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2cf7e-3cfe-4f0f-b69c-49987b9f6271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:08.846812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6470-f9b3-4962-aa2c-cb84bee0a621 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:08.847091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6470-f9b3-4962-aa2c-cb84bee0a621 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:08.847182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2cf7e-3cfe-4f0f-b69c-49987b9f6271 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:08.847361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce6470-f9b3-4962-aa2c-cb84bee0a621 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:08.847457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2cf7e-3cfe-4f0f-b69c-49987b9f6271 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:08.847701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2cf7e-3cfe-4f0f-b69c-49987b9f6271 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:08.848003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce6470-f9b3-4962-aa2c-cb84bee0a621 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:08.848403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2cf7e-3cfe-4f0f-b69c-49987b9f6271 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:08.848710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2cf7e-3cfe-4f0f-b69c-49987b9f6271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:08.849486 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce6470-f9b3-4962-aa2c-cb84bee0a621 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:08.850095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2cf7e-3cfe-4f0f-b69c-49987b9f6271 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:08.858814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 96/198] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:08.859617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2cf7e-3cfe-4f0f-b69c-49987b9f6271 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:08.956409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 103/199] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:56:08 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:56:08.956409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce6470-f9b3-4962-aa2c-cb84bee0a621 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:08.964108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2cf7e-3cfe-4f0f-b69c-49987b9f6271 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:08.972608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:09.005398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fba216-bae4-4d5d-b0c3-0af180a9202e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:09.006070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fba216-bae4-4d5d-b0c3-0af180a9202e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:09.006350 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fba216-bae4-4d5d-b0c3-0af180a9202e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:09.006619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fba216-bae4-4d5d-b0c3-0af180a9202e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:09.007790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fba216-bae4-4d5d-b0c3-0af180a9202e None admin] RBAC: Adding query filter params (role.id=24cce6d670834e3ba65b942574313d0a, scope.project.id=14a69497189c4f9a8f7f67f8da320f21, user.id=e79e9344a59f4e098f27e679467d3246) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:09.008278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fba216-bae4-4d5d-b0c3-0af180a9202e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:09.009836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fba216-bae4-4d5d-b0c3-0af180a9202e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:09.020276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 97/200] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:08 2022] GET /identity/v3/role_assignments?user.id=e79e9344a59f4e098f27e679467d3246&scope.project.id=14a69497189c4f9a8f7f67f8da320f21&role.id=24cce6d670834e3ba65b942574313d0a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:09.020276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fba216-bae4-4d5d-b0c3-0af180a9202e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:09.029054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:09.084063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce6470-f9b3-4962-aa2c-cb84bee0a621 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:09.135285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c828df-b12a-476c-8dda-2891d23230d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:09.135923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c828df-b12a-476c-8dda-2891d23230d1 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:09.136206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c828df-b12a-476c-8dda-2891d23230d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:09.136509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c828df-b12a-476c-8dda-2891d23230d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:09.137262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c828df-b12a-476c-8dda-2891d23230d1 None admin] RBAC: Adding query filter params (role.id=4913cb9f208f4c4892f61e1433923571, scope.project.id=e4665e2f75a74d40883dbd9e329b0586, user.id=dd979face29840c3a24441467f722da8) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:09.137574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c828df-b12a-476c-8dda-2891d23230d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:09.139083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c828df-b12a-476c-8dda-2891d23230d1 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:09.150363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 104/201] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:08 2022] GET /identity/v3/role_assignments?user.id=dd979face29840c3a24441467f722da8&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=4913cb9f208f4c4892f61e1433923571 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:09.150551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c828df-b12a-476c-8dda-2891d23230d1 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:09.169900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fba216-bae4-4d5d-b0c3-0af180a9202e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:09.226276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90168d1d-3ab8-4104-96b4-e5eeed24d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:09.226921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90168d1d-3ab8-4104-96b4-e5eeed24d54f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:09.227202 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90168d1d-3ab8-4104-96b4-e5eeed24d54f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:09.227474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90168d1d-3ab8-4104-96b4-e5eeed24d54f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:09.330453 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:09.335433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90168d1d-3ab8-4104-96b4-e5eeed24d54f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:09.337521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90168d1d-3ab8-4104-96b4-e5eeed24d54f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:09.345064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c828df-b12a-476c-8dda-2891d23230d1 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:09.351203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:09.385927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d24a2-08e4-46c9-b1c6-25e451742b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:09.386574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d24a2-08e4-46c9-b1c6-25e451742b05 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:09.386853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d24a2-08e4-46c9-b1c6-25e451742b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:09.387128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d24a2-08e4-46c9-b1c6-25e451742b05 None admin] PATH_INFO: `/v3/users/03327f326b1046fea97ce4efaa4f9eaa` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:09.389985 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d24a2-08e4-46c9-b1c6-25e451742b05 None admin] RBAC: Authorizing `identity:get_user(user_id=03327f326b1046fea97ce4efaa4f9eaa)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:09.390925 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d24a2-08e4-46c9-b1c6-25e451742b05 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:09.392712 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 105/202] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:09 2022] GET /identity/v3/users/03327f326b1046fea97ce4efaa4f9eaa => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:09.399014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d24a2-08e4-46c9-b1c6-25e451742b05 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:09.482858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 98/203] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:09.489149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90168d1d-3ab8-4104-96b4-e5eeed24d54f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:09.556057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d24a2-08e4-46c9-b1c6-25e451742b05 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:09.594163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e41aea-2e16-480e-9507-61b252fb8b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:09.594889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e41aea-2e16-480e-9507-61b252fb8b62 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:09.595285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e41aea-2e16-480e-9507-61b252fb8b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:09.595565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e41aea-2e16-480e-9507-61b252fb8b62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:09.604157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90168d1d-3ab8-4104-96b4-e5eeed24d54f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:09.613308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:09.622920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:09.643295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb0255-69e1-452d-a734-d0c14ab70edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:09.644273 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb0255-69e1-452d-a734-d0c14ab70edb None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:09.644780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb0255-69e1-452d-a734-d0c14ab70edb None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:09.645214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb0255-69e1-452d-a734-d0c14ab70edb None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:09.646512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb0255-69e1-452d-a734-d0c14ab70edb None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:09.648247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb0255-69e1-452d-a734-d0c14ab70edb None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:09.654651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 99/204] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:09 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:09.656989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb0255-69e1-452d-a734-d0c14ab70edb None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:09.671623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e41aea-2e16-480e-9507-61b252fb8b62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:09.673154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e41aea-2e16-480e-9507-61b252fb8b62 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:09.772970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb0255-69e1-452d-a734-d0c14ab70edb None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:09.788975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 106/205] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:09.794960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e41aea-2e16-480e-9507-61b252fb8b62 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:09.816156 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bfd7a-35df-4dbc-97d8-33203ea063e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:09.817264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bfd7a-35df-4dbc-97d8-33203ea063e1 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:09.818100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bfd7a-35df-4dbc-97d8-33203ea063e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:09.818854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bfd7a-35df-4dbc-97d8-33203ea063e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:09.819974 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bfd7a-35df-4dbc-97d8-33203ea063e1 None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=d678307757524765a2599dd485cbbb7e, user.id=03327f326b1046fea97ce4efaa4f9eaa) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:09.820537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bfd7a-35df-4dbc-97d8-33203ea063e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:09.822526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bfd7a-35df-4dbc-97d8-33203ea063e1 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:09.836549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 100/206] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:09 2022] GET /identity/v3/role_assignments?user.id=03327f326b1046fea97ce4efaa4f9eaa&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:09.875151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:09.926379 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e41aea-2e16-480e-9507-61b252fb8b62 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:09.971789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a569e32-94f8-41b1-a065-e90222c87081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:09.972855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569e32-94f8-41b1-a065-e90222c87081 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:09.973335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569e32-94f8-41b1-a065-e90222c87081 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:09.973830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a569e32-94f8-41b1-a065-e90222c87081 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:09.975285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a569e32-94f8-41b1-a065-e90222c87081 None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:09.977018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a569e32-94f8-41b1-a065-e90222c87081 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:09.984374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 107/207] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:09 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:09.986769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bfd7a-35df-4dbc-97d8-33203ea063e1 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:10.032747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:10.096223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bfd7a-35df-4dbc-97d8-33203ea063e1 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:10.132641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca758c-4b62-4bf5-aa12-3243899c68cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:10.133298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca758c-4b62-4bf5-aa12-3243899c68cf None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:10.133582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca758c-4b62-4bf5-aa12-3243899c68cf None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:10.133861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca758c-4b62-4bf5-aa12-3243899c68cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:10.134590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca758c-4b62-4bf5-aa12-3243899c68cf None admin] RBAC: Adding query filter params (role.id=2837bb5c87054ea7a046150d413d2561, scope.project.id=d678307757524765a2599dd485cbbb7e, user.id=03327f326b1046fea97ce4efaa4f9eaa) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:10.134896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca758c-4b62-4bf5-aa12-3243899c68cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:10.136359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca758c-4b62-4bf5-aa12-3243899c68cf None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:10.142235 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 101/208] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:09 2022] GET /identity/v3/role_assignments?user.id=03327f326b1046fea97ce4efaa4f9eaa&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=2837bb5c87054ea7a046150d413d2561 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:11.267222 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeae73-da0f-47e9-99ec-5e86b9b44b0b None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:11.267773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeae73-da0f-47e9-99ec-5e86b9b44b0b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:11.267773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeae73-da0f-47e9-99ec-5e86b9b44b0b None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:11.269433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 108/209] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:11.275046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63360bfb-3386-437e-87af-8f5c00b19f5e None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:11.275515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63360bfb-3386-437e-87af-8f5c00b19f5e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:11.275618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63360bfb-3386-437e-87af-8f5c00b19f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:11.293369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0fe66-31b1-4381-899b-0206a1757cb6 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:11.293657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0fe66-31b1-4381-899b-0206a1757cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:11.293927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0fe66-31b1-4381-899b-0206a1757cb6 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:11.295493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 109/210] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:56:11.300977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68523d8f-5be8-4d03-8a7c-e78b8de114f6 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:11.301260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68523d8f-5be8-4d03-8a7c-e78b8de114f6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:11.301535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68523d8f-5be8-4d03-8a7c-e78b8de114f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:11.305956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-63360bfb-3386-437e-87af-8f5c00b19f5e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:11.307375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-63360bfb-3386-437e-87af-8f5c00b19f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:11.322805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-68523d8f-5be8-4d03-8a7c-e78b8de114f6 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:11.324524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-68523d8f-5be8-4d03-8a7c-e78b8de114f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:11.383638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 102/211] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:11.406123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 110/212] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:11.664468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63360bfb-3386-437e-87af-8f5c00b19f5e None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:11.680418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68523d8f-5be8-4d03-8a7c-e78b8de114f6 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:11.698996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:11.738629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:11.776283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63360bfb-3386-437e-87af-8f5c00b19f5e None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:11.790785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68523d8f-5be8-4d03-8a7c-e78b8de114f6 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:11.820773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58a891-2f33-4de6-a6c6-74635f1859e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:11.821687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a891-2f33-4de6-a6c6-74635f1859e4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:11.821976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a891-2f33-4de6-a6c6-74635f1859e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:11.822254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58a891-2f33-4de6-a6c6-74635f1859e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:11.829851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02bf23-03dc-4a90-b3f8-098f1ab584c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:11.830883 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02bf23-03dc-4a90-b3f8-098f1ab584c7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:11.831298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02bf23-03dc-4a90-b3f8-098f1ab584c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:11.831694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02bf23-03dc-4a90-b3f8-098f1ab584c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:11.832986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02bf23-03dc-4a90-b3f8-098f1ab584c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:11.834581 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02bf23-03dc-4a90-b3f8-098f1ab584c7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:11.835560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58a891-2f33-4de6-a6c6-74635f1859e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-de58a891-2f33-4de6-a6c6-74635f1859e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:11.841255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:11.842221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:11.842992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 103/214] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:11.843629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58a891-2f33-4de6-a6c6-74635f1859e4 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:11.844372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 111/214] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:11.849959 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02bf23-03dc-4a90-b3f8-098f1ab584c7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:11.962451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:11.972270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58a891-2f33-4de6-a6c6-74635f1859e4 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:11.973915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02bf23-03dc-4a90-b3f8-098f1ab584c7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:11.996970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:12.010888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27e932-e21d-47b7-b302-dda3203cb8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:12.011264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1773b-50fa-41f7-aa71-86eaa596fde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:12.011879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1773b-50fa-41f7-aa71-86eaa596fde2 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:12.011990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27e932-e21d-47b7-b302-dda3203cb8a2 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:12.012202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1773b-50fa-41f7-aa71-86eaa596fde2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:12.012510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1773b-50fa-41f7-aa71-86eaa596fde2 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:12.012713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27e932-e21d-47b7-b302-dda3203cb8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:12.013145 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27e932-e21d-47b7-b302-dda3203cb8a2 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:12.013251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1773b-50fa-41f7-aa71-86eaa596fde2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:12.013461 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1773b-50fa-41f7-aa71-86eaa596fde2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:12.014193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27e932-e21d-47b7-b302-dda3203cb8a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:12.014869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1773b-50fa-41f7-aa71-86eaa596fde2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:12.015925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27e932-e21d-47b7-b302-dda3203cb8a2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:12.023482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 112/215] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:12.024845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72ee2-7a7a-4308-a85e-b2e90e2928ed None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:12.025135 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72ee2-7a7a-4308-a85e-b2e90e2928ed None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:12.025407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b72ee2-7a7a-4308-a85e-b2e90e2928ed None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:12.027631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 113/216] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:12.030061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b72ee2-7a7a-4308-a85e-b2e90e2928ed None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:12.148458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b72ee2-7a7a-4308-a85e-b2e90e2928ed None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:12.179453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 104/217] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:56:11 2022] POST /identity/v3/users => generated 297 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:56:12.184110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8666f-1d0b-48e1-9e8b-85bcaec5d784 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:12.184110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8666f-1d0b-48e1-9e8b-85bcaec5d784 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:12.184110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8666f-1d0b-48e1-9e8b-85bcaec5d784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:12.186490 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19a10b-5d19-434d-8d9f-1ae2786bfbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:12.187397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a10b-5d19-434d-8d9f-1ae2786bfbac None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:12.187680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a10b-5d19-434d-8d9f-1ae2786bfbac None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:12.187942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19a10b-5d19-434d-8d9f-1ae2786bfbac None admin] PATH_INFO: `/v3/users/6e8ddbaf7de84ca39c5c954f818fe49a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:12.203466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4fa8666f-1d0b-48e1-9e8b-85bcaec5d784 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:12.204574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19a10b-5d19-434d-8d9f-1ae2786bfbac None admin] RBAC: Authorizing `identity:get_user(user_id=6e8ddbaf7de84ca39c5c954f818fe49a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:12.204915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4fa8666f-1d0b-48e1-9e8b-85bcaec5d784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:12.206145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19a10b-5d19-434d-8d9f-1ae2786bfbac None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:12.208141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 114/218] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:12 2022] GET /identity/v3/users/6e8ddbaf7de84ca39c5c954f818fe49a => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:12.209391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62182bf-eabc-4947-a8a9-a6070d6f19f1 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:12.209664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62182bf-eabc-4947-a8a9-a6070d6f19f1 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:12.212898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62182bf-eabc-4947-a8a9-a6070d6f19f1 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:12.212898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 115/219] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:12.216629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62182bf-eabc-4947-a8a9-a6070d6f19f1 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:12.268411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:12.295003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 105/220] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:12.302626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be385-8658-4dc0-81b5-1623e87921be None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:12.303180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be385-8658-4dc0-81b5-1623e87921be None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:12.303906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734be385-8658-4dc0-81b5-1623e87921be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:12.329771 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-734be385-8658-4dc0-81b5-1623e87921be None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:12.331462 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-734be385-8658-4dc0-81b5-1623e87921be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:12.339233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62182bf-eabc-4947-a8a9-a6070d6f19f1 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:12.384625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac633a0-ab47-476b-b7d3-ec1834590838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:12.385251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac633a0-ab47-476b-b7d3-ec1834590838 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:12.385532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac633a0-ab47-476b-b7d3-ec1834590838 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:12.385816 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac633a0-ab47-476b-b7d3-ec1834590838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:12.408092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 106/221] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:12.464053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac633a0-ab47-476b-b7d3-ec1834590838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:12.465561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac633a0-ab47-476b-b7d3-ec1834590838 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:12.515023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:12.574358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734be385-8658-4dc0-81b5-1623e87921be None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:12.582492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 116/222] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:12.590498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:12.591807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac633a0-ab47-476b-b7d3-ec1834590838 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:12.713646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734be385-8658-4dc0-81b5-1623e87921be None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:12.748511 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac633a0-ab47-476b-b7d3-ec1834590838 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:12.759172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23161f91-8c92-406b-a55c-c7c483dce725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:12.759573 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23161f91-8c92-406b-a55c-c7c483dce725 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:12.759827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23161f91-8c92-406b-a55c-c7c483dce725 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:12.760098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23161f91-8c92-406b-a55c-c7c483dce725 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:12.771901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23161f91-8c92-406b-a55c-c7c483dce725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-23161f91-8c92-406b-a55c-c7c483dce725 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:12.776716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:12.777618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:12.778450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 107/223] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:56:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:12.779092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23161f91-8c92-406b-a55c-c7c483dce725 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:12.805714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae6ade-787d-4f60-b94b-a1b9990d4c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:12.807273 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae6ade-787d-4f60-b94b-a1b9990d4c42 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:12.808190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae6ade-787d-4f60-b94b-a1b9990d4c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:12.808668 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae6ade-787d-4f60-b94b-a1b9990d4c42 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:12.810750 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae6ade-787d-4f60-b94b-a1b9990d4c42 None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:12.813439 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae6ade-787d-4f60-b94b-a1b9990d4c42 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:12.816662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 117/224] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:12 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:12.818159 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae6ade-787d-4f60-b94b-a1b9990d4c42 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:12.833780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:12.862728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:12.899661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23161f91-8c92-406b-a55c-c7c483dce725 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:12.938924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dec4c-f2c0-4204-9654-d26113d6ddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:12.939726 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dec4c-f2c0-4204-9654-d26113d6ddac None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:12.940011 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dec4c-f2c0-4204-9654-d26113d6ddac None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:12.940320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dec4c-f2c0-4204-9654-d26113d6ddac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:12.954830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dec4c-f2c0-4204-9654-d26113d6ddac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:12.960869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae6ade-787d-4f60-b94b-a1b9990d4c42 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-2a9dec4c-f2c0-4204-9654-d26113d6ddac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:12.961143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:12.962037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:12.962813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 108/225] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:56:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:12.963446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dec4c-f2c0-4204-9654-d26113d6ddac None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:13.018115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b77a3-a971-4293-a4d2-0930390a78c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:13.019860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b77a3-a971-4293-a4d2-0930390a78c3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:13.020377 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b77a3-a971-4293-a4d2-0930390a78c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:13.020837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b77a3-a971-4293-a4d2-0930390a78c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:13.022219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b77a3-a971-4293-a4d2-0930390a78c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:13.022706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b77a3-a971-4293-a4d2-0930390a78c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:13.025111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b77a3-a971-4293-a4d2-0930390a78c3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:13.041747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 118/226] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:13.041747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b77a3-a971-4293-a4d2-0930390a78c3 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:13.094985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dec4c-f2c0-4204-9654-d26113d6ddac None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:13.117449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:13.126662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:13.135152 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b60d4-24ba-4a16-868b-47472f583c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:13.136426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b60d4-24ba-4a16-868b-47472f583c85 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:13.136426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b60d4-24ba-4a16-868b-47472f583c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:13.136950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b60d4-24ba-4a16-868b-47472f583c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:13.137882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b60d4-24ba-4a16-868b-47472f583c85 None admin] RBAC: Adding query filter params (role.id=24cce6d670834e3ba65b942574313d0a, scope.project.id=d678307757524765a2599dd485cbbb7e, user.id=6e8ddbaf7de84ca39c5c954f818fe49a) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:13.138549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b60d4-24ba-4a16-868b-47472f583c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:13.140842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b60d4-24ba-4a16-868b-47472f583c85 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:13.147107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 109/227] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:12 2022] GET /identity/v3/role_assignments?user.id=6e8ddbaf7de84ca39c5c954f818fe49a&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=24cce6d670834e3ba65b942574313d0a => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:13.148173 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b60d4-24ba-4a16-868b-47472f583c85 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:13.152981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b77a3-a971-4293-a4d2-0930390a78c3 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:13.213994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a399b9-1157-43f0-bd8d-a936d4cb97a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:13.214628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a399b9-1157-43f0-bd8d-a936d4cb97a0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:13.214911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a399b9-1157-43f0-bd8d-a936d4cb97a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:13.215185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a399b9-1157-43f0-bd8d-a936d4cb97a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:13.215863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a399b9-1157-43f0-bd8d-a936d4cb97a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:13.216168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a399b9-1157-43f0-bd8d-a936d4cb97a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:13.217872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a399b9-1157-43f0-bd8d-a936d4cb97a0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:13.240267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 119/228] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:13.255654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a399b9-1157-43f0-bd8d-a936d4cb97a0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:13.281635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b60d4-24ba-4a16-868b-47472f583c85 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:13.346103 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acd62f-95cb-40e6-acef-1e6221e63e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:13.346864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acd62f-95cb-40e6-acef-1e6221e63e72 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:13.347038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acd62f-95cb-40e6-acef-1e6221e63e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:13.347305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acd62f-95cb-40e6-acef-1e6221e63e72 None admin] PATH_INFO: `/v3/users/03327f326b1046fea97ce4efaa4f9eaa` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:13.348575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acd62f-95cb-40e6-acef-1e6221e63e72 None admin] RBAC: Authorizing `identity:get_user(user_id=03327f326b1046fea97ce4efaa4f9eaa)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:13.350087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acd62f-95cb-40e6-acef-1e6221e63e72 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:13.352270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 110/229] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:13 2022] GET /identity/v3/users/03327f326b1046fea97ce4efaa4f9eaa => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:13.361876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acd62f-95cb-40e6-acef-1e6221e63e72 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:13.440941 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:13.488920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acd62f-95cb-40e6-acef-1e6221e63e72 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:13.489654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a399b9-1157-43f0-bd8d-a936d4cb97a0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:13.528385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93626a-1da4-48ee-84b4-bd132d0d8bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:13.529329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93626a-1da4-48ee-84b4-bd132d0d8bed None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:13.530066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93626a-1da4-48ee-84b4-bd132d0d8bed None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:13.530644 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93626a-1da4-48ee-84b4-bd132d0d8bed None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:13.532065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93626a-1da4-48ee-84b4-bd132d0d8bed None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:13.534070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93626a-1da4-48ee-84b4-bd132d0d8bed None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:13.536446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 111/230] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:13 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:13.547128 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93626a-1da4-48ee-84b4-bd132d0d8bed None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:13.580991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:13.584873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35f562-5884-47be-a959-458a76c11082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:13.585586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35f562-5884-47be-a959-458a76c11082 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:13.585869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35f562-5884-47be-a959-458a76c11082 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:13.586395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35f562-5884-47be-a959-458a76c11082 None admin] PATH_INFO: `/v3/users/03327f326b1046fea97ce4efaa4f9eaa` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:13.588024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35f562-5884-47be-a959-458a76c11082 None admin] RBAC: Authorizing `identity:get_user(user_id=03327f326b1046fea97ce4efaa4f9eaa)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:13.590105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35f562-5884-47be-a959-458a76c11082 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:13.600799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 120/231] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:13 2022] GET /identity/v3/users/03327f326b1046fea97ce4efaa4f9eaa => generated 283 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:13.620603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35f562-5884-47be-a959-458a76c11082 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:13.734596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93626a-1da4-48ee-84b4-bd132d0d8bed None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:13.796109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35f562-5884-47be-a959-458a76c11082 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:13.802884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:13.824561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634f078-bed0-42bc-9457-5051c926b296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:13.825233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634f078-bed0-42bc-9457-5051c926b296 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:13.825510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634f078-bed0-42bc-9457-5051c926b296 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:13.825787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634f078-bed0-42bc-9457-5051c926b296 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e/users/03327f326b1046fea97ce4efaa4f9eaa/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:13.829583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634f078-bed0-42bc-9457-5051c926b296 None admin] RBAC: Authorizing `identity:create_grant(project_id=d678307757524765a2599dd485cbbb7e, user_id=03327f326b1046fea97ce4efaa4f9eaa, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:13.831026 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634f078-bed0-42bc-9457-5051c926b296 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:13.831987 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded043a-ea6f-4865-a311-577a433d1c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:13.832661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded043a-ea6f-4865-a311-577a433d1c80 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:13.832945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded043a-ea6f-4865-a311-577a433d1c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:13.833241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded043a-ea6f-4865-a311-577a433d1c80 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:13.834373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded043a-ea6f-4865-a311-577a433d1c80 None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:13.835930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded043a-ea6f-4865-a311-577a433d1c80 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:13.837823 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 121/232] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:13 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:13.843999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded043a-ea6f-4865-a311-577a433d1c80 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:13.916064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:13.934238 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 112/233] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:56:13 2022] PUT /identity/v3/projects/d678307757524765a2599dd485cbbb7e/users/03327f326b1046fea97ce4efaa4f9eaa/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:13.964971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded043a-ea6f-4865-a311-577a433d1c80 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:14.015272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070dcf4-a7ba-415e-b619-3b2396ab4e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:14.016012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070dcf4-a7ba-415e-b619-3b2396ab4e7c None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:14.016319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070dcf4-a7ba-415e-b619-3b2396ab4e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:14.016598 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070dcf4-a7ba-415e-b619-3b2396ab4e7c None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e/users/03327f326b1046fea97ce4efaa4f9eaa/roles/2837bb5c87054ea7a046150d413d2561` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:14.020875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070dcf4-a7ba-415e-b619-3b2396ab4e7c None admin] RBAC: Authorizing `identity:create_grant(project_id=d678307757524765a2599dd485cbbb7e, user_id=03327f326b1046fea97ce4efaa4f9eaa, role_id=2837bb5c87054ea7a046150d413d2561)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:14.022402 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070dcf4-a7ba-415e-b619-3b2396ab4e7c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:14.129144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 122/234] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:56:13 2022] PUT /identity/v3/projects/d678307757524765a2599dd485cbbb7e/users/03327f326b1046fea97ce4efaa4f9eaa/roles/2837bb5c87054ea7a046150d413d2561 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:56:14.531347 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31568c0b-f3c2-44ce-ae46-59522371f0fb None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:14.531864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31568c0b-f3c2-44ce-ae46-59522371f0fb None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:14.531864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31568c0b-f3c2-44ce-ae46-59522371f0fb None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:14.533274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 113/235] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:14.541932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f5a2f-0aed-4260-b602-cb69201c59f5 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:14.542381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f5a2f-0aed-4260-b602-cb69201c59f5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:14.542564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f5a2f-0aed-4260-b602-cb69201c59f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:14.565168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-fa4f5a2f-0aed-4260-b602-cb69201c59f5 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:14.566739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fa4f5a2f-0aed-4260-b602-cb69201c59f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:14.653030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 123/236] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:14.664829 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb311fc-b833-454e-9aa8-53dc23d06b16 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:14.665121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb311fc-b833-454e-9aa8-53dc23d06b16 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:14.665367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb311fc-b833-454e-9aa8-53dc23d06b16 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:14.666713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 114/237] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:14.672860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204b63d-bc46-47f6-b98d-de6b15608222 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:14.673147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204b63d-bc46-47f6-b98d-de6b15608222 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:14.673418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204b63d-bc46-47f6-b98d-de6b15608222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:14.696486 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-a204b63d-bc46-47f6-b98d-de6b15608222 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:14.697983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a204b63d-bc46-47f6-b98d-de6b15608222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:14.755598 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:14.770066 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 124/238] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:14.964713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb311fc-b833-454e-9aa8-53dc23d06b16 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:15.099474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204b63d-bc46-47f6-b98d-de6b15608222 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:15.115523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb311fc-b833-454e-9aa8-53dc23d06b16 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:15.179245 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce41e80-83db-4a04-a0fa-6d39cb08aeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:15.180060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce41e80-83db-4a04-a0fa-6d39cb08aeb1 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:15.180375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce41e80-83db-4a04-a0fa-6d39cb08aeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:15.180651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce41e80-83db-4a04-a0fa-6d39cb08aeb1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:15.192948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce41e80-83db-4a04-a0fa-6d39cb08aeb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-dce41e80-83db-4a04-a0fa-6d39cb08aeb1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:15.198329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:15.199200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:15.200160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 115/239] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:15.207527 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce41e80-83db-4a04-a0fa-6d39cb08aeb1 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:15.300683 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:15.337177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce41e80-83db-4a04-a0fa-6d39cb08aeb1 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:15.376548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12281ea9-c45c-4f2b-8e34-d8f197cec661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:15.377473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12281ea9-c45c-4f2b-8e34-d8f197cec661 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:15.377912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12281ea9-c45c-4f2b-8e34-d8f197cec661 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:15.378248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204b63d-bc46-47f6-b98d-de6b15608222 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:15.378559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12281ea9-c45c-4f2b-8e34-d8f197cec661 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:15.379390 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12281ea9-c45c-4f2b-8e34-d8f197cec661 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:15.379837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12281ea9-c45c-4f2b-8e34-d8f197cec661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:15.381622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12281ea9-c45c-4f2b-8e34-d8f197cec661 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:15.392373 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 116/240] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:15.405308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12281ea9-c45c-4f2b-8e34-d8f197cec661 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:15.432181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af877f2-8ad8-45a9-8ca6-274835e90136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:15.432969 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af877f2-8ad8-45a9-8ca6-274835e90136 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:15.433307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af877f2-8ad8-45a9-8ca6-274835e90136 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:15.433583 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af877f2-8ad8-45a9-8ca6-274835e90136 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:15.434860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af877f2-8ad8-45a9-8ca6-274835e90136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:15.437211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af877f2-8ad8-45a9-8ca6-274835e90136 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:15.438966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 125/241] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:15.445376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af877f2-8ad8-45a9-8ca6-274835e90136 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:15.534295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:15.588630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af877f2-8ad8-45a9-8ca6-274835e90136 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:15.596897 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12281ea9-c45c-4f2b-8e34-d8f197cec661 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:15.610796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:15.637212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff479d3-53e8-4940-b2bf-74940884789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:15.637815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4b000-fced-471a-a1c5-b916d6235409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:15.637934 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff479d3-53e8-4940-b2bf-74940884789d None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:15.638281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff479d3-53e8-4940-b2bf-74940884789d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:15.638625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff479d3-53e8-4940-b2bf-74940884789d None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:15.639326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4b000-fced-471a-a1c5-b916d6235409 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:15.639442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff479d3-53e8-4940-b2bf-74940884789d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:15.639930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4b000-fced-471a-a1c5-b916d6235409 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:15.640435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4b000-fced-471a-a1c5-b916d6235409 None admin] PATH_INFO: `/v3/users/f14ef762a3d64df4b065679e5aa846f8` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:15.641081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff479d3-53e8-4940-b2bf-74940884789d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:15.656153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4b000-fced-471a-a1c5-b916d6235409 None admin] RBAC: Authorizing `identity:get_user(user_id=f14ef762a3d64df4b065679e5aa846f8)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:15.658167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4b000-fced-471a-a1c5-b916d6235409 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:15.660209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 117/242] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:15 2022] GET /identity/v3/users/f14ef762a3d64df4b065679e5aa846f8 => generated 297 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:15.661795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e6ee-14fa-4827-84ba-e60d4abc8e6b None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:15.668471 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e6ee-14fa-4827-84ba-e60d4abc8e6b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:15.668471 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e6ee-14fa-4827-84ba-e60d4abc8e6b None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:15.668471 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 118/243] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:15.669827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9e6ee-14fa-4827-84ba-e60d4abc8e6b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:15.713059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 126/244] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:56:15 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:56:15.713971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab4650-6650-4f1a-97fd-08daec5121e5 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:15.714300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab4650-6650-4f1a-97fd-08daec5121e5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:15.714579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab4650-6650-4f1a-97fd-08daec5121e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:15.739844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-bcab4650-6650-4f1a-97fd-08daec5121e5 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:15.741160 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bcab4650-6650-4f1a-97fd-08daec5121e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:15.815233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9e6ee-14fa-4827-84ba-e60d4abc8e6b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:15.821771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 127/245] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:15.857207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d326eed-42de-4844-8017-d02f649ca7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:15.858847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326eed-42de-4844-8017-d02f649ca7df None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:15.859325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326eed-42de-4844-8017-d02f649ca7df None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:15.859858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d326eed-42de-4844-8017-d02f649ca7df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:15.900718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:15.940635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d326eed-42de-4844-8017-d02f649ca7df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:15.942459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d326eed-42de-4844-8017-d02f649ca7df None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:16.054592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 119/246] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:16.060569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab4650-6650-4f1a-97fd-08daec5121e5 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:16.126436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:16.146989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d326eed-42de-4844-8017-d02f649ca7df None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:16.198773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab4650-6650-4f1a-97fd-08daec5121e5 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:16.245010 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:16.246707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102596c-f98d-4822-af1d-b5f68066964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:16.247782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102596c-f98d-4822-af1d-b5f68066964f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:16.248956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102596c-f98d-4822-af1d-b5f68066964f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:16.249431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102596c-f98d-4822-af1d-b5f68066964f None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:16.251285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102596c-f98d-4822-af1d-b5f68066964f None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:16.254243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102596c-f98d-4822-af1d-b5f68066964f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:16.256198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 128/247] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:16 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:16.265737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102596c-f98d-4822-af1d-b5f68066964f None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:16.295285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d326eed-42de-4844-8017-d02f649ca7df None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:16.343069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2979fcb-3c45-4f17-8b5d-8407797cb115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:16.344088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2979fcb-3c45-4f17-8b5d-8407797cb115 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:16.344631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2979fcb-3c45-4f17-8b5d-8407797cb115 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:16.345106 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2979fcb-3c45-4f17-8b5d-8407797cb115 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:16.370146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2979fcb-3c45-4f17-8b5d-8407797cb115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-a2979fcb-3c45-4f17-8b5d-8407797cb115 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:16.376990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:16.377875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:16.378685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:16.381425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 120/248] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:56:16.386286 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102596c-f98d-4822-af1d-b5f68066964f None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:16.387569 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2979fcb-3c45-4f17-8b5d-8407797cb115 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:16.405092 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:16.426163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796be7-0a01-4188-8f17-e6f9644b9b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:16.430990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796be7-0a01-4188-8f17-e6f9644b9b74 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:16.430990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796be7-0a01-4188-8f17-e6f9644b9b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:16.430990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a796be7-0a01-4188-8f17-e6f9644b9b74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:16.430990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a796be7-0a01-4188-8f17-e6f9644b9b74 None admin] RBAC: Adding query filter params (role.id=4913cb9f208f4c4892f61e1433923571, scope.project.id=d678307757524765a2599dd485cbbb7e, user.id=f14ef762a3d64df4b065679e5aa846f8) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:16.430990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a796be7-0a01-4188-8f17-e6f9644b9b74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:16.430990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a796be7-0a01-4188-8f17-e6f9644b9b74 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:16.437930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 129/249] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:16 2022] GET /identity/v3/role_assignments?user.id=f14ef762a3d64df4b065679e5aa846f8&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=4913cb9f208f4c4892f61e1433923571 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:16.519204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2979fcb-3c45-4f17-8b5d-8407797cb115 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:16.554812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:16.569326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de80179-aa49-4e12-8f76-20c730faaac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:16.571233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de80179-aa49-4e12-8f76-20c730faaac6 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:16.571233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de80179-aa49-4e12-8f76-20c730faaac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:16.571233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de80179-aa49-4e12-8f76-20c730faaac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:16.571561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de80179-aa49-4e12-8f76-20c730faaac6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:16.571883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de80179-aa49-4e12-8f76-20c730faaac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:16.573390 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de80179-aa49-4e12-8f76-20c730faaac6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:16.585192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 121/250] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:16.591433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796be7-0a01-4188-8f17-e6f9644b9b74 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:16.704597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0617-0ff4-47db-be8d-c9f4e544178c None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:16.705077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0617-0ff4-47db-be8d-c9f4e544178c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:16.705077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0617-0ff4-47db-be8d-c9f4e544178c None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:16.706522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 122/251] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:16.712025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c76b-f7b4-42ca-92e2-01ab1539ea1f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:16.712333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c76b-f7b4-42ca-92e2-01ab1539ea1f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:16.712602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962c76b-f7b4-42ca-92e2-01ab1539ea1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:16.734192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4962c76b-f7b4-42ca-92e2-01ab1539ea1f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:16.735671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4962c76b-f7b4-42ca-92e2-01ab1539ea1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:16.753427 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a796be7-0a01-4188-8f17-e6f9644b9b74 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:16.819019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173c214-b48a-485d-be6c-369f1a60bb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:16.819662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c214-b48a-485d-be6c-369f1a60bb28 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:16.819935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c214-b48a-485d-be6c-369f1a60bb28 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:16.820201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173c214-b48a-485d-be6c-369f1a60bb28 None admin] PATH_INFO: `/v3/users/6e8ddbaf7de84ca39c5c954f818fe49a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:16.821635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173c214-b48a-485d-be6c-369f1a60bb28 None admin] RBAC: Authorizing `identity:get_user(user_id=6e8ddbaf7de84ca39c5c954f818fe49a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:16.823194 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173c214-b48a-485d-be6c-369f1a60bb28 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:16.826042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 123/252] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:16.827360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770009e-56c9-4aa6-a80a-e6356e9d6603 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:16.827474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 130/253] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:16 2022] GET /identity/v3/users/6e8ddbaf7de84ca39c5c954f818fe49a => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:16.827705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770009e-56c9-4aa6-a80a-e6356e9d6603 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:16.827980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770009e-56c9-4aa6-a80a-e6356e9d6603 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:16.833420 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173c214-b48a-485d-be6c-369f1a60bb28 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:16.833863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 124/254] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:16.849089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb890-474b-4e8b-81ab-a6ee582a7d72 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:16.849356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb890-474b-4e8b-81ab-a6ee582a7d72 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:16.849619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cb890-474b-4e8b-81ab-a6ee582a7d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:16.885581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-2f1cb890-474b-4e8b-81ab-a6ee582a7d72 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:16.886776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2f1cb890-474b-4e8b-81ab-a6ee582a7d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:16.933977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:17.045070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 125/255] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:17.058113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173c214-b48a-485d-be6c-369f1a60bb28 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:17.112983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422b035-2bfb-450a-a76e-825b3784cdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:17.113628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422b035-2bfb-450a-a76e-825b3784cdff None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:17.113915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422b035-2bfb-450a-a76e-825b3784cdff None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:17.114160 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422b035-2bfb-450a-a76e-825b3784cdff None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:17.120981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422b035-2bfb-450a-a76e-825b3784cdff None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:17.122475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422b035-2bfb-450a-a76e-825b3784cdff None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:17.124349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 131/256] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:16 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:17.131320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cb890-474b-4e8b-81ab-a6ee582a7d72 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:17.196258 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:17.257040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cb890-474b-4e8b-81ab-a6ee582a7d72 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:17.261203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422b035-2bfb-450a-a76e-825b3784cdff None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:17.326816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c0efb-0e1c-4bd3-9dd7-e144a9a6cd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:17.327718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0efb-0e1c-4bd3-9dd7-e144a9a6cd4f None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:17.328863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0efb-0e1c-4bd3-9dd7-e144a9a6cd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:17.329463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c0efb-0e1c-4bd3-9dd7-e144a9a6cd4f None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e/users/6e8ddbaf7de84ca39c5c954f818fe49a/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:17.337538 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c0efb-0e1c-4bd3-9dd7-e144a9a6cd4f None admin] RBAC: Authorizing `identity:create_grant(project_id=d678307757524765a2599dd485cbbb7e, user_id=6e8ddbaf7de84ca39c5c954f818fe49a, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:17.339940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c0efb-0e1c-4bd3-9dd7-e144a9a6cd4f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:17.407592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 126/257] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:56:17 2022] PUT /identity/v3/projects/d678307757524765a2599dd485cbbb7e/users/6e8ddbaf7de84ca39c5c954f818fe49a/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:17.457076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422b035-2bfb-450a-a76e-825b3784cdff None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:17.478020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:17.491927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c0efb-0e1c-4bd3-9dd7-e144a9a6cd4f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:17.520977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7c355-037c-4591-96c3-8a8290ead928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:17.521917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7c355-037c-4591-96c3-8a8290ead928 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:17.522433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7c355-037c-4591-96c3-8a8290ead928 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:17.523049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7c355-037c-4591-96c3-8a8290ead928 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:17.553280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7c355-037c-4591-96c3-8a8290ead928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-f3c7c355-037c-4591-96c3-8a8290ead928 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:17.559071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:17.560197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:17.561375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:17.563786 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 132/258] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:56:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:17.573276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7c355-037c-4591-96c3-8a8290ead928 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:17.644845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c0efb-0e1c-4bd3-9dd7-e144a9a6cd4f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:17.668714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:17.715899 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26408e4-bed3-4f70-8063-a9b7140c537b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:17.717501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26408e4-bed3-4f70-8063-a9b7140c537b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:17.718411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26408e4-bed3-4f70-8063-a9b7140c537b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:17.718798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26408e4-bed3-4f70-8063-a9b7140c537b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:17.742821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26408e4-bed3-4f70-8063-a9b7140c537b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-f26408e4-bed3-4f70-8063-a9b7140c537b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:17.749688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:17.750791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:17.751861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:17.753567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 127/259] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:56:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:17.761154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26408e4-bed3-4f70-8063-a9b7140c537b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:17.805525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7c355-037c-4591-96c3-8a8290ead928 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:17.846100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ce1f2-087f-48c3-98e2-74678c779f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:17.846881 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ce1f2-087f-48c3-98e2-74678c779f18 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:17.847258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ce1f2-087f-48c3-98e2-74678c779f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:17.847605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ce1f2-087f-48c3-98e2-74678c779f18 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:17.848397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ce1f2-087f-48c3-98e2-74678c779f18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:17.848775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ce1f2-087f-48c3-98e2-74678c779f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:17.850368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ce1f2-087f-48c3-98e2-74678c779f18 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:17.860537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 133/260] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:17.872105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ce1f2-087f-48c3-98e2-74678c779f18 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:17.914086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26408e4-bed3-4f70-8063-a9b7140c537b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:17.978993 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417115d-09ae-40f2-a09e-6a98e024a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:17.979940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417115d-09ae-40f2-a09e-6a98e024a511 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:17.980570 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417115d-09ae-40f2-a09e-6a98e024a511 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:17.981553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417115d-09ae-40f2-a09e-6a98e024a511 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:17.983459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:17.984871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417115d-09ae-40f2-a09e-6a98e024a511 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:17.985382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417115d-09ae-40f2-a09e-6a98e024a511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:17.988107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417115d-09ae-40f2-a09e-6a98e024a511 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:18.004479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 128/261] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:18.011704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417115d-09ae-40f2-a09e-6a98e024a511 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:18.086084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:18.212646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417115d-09ae-40f2-a09e-6a98e024a511 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:18.266988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ce1f2-087f-48c3-98e2-74678c779f18 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:18.340986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e1e81-a6d3-49f4-8590-4221f6aca2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:18.341642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e1e81-a6d3-49f4-8590-4221f6aca2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:18.342067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e1e81-a6d3-49f4-8590-4221f6aca2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:18.342393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e1e81-a6d3-49f4-8590-4221f6aca2d9 None admin] PATH_INFO: `/v3/users/03327f326b1046fea97ce4efaa4f9eaa` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:18.347537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e1e81-a6d3-49f4-8590-4221f6aca2d9 None admin] RBAC: Authorizing `identity:get_user(user_id=03327f326b1046fea97ce4efaa4f9eaa)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:18.349123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e1e81-a6d3-49f4-8590-4221f6aca2d9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:18.351165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 129/262] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:18 2022] GET /identity/v3/users/03327f326b1046fea97ce4efaa4f9eaa => generated 283 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:18.357217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e1e81-a6d3-49f4-8590-4221f6aca2d9 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:18.397041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12551d8-54ce-427e-a910-10469728c582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:18.397720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12551d8-54ce-427e-a910-10469728c582 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:18.398009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12551d8-54ce-427e-a910-10469728c582 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:18.398286 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12551d8-54ce-427e-a910-10469728c582 None admin] PATH_INFO: `/v3/users/03327f326b1046fea97ce4efaa4f9eaa` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:18.399593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12551d8-54ce-427e-a910-10469728c582 None admin] RBAC: Authorizing `identity:get_user(user_id=03327f326b1046fea97ce4efaa4f9eaa)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:18.401118 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12551d8-54ce-427e-a910-10469728c582 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:18.403047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 134/263] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:17 2022] GET /identity/v3/users/03327f326b1046fea97ce4efaa4f9eaa => generated 283 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:18.409130 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12551d8-54ce-427e-a910-10469728c582 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:18.609424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e1e81-a6d3-49f4-8590-4221f6aca2d9 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:18.612600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:18.616000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:18.622081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12551d8-54ce-427e-a910-10469728c582 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:18.680687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51020686-1a76-4345-a4ce-5fd69ba813c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:18.681845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020686-1a76-4345-a4ce-5fd69ba813c4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:18.682538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020686-1a76-4345-a4ce-5fd69ba813c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:18.683204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51020686-1a76-4345-a4ce-5fd69ba813c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:18.688971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e023-1e7f-4af1-a3d5-e2f7e39c44c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:18.689592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e023-1e7f-4af1-a3d5-e2f7e39c44c8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:18.690051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e023-1e7f-4af1-a3d5-e2f7e39c44c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:18.690487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0e023-1e7f-4af1-a3d5-e2f7e39c44c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:18.761228 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51020686-1a76-4345-a4ce-5fd69ba813c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:18.763975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51020686-1a76-4345-a4ce-5fd69ba813c4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:18.803962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0e023-1e7f-4af1-a3d5-e2f7e39c44c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:18.805473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0e023-1e7f-4af1-a3d5-e2f7e39c44c8 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:18.916704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:18.922696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 135/264] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:56:18.930129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51020686-1a76-4345-a4ce-5fd69ba813c4 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:18.968022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:18.972067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 130/265] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:18.978850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e023-1e7f-4af1-a3d5-e2f7e39c44c8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:19.114137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0e023-1e7f-4af1-a3d5-e2f7e39c44c8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:19.153657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34e26a-eb11-40de-aa32-9b1dde4beb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:19.155185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34e26a-eb11-40de-aa32-9b1dde4beb0f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:19.155842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34e26a-eb11-40de-aa32-9b1dde4beb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:19.157725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34e26a-eb11-40de-aa32-9b1dde4beb0f None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:19.160240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34e26a-eb11-40de-aa32-9b1dde4beb0f None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:19.161918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34e26a-eb11-40de-aa32-9b1dde4beb0f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:19.163794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 131/266] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:18 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:19.165364 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf26ac0-9e41-4027-a407-615fbcd8d154 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:19.165850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf26ac0-9e41-4027-a407-615fbcd8d154 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:19.166341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf26ac0-9e41-4027-a407-615fbcd8d154 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:19.167810 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 132/267] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:19.174138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6df04-7966-47a9-a9fa-83d06c466c98 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:19.174741 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6df04-7966-47a9-a9fa-83d06c466c98 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:19.175213 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6df04-7966-47a9-a9fa-83d06c466c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:19.205693 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-57d6df04-7966-47a9-a9fa-83d06c466c98 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:19.207793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-57d6df04-7966-47a9-a9fa-83d06c466c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:19.210179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51020686-1a76-4345-a4ce-5fd69ba813c4 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:19.268110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc75152-a5eb-4270-92fc-f84dff6cb48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:19.268927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc75152-a5eb-4270-92fc-f84dff6cb48d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:19.269227 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc75152-a5eb-4270-92fc-f84dff6cb48d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:19.269506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc75152-a5eb-4270-92fc-f84dff6cb48d None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:19.270754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc75152-a5eb-4270-92fc-f84dff6cb48d None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:19.272414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc75152-a5eb-4270-92fc-f84dff6cb48d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:19.279143 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 136/268] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:18 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:19.280491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc75152-a5eb-4270-92fc-f84dff6cb48d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:19.302138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:19.309809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 133/269] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:19.312095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416975e-52a3-4783-81a5-a465a44a29e4 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:19.316037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416975e-52a3-4783-81a5-a465a44a29e4 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:19.316037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416975e-52a3-4783-81a5-a465a44a29e4 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:19.316037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 134/270] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:19.316037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416975e-52a3-4783-81a5-a465a44a29e4 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:19.360618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:19.399204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc75152-a5eb-4270-92fc-f84dff6cb48d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:19.427556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416975e-52a3-4783-81a5-a465a44a29e4 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:19.472908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5a4f5-e6b5-42bd-947e-b65689fb8edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:19.473891 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5a4f5-e6b5-42bd-947e-b65689fb8edc None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:19.474375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5a4f5-e6b5-42bd-947e-b65689fb8edc None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:19.474859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5a4f5-e6b5-42bd-947e-b65689fb8edc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:19.475821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5a4f5-e6b5-42bd-947e-b65689fb8edc None admin] RBAC: Adding query filter params (role.id=2837bb5c87054ea7a046150d413d2561, scope.project.id=d678307757524765a2599dd485cbbb7e, user.id=03327f326b1046fea97ce4efaa4f9eaa) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:19.476357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5a4f5-e6b5-42bd-947e-b65689fb8edc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:19.478030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5a4f5-e6b5-42bd-947e-b65689fb8edc None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:19.491705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 137/271] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:19 2022] GET /identity/v3/role_assignments?user.id=03327f326b1046fea97ce4efaa4f9eaa&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=2837bb5c87054ea7a046150d413d2561 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:19.493729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39a61-6d0a-4c4c-abb4-17b4a87ff93b None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:19.494553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39a61-6d0a-4c4c-abb4-17b4a87ff93b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:19.495548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f39a61-6d0a-4c4c-abb4-17b4a87ff93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:19.496465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d5815-609e-47c6-981f-798a3cf1dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:19.497344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d5815-609e-47c6-981f-798a3cf1dc82 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:19.500843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d5815-609e-47c6-981f-798a3cf1dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:19.501428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d5815-609e-47c6-981f-798a3cf1dc82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:19.502461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d5815-609e-47c6-981f-798a3cf1dc82 None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=d678307757524765a2599dd485cbbb7e, user.id=03327f326b1046fea97ce4efaa4f9eaa) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:19.503002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d5815-609e-47c6-981f-798a3cf1dc82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:19.504803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d5815-609e-47c6-981f-798a3cf1dc82 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:19.516956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 135/272] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:19 2022] GET /identity/v3/role_assignments?user.id=03327f326b1046fea97ce4efaa4f9eaa&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:19.537472 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-e6f39a61-6d0a-4c4c-abb4-17b4a87ff93b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:19.539231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e6f39a61-6d0a-4c4c-abb4-17b4a87ff93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:19.639378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 138/273] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:19.676382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d5815-609e-47c6-981f-798a3cf1dc82 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:19.767271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:19.819013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dd9c6-8444-41e3-8d0e-08640a2546a5 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:19.819013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dd9c6-8444-41e3-8d0e-08640a2546a5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:19.819013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88dd9c6-8444-41e3-8d0e-08640a2546a5 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:19.821269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 139/274] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:19.828663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d5815-609e-47c6-981f-798a3cf1dc82 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:19.836491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24dac5-50b9-431c-9979-5b1a86766e06 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:19.836491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24dac5-50b9-431c-9979-5b1a86766e06 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:19.836491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b24dac5-50b9-431c-9979-5b1a86766e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:19.859268 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-3b24dac5-50b9-431c-9979-5b1a86766e06 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:19.860855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3b24dac5-50b9-431c-9979-5b1a86766e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:19.888764 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ed4a-a242-4646-9507-2f5e5a6c851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:19.889534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ed4a-a242-4646-9507-2f5e5a6c851f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:19.890043 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ed4a-a242-4646-9507-2f5e5a6c851f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:19.890399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893ed4a-a242-4646-9507-2f5e5a6c851f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:19.917240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893ed4a-a242-4646-9507-2f5e5a6c851f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-3893ed4a-a242-4646-9507-2f5e5a6c851f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:19.923848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:19.924731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:19.925523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:19.929796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 136/275] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:19.931125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ed4a-a242-4646-9507-2f5e5a6c851f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:19.961935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:19.964114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 140/276] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:20.057585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893ed4a-a242-4646-9507-2f5e5a6c851f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:20.083127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:20.086066 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24dac5-50b9-431c-9979-5b1a86766e06 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:20.109742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee43ae-659d-4983-834e-342300a91987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:20.110753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee43ae-659d-4983-834e-342300a91987 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:20.111195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee43ae-659d-4983-834e-342300a91987 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:20.111612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee43ae-659d-4983-834e-342300a91987 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:20.112336 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee43ae-659d-4983-834e-342300a91987 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:20.112643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee43ae-659d-4983-834e-342300a91987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:20.114708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ee43ae-659d-4983-834e-342300a91987 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:20.127216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 137/277] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:20.133395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee43ae-659d-4983-834e-342300a91987 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:20.236456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b24dac5-50b9-431c-9979-5b1a86766e06 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:20.266781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee43ae-659d-4983-834e-342300a91987 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:20.278606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081766f-0ade-4564-82ed-8d2b981cb87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:20.280113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081766f-0ade-4564-82ed-8d2b981cb87a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:20.280586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081766f-0ade-4564-82ed-8d2b981cb87a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:20.280994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081766f-0ade-4564-82ed-8d2b981cb87a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:20.284482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081766f-0ade-4564-82ed-8d2b981cb87a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:20.288391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081766f-0ade-4564-82ed-8d2b981cb87a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:20.290484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 141/278] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:20.299009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081766f-0ade-4564-82ed-8d2b981cb87a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:20.315012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55da0c-d909-4644-9718-b33a0e7edd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:20.315652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55da0c-d909-4644-9718-b33a0e7edd0c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:20.315979 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55da0c-d909-4644-9718-b33a0e7edd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:20.316266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55da0c-d909-4644-9718-b33a0e7edd0c None admin] PATH_INFO: `/v3/users/f14ef762a3d64df4b065679e5aa846f8` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:20.317598 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55da0c-d909-4644-9718-b33a0e7edd0c None admin] RBAC: Authorizing `identity:get_user(user_id=f14ef762a3d64df4b065679e5aa846f8)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:20.319107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55da0c-d909-4644-9718-b33a0e7edd0c None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:20.321089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 138/279] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:20 2022] GET /identity/v3/users/f14ef762a3d64df4b065679e5aa846f8 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:20.321855 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55da0c-d909-4644-9718-b33a0e7edd0c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:20.374671 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:20.382341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:20.419842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081766f-0ade-4564-82ed-8d2b981cb87a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:20.433834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55da0c-d909-4644-9718-b33a0e7edd0c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:20.458705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ccae-05f8-4f52-adde-5949b98a49b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:20.459324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ccae-05f8-4f52-adde-5949b98a49b6 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:20.459604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ccae-05f8-4f52-adde-5949b98a49b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:20.460202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ccae-05f8-4f52-adde-5949b98a49b6 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:20.460635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ccae-05f8-4f52-adde-5949b98a49b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:20.462100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ccae-05f8-4f52-adde-5949b98a49b6 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:20.473155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5562b-86b2-4a4e-8e1c-44d7acd9fb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:20.473483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5562b-86b2-4a4e-8e1c-44d7acd9fb1b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:20.473762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5562b-86b2-4a4e-8e1c-44d7acd9fb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:20.474041 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5562b-86b2-4a4e-8e1c-44d7acd9fb1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:20.485616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5562b-86b2-4a4e-8e1c-44d7acd9fb1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-67c5562b-86b2-4a4e-8e1c-44d7acd9fb1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:20.490927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:20.491868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:20.492710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 139/280] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:20.493853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5562b-86b2-4a4e-8e1c-44d7acd9fb1b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:20.562943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 142/281] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:56:20 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:56:20.564578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ccae-05f8-4f52-adde-5949b98a49b6 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:20.617044 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5562b-86b2-4a4e-8e1c-44d7acd9fb1b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:20.634737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:20.661039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a002958-3a06-4067-b119-7d0a8d12ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:20.662058 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a002958-3a06-4067-b119-7d0a8d12ed50 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:20.662567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a002958-3a06-4067-b119-7d0a8d12ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:20.663074 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a002958-3a06-4067-b119-7d0a8d12ed50 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:20.664743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a002958-3a06-4067-b119-7d0a8d12ed50 None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:20.666720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a002958-3a06-4067-b119-7d0a8d12ed50 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:20.668847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 140/282] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:20 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:20.675086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a002958-3a06-4067-b119-7d0a8d12ed50 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:20.718617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ccae-05f8-4f52-adde-5949b98a49b6 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:20.736766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:20.762913 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3832bec-7073-4cf1-b48f-d5790f53eedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:20.763556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3832bec-7073-4cf1-b48f-d5790f53eedd None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:20.764488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3832bec-7073-4cf1-b48f-d5790f53eedd None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:20.764740 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3832bec-7073-4cf1-b48f-d5790f53eedd None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:20.765408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3832bec-7073-4cf1-b48f-d5790f53eedd None admin] RBAC: Adding query filter params (name=member) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:20.766130 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3832bec-7073-4cf1-b48f-d5790f53eedd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:20.767269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3832bec-7073-4cf1-b48f-d5790f53eedd None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:20.778078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 143/283] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:20.779489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97193712-fccb-468c-94a9-9a3207e32e84 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:20.779985 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97193712-fccb-468c-94a9-9a3207e32e84 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:20.780089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97193712-fccb-468c-94a9-9a3207e32e84 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:20.781760 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 144/284] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:20.793150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97193712-fccb-468c-94a9-9a3207e32e84 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:20.795841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a002958-3a06-4067-b119-7d0a8d12ed50 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:20.849673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60d03-b0ea-4de6-ba69-ca31b4c2a469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:20.849673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60d03-b0ea-4de6-ba69-ca31b4c2a469 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:20.849673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60d03-b0ea-4de6-ba69-ca31b4c2a469 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:20.849673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60d03-b0ea-4de6-ba69-ca31b4c2a469 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e/users/f14ef762a3d64df4b065679e5aa846f8/roles/4913cb9f208f4c4892f61e1433923571` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:20.850729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe60d03-b0ea-4de6-ba69-ca31b4c2a469 None admin] RBAC: Authorizing `identity:create_grant(project_id=d678307757524765a2599dd485cbbb7e, user_id=f14ef762a3d64df4b065679e5aa846f8, role_id=4913cb9f208f4c4892f61e1433923571)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:20.852367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe60d03-b0ea-4de6-ba69-ca31b4c2a469 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:20.916484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97193712-fccb-468c-94a9-9a3207e32e84 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:20.952865 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc97b73-320c-4fa8-8a0f-f293380cc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:20.953509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc97b73-320c-4fa8-8a0f-f293380cc850 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:20.953786 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc97b73-320c-4fa8-8a0f-f293380cc850 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:20.954053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc97b73-320c-4fa8-8a0f-f293380cc850 None admin] PATH_INFO: `/v3/users/cffe465dfb36453abc37efb72f2bfa91` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:20.968506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc97b73-320c-4fa8-8a0f-f293380cc850 None admin] RBAC: Authorizing `identity:get_user(user_id=cffe465dfb36453abc37efb72f2bfa91)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:20.969967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc97b73-320c-4fa8-8a0f-f293380cc850 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:20.971894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 145/285] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:20 2022] GET /identity/v3/users/cffe465dfb36453abc37efb72f2bfa91 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:20.972918 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f6d7-6c1d-4f49-8f36-ab1b672c9c80 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:20.973203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f6d7-6c1d-4f49-8f36-ab1b672c9c80 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:20.973451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f6d7-6c1d-4f49-8f36-ab1b672c9c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:20.991632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c4c8f6d7-6c1d-4f49-8f36-ab1b672c9c80 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:20.992854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c4c8f6d7-6c1d-4f49-8f36-ab1b672c9c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:21.006616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 141/286] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:56:20 2022] PUT /identity/v3/projects/d678307757524765a2599dd485cbbb7e/users/f14ef762a3d64df4b065679e5aa846f8/roles/4913cb9f208f4c4892f61e1433923571 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:21.008491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60d03-b0ea-4de6-ba69-ca31b4c2a469 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:21.037778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:21.066906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:21.111079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 146/287] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:21.137901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60d03-b0ea-4de6-ba69-ca31b4c2a469 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:21.175915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66b8d0-c046-48c7-9cc3-619519439b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:21.176852 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b8d0-c046-48c7-9cc3-619519439b9e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:21.177311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b8d0-c046-48c7-9cc3-619519439b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:21.177763 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b8d0-c046-48c7-9cc3-619519439b9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:21.178732 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66b8d0-c046-48c7-9cc3-619519439b9e None admin] RBAC: Adding query filter params (role.id=24cce6d670834e3ba65b942574313d0a, user.id=cffe465dfb36453abc37efb72f2bfa91, scope.system=all) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:21.179226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66b8d0-c046-48c7-9cc3-619519439b9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:21.180991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66b8d0-c046-48c7-9cc3-619519439b9e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:21.188382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 142/288] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Aug 24 16:56:21 2022] GET /identity/v3/role_assignments?user.id=cffe465dfb36453abc37efb72f2bfa91&scope.system=all&role.id=24cce6d670834e3ba65b942574313d0a => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:21.439073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8f6d7-6c1d-4f49-8f36-ab1b672c9c80 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:21.546644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8f6d7-6c1d-4f49-8f36-ab1b672c9c80 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:21.584842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be4052-5d54-4591-9a51-7fd2e36642ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:21.585827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4052-5d54-4591-9a51-7fd2e36642ce None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:21.586321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4052-5d54-4591-9a51-7fd2e36642ce None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:21.586783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be4052-5d54-4591-9a51-7fd2e36642ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:21.597860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be4052-5d54-4591-9a51-7fd2e36642ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-f4be4052-5d54-4591-9a51-7fd2e36642ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:21.602859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:21.603730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:21.604518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:21.606789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 147/289] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:21.613699 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66b8d0-c046-48c7-9cc3-619519439b9e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:21.719349 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66b8d0-c046-48c7-9cc3-619519439b9e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:21.722154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:21.755655 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2c644-d64e-4b17-a815-928b4161fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:21.756347 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c644-d64e-4b17-a815-928b4161fb45 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:21.756632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c644-d64e-4b17-a815-928b4161fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:21.756907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c644-d64e-4b17-a815-928b4161fb45 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:21.757628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2c644-d64e-4b17-a815-928b4161fb45 None admin] RBAC: Adding query filter params (name=member) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:21.757933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2c644-d64e-4b17-a815-928b4161fb45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:21.759305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2c644-d64e-4b17-a815-928b4161fb45 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:21.772611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 143/290] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:21.774237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be4052-5d54-4591-9a51-7fd2e36642ce None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:21.804431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:21.885814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be4052-5d54-4591-9a51-7fd2e36642ce None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:21.931487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09147dd-e92c-4273-9eb1-e3f8ba465f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:21.932133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09147dd-e92c-4273-9eb1-e3f8ba465f33 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:21.932484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09147dd-e92c-4273-9eb1-e3f8ba465f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:21.932758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09147dd-e92c-4273-9eb1-e3f8ba465f33 None admin] PATH_INFO: `/v3/users/6e8ddbaf7de84ca39c5c954f818fe49a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:21.933905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09147dd-e92c-4273-9eb1-e3f8ba465f33 None admin] RBAC: Authorizing `identity:get_user(user_id=6e8ddbaf7de84ca39c5c954f818fe49a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:21.935650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09147dd-e92c-4273-9eb1-e3f8ba465f33 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:21.937773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 148/291] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:21 2022] GET /identity/v3/users/6e8ddbaf7de84ca39c5c954f818fe49a => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:21.943572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2c644-d64e-4b17-a815-928b4161fb45 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:22.057829 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2c644-d64e-4b17-a815-928b4161fb45 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:22.094340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502696a8-6b96-4b78-8473-ca1d3995ee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:22.094956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502696a8-6b96-4b78-8473-ca1d3995ee91 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:22.095237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502696a8-6b96-4b78-8473-ca1d3995ee91 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:22.095508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502696a8-6b96-4b78-8473-ca1d3995ee91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:22.140758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:22.165911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502696a8-6b96-4b78-8473-ca1d3995ee91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:22.174226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502696a8-6b96-4b78-8473-ca1d3995ee91 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:22.274023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 144/292] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:22.275502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09147dd-e92c-4273-9eb1-e3f8ba465f33 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:22.422922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:22.429830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09147dd-e92c-4273-9eb1-e3f8ba465f33 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:22.471181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27000f6-1c51-4b59-89a3-7f6df12a1144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:22.471827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27000f6-1c51-4b59-89a3-7f6df12a1144 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:22.472500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27000f6-1c51-4b59-89a3-7f6df12a1144 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:22.472777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27000f6-1c51-4b59-89a3-7f6df12a1144 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:22.473941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27000f6-1c51-4b59-89a3-7f6df12a1144 None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:22.475597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27000f6-1c51-4b59-89a3-7f6df12a1144 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:22.482738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 149/293] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:22 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:22.484369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502696a8-6b96-4b78-8473-ca1d3995ee91 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:22.557665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:22.590179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502696a8-6b96-4b78-8473-ca1d3995ee91 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:22.630335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c818c-36b9-4706-bbe7-c37ceeb3441e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:22.636625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c818c-36b9-4706-bbe7-c37ceeb3441e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:22.636901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c818c-36b9-4706-bbe7-c37ceeb3441e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:22.637176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c818c-36b9-4706-bbe7-c37ceeb3441e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:22.637951 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c818c-36b9-4706-bbe7-c37ceeb3441e None admin] RBAC: Adding query filter params (role.id=24cce6d670834e3ba65b942574313d0a, scope.project.id=d678307757524765a2599dd485cbbb7e, user.id=6e8ddbaf7de84ca39c5c954f818fe49a) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:22.638262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c818c-36b9-4706-bbe7-c37ceeb3441e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:22.640317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c818c-36b9-4706-bbe7-c37ceeb3441e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:22.647185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 145/294] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:22 2022] GET /identity/v3/role_assignments?user.id=6e8ddbaf7de84ca39c5c954f818fe49a&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=24cce6d670834e3ba65b942574313d0a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:22.969752 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e8942-51c4-4b93-8dc7-d423ec0d4b48 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:22.970065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e8942-51c4-4b93-8dc7-d423ec0d4b48 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:22.970305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e8942-51c4-4b93-8dc7-d423ec0d4b48 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:22.971647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 150/295] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:22.977205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a1ce0-48bc-4aeb-a5c3-70d1175e4fe2 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:22.977646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a1ce0-48bc-4aeb-a5c3-70d1175e4fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:22.977820 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a1ce0-48bc-4aeb-a5c3-70d1175e4fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:22.996947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-343a1ce0-48bc-4aeb-a5c3-70d1175e4fe2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:22.998820 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-343a1ce0-48bc-4aeb-a5c3-70d1175e4fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:23.078655 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 146/296] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:23.201732 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07354e2-d66e-4baa-a1de-605b4bb7b111 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:23.201986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07354e2-d66e-4baa-a1de-605b4bb7b111 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:23.202286 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07354e2-d66e-4baa-a1de-605b4bb7b111 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:23.203739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 151/297] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:23.209592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5f18b-f582-4128-a27c-f5f0c821a9c6 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:23.209878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5f18b-f582-4128-a27c-f5f0c821a9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:23.210151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5f18b-f582-4128-a27c-f5f0c821a9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:23.233388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-3dc5f18b-f582-4128-a27c-f5f0c821a9c6 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:23.234559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3dc5f18b-f582-4128-a27c-f5f0c821a9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:23.302157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:23.321031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 147/298] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:23.387796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07354e2-d66e-4baa-a1de-605b4bb7b111 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:23.500498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07354e2-d66e-4baa-a1de-605b4bb7b111 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:23.537696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf894e2-ae0a-4af3-8126-49f9eaab2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:23.538594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf894e2-ae0a-4af3-8126-49f9eaab2d55 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:23.539008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf894e2-ae0a-4af3-8126-49f9eaab2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:23.539410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf894e2-ae0a-4af3-8126-49f9eaab2d55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:23.540720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf894e2-ae0a-4af3-8126-49f9eaab2d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:23.542384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf894e2-ae0a-4af3-8126-49f9eaab2d55 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:23.544597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 152/299] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:23.550309 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5f18b-f582-4128-a27c-f5f0c821a9c6 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:23.607047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf894e2-ae0a-4af3-8126-49f9eaab2d55 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:23.653982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:23.659056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5f18b-f582-4128-a27c-f5f0c821a9c6 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:23.695614 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0650f-fb6c-475c-bd19-cb6ecacbbed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:23.696222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0650f-fb6c-475c-bd19-cb6ecacbbed6 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:23.696524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0650f-fb6c-475c-bd19-cb6ecacbbed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:23.696797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0650f-fb6c-475c-bd19-cb6ecacbbed6 None admin] PATH_INFO: `/v3/groups` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:23.697480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0650f-fb6c-475c-bd19-cb6ecacbbed6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:23.698906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c0650f-fb6c-475c-bd19-cb6ecacbbed6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:23.715429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf894e2-ae0a-4af3-8126-49f9eaab2d55 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:23.750168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db9305-3618-4f16-ad82-dfe5361f3110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:23.750851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db9305-3618-4f16-ad82-dfe5361f3110 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:23.751067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db9305-3618-4f16-ad82-dfe5361f3110 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:23.751333 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db9305-3618-4f16-ad82-dfe5361f3110 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:23.761181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db9305-3618-4f16-ad82-dfe5361f3110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-26db9305-3618-4f16-ad82-dfe5361f3110 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:23.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:23.768120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:23.769163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 153/300] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:56:23.769975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e4ca-767e-412e-9999-8519d4feafe5 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:23.769975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e4ca-767e-412e-9999-8519d4feafe5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:23.769975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844e4ca-767e-412e-9999-8519d4feafe5 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:23.771167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 154/301] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:23.772207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e565f3-f104-470c-a044-7536c1f07233 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:23.772578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e565f3-f104-470c-a044-7536c1f07233 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:23.772834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e565f3-f104-470c-a044-7536c1f07233 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:23.774675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 155/302] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:23.775913 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e565f3-f104-470c-a044-7536c1f07233 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:23.790343 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 148/303] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Aug 24 16:56:23 2022] POST /identity/v3/groups => generated 229 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:56:23.791771 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c47d6d-59bf-4164-bb02-171c55ff9ab5 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:23.792093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c47d6d-59bf-4164-bb02-171c55ff9ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:23.792400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c47d6d-59bf-4164-bb02-171c55ff9ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:23.814289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-c8c47d6d-59bf-4164-bb02-171c55ff9ab5 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:23.816854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c8c47d6d-59bf-4164-bb02-171c55ff9ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:23.876591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:23.899817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 149/304] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:23.901155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f6ec-aa16-49b1-be0d-21629538a577 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:23.901443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f6ec-aa16-49b1-be0d-21629538a577 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:23.901717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f6ec-aa16-49b1-be0d-21629538a577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:23.921701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6e96f6ec-aa16-49b1-be0d-21629538a577 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:23.922938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6e96f6ec-aa16-49b1-be0d-21629538a577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:23.979697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:23.996081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e565f3-f104-470c-a044-7536c1f07233 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:24.030304 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 150/305] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:24.043599 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235d133-fbb8-4c68-b712-ca0dc1957927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:24.044487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235d133-fbb8-4c68-b712-ca0dc1957927 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:24.045429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235d133-fbb8-4c68-b712-ca0dc1957927 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:24.045871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235d133-fbb8-4c68-b712-ca0dc1957927 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:24.046781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235d133-fbb8-4c68-b712-ca0dc1957927 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:24.047231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235d133-fbb8-4c68-b712-ca0dc1957927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:24.048783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235d133-fbb8-4c68-b712-ca0dc1957927 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:24.057444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 156/306] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:24.064111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96f6ec-aa16-49b1-be0d-21629538a577 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:24.168800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96f6ec-aa16-49b1-be0d-21629538a577 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:24.184590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:24.205327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3d0d-4de2-4dca-bcfa-9842a4e62b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:24.205543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235d133-fbb8-4c68-b712-ca0dc1957927 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:24.205967 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3d0d-4de2-4dca-bcfa-9842a4e62b0d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:24.206251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3d0d-4de2-4dca-bcfa-9842a4e62b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:24.206525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3d0d-4de2-4dca-bcfa-9842a4e62b0d None admin] PATH_INFO: `/v3/users/a93f242d0d5e44afb7dc2f5e7eb39610` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:24.222373 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3d0d-4de2-4dca-bcfa-9842a4e62b0d None admin] RBAC: Authorizing `identity:get_user(user_id=a93f242d0d5e44afb7dc2f5e7eb39610)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:24.223851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3d0d-4de2-4dca-bcfa-9842a4e62b0d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:24.225554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 151/307] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:24 2022] GET /identity/v3/users/a93f242d0d5e44afb7dc2f5e7eb39610 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:24.231324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3d0d-4de2-4dca-bcfa-9842a4e62b0d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:24.333411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235d133-fbb8-4c68-b712-ca0dc1957927 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:24.361550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3d0d-4de2-4dca-bcfa-9842a4e62b0d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:24.370323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e778fd9-4a33-42d6-9c29-86af7e70f64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:24.371772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e778fd9-4a33-42d6-9c29-86af7e70f64b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:24.372298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e778fd9-4a33-42d6-9c29-86af7e70f64b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:24.373411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e778fd9-4a33-42d6-9c29-86af7e70f64b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:24.386906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e778fd9-4a33-42d6-9c29-86af7e70f64b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-5e778fd9-4a33-42d6-9c29-86af7e70f64b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:24.392911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:24.394321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 157/308] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:24.395184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e778fd9-4a33-42d6-9c29-86af7e70f64b None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:24.404662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511fcc3-f4a7-4227-b855-a8c89761ec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:24.405469 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511fcc3-f4a7-4227-b855-a8c89761ec21 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:24.405742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511fcc3-f4a7-4227-b855-a8c89761ec21 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:24.406006 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511fcc3-f4a7-4227-b855-a8c89761ec21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:24.406730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511fcc3-f4a7-4227-b855-a8c89761ec21 None admin] RBAC: Adding query filter params (role.id=4913cb9f208f4c4892f61e1433923571, user.id=a93f242d0d5e44afb7dc2f5e7eb39610, scope.system=all) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:24.407035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511fcc3-f4a7-4227-b855-a8c89761ec21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:24.408507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511fcc3-f4a7-4227-b855-a8c89761ec21 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:24.412408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:24.419225 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 152/309] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Aug 24 16:56:24 2022] GET /identity/v3/role_assignments?user.id=a93f242d0d5e44afb7dc2f5e7eb39610&scope.system=all&role.id=4913cb9f208f4c4892f61e1433923571 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:24.419225 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511fcc3-f4a7-4227-b855-a8c89761ec21 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:24.452624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:24.544522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e778fd9-4a33-42d6-9c29-86af7e70f64b None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:24.548050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511fcc3-f4a7-4227-b855-a8c89761ec21 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:24.591502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493dc1f-36c6-4952-8b82-70dfc35e1ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:24.592288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493dc1f-36c6-4952-8b82-70dfc35e1ffc None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:24.592573 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493dc1f-36c6-4952-8b82-70dfc35e1ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:24.592840 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493dc1f-36c6-4952-8b82-70dfc35e1ffc None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:24.593502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493dc1f-36c6-4952-8b82-70dfc35e1ffc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:24.593801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493dc1f-36c6-4952-8b82-70dfc35e1ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:24.595352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493dc1f-36c6-4952-8b82-70dfc35e1ffc None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:24.602158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db617b-b8b5-4043-92ab-418497520207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:24.603072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db617b-b8b5-4043-92ab-418497520207 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:24.603577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db617b-b8b5-4043-92ab-418497520207 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:24.603816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 153/310] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:24.604278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db617b-b8b5-4043-92ab-418497520207 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:24.610060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493dc1f-36c6-4952-8b82-70dfc35e1ffc None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:24.618160 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db617b-b8b5-4043-92ab-418497520207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-42db617b-b8b5-4043-92ab-418497520207 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:24.626412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:24.627292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:24.628059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:24.634261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 158/311] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:24.635534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db617b-b8b5-4043-92ab-418497520207 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:24.723425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:24.730777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:24.733165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493dc1f-36c6-4952-8b82-70dfc35e1ffc None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:24.772472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7b02e-8eac-400c-b3d7-e3827148543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:24.773029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b02e-8eac-400c-b3d7-e3827148543b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:24.773305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b02e-8eac-400c-b3d7-e3827148543b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:24.773678 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7b02e-8eac-400c-b3d7-e3827148543b None admin] PATH_INFO: `/v3/users/f14ef762a3d64df4b065679e5aa846f8` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:24.775122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7b02e-8eac-400c-b3d7-e3827148543b None admin] RBAC: Authorizing `identity:get_user(user_id=f14ef762a3d64df4b065679e5aa846f8)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:24.776784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd7b02e-8eac-400c-b3d7-e3827148543b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:24.777779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db617b-b8b5-4043-92ab-418497520207 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:24.778464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 154/312] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:24 2022] GET /identity/v3/users/f14ef762a3d64df4b065679e5aa846f8 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:24.784779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7b02e-8eac-400c-b3d7-e3827148543b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:24.825459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77269f69-0995-4960-a61a-29f22e1bbb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:24.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77269f69-0995-4960-a61a-29f22e1bbb69 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:24.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77269f69-0995-4960-a61a-29f22e1bbb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:24.827027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77269f69-0995-4960-a61a-29f22e1bbb69 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:24.827827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77269f69-0995-4960-a61a-29f22e1bbb69 None admin] RBAC: Adding query filter params (name=member) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:24.828256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77269f69-0995-4960-a61a-29f22e1bbb69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:24.830451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77269f69-0995-4960-a61a-29f22e1bbb69 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:24.848372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 159/313] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:24.849739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77269f69-0995-4960-a61a-29f22e1bbb69 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:24.906170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7b02e-8eac-400c-b3d7-e3827148543b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:24.946927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3a0f9-7bf9-449a-8525-6bde936b3f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:24.948473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3a0f9-7bf9-449a-8525-6bde936b3f94 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:24.948857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3a0f9-7bf9-449a-8525-6bde936b3f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:24.949208 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3a0f9-7bf9-449a-8525-6bde936b3f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:24.990681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77269f69-0995-4960-a61a-29f22e1bbb69 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:24.994212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:25.036183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab0164-892c-47c5-8a88-1b11dfb77a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:25.036955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab0164-892c-47c5-8a88-1b11dfb77a0a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:25.037306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab0164-892c-47c5-8a88-1b11dfb77a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:25.037650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab0164-892c-47c5-8a88-1b11dfb77a0a None admin] PATH_INFO: `/v3/users/cffe465dfb36453abc37efb72f2bfa91` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:25.039772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3a0f9-7bf9-449a-8525-6bde936b3f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:25.042145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab0164-892c-47c5-8a88-1b11dfb77a0a None admin] RBAC: Authorizing `identity:get_user(user_id=cffe465dfb36453abc37efb72f2bfa91)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:25.042262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3a0f9-7bf9-449a-8525-6bde936b3f94 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:25.042369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab0164-892c-47c5-8a88-1b11dfb77a0a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:25.042369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 160/314] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:24 2022] GET /identity/v3/users/cffe465dfb36453abc37efb72f2bfa91 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:25.048115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab0164-892c-47c5-8a88-1b11dfb77a0a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:25.050987 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:25.150359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 155/315] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:25.158389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab0164-892c-47c5-8a88-1b11dfb77a0a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:25.162097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3a0f9-7bf9-449a-8525-6bde936b3f94 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:25.197240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4ed4-a1c6-4e9f-b4da-63b228f7967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:25.198290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4ed4-a1c6-4e9f-b4da-63b228f7967d None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:25.198742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4ed4-a1c6-4e9f-b4da-63b228f7967d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:25.199184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b4ed4-a1c6-4e9f-b4da-63b228f7967d None admin] PATH_INFO: `/v3/system/users/cffe465dfb36453abc37efb72f2bfa91/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:25.201091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b4ed4-a1c6-4e9f-b4da-63b228f7967d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cffe465dfb36453abc37efb72f2bfa91, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:25.203298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b4ed4-a1c6-4e9f-b4da-63b228f7967d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:25.229517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:25.267625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3a0f9-7bf9-449a-8525-6bde936b3f94 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:25.294351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 161/316] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Aug 24 16:56:25 2022] PUT /identity/v3/system/users/cffe465dfb36453abc37efb72f2bfa91/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:25.312386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeda3bb-856d-443c-929f-c9e3b7d101bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:25.313459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda3bb-856d-443c-929f-c9e3b7d101bd None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:25.313955 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda3bb-856d-443c-929f-c9e3b7d101bd None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:25.314418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeda3bb-856d-443c-929f-c9e3b7d101bd None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:25.316152 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeda3bb-856d-443c-929f-c9e3b7d101bd None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:25.317992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeda3bb-856d-443c-929f-c9e3b7d101bd None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:25.320054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 156/317] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:25 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:25.328788 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4ed4-a1c6-4e9f-b4da-63b228f7967d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:25.410721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:25.453493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b4ed4-a1c6-4e9f-b4da-63b228f7967d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:25.491745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac48623-9f87-4467-9ef9-e01b563b3702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:25.492747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48623-9f87-4467-9ef9-e01b563b3702 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:25.493224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48623-9f87-4467-9ef9-e01b563b3702 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:25.493700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48623-9f87-4467-9ef9-e01b563b3702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:25.494442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac48623-9f87-4467-9ef9-e01b563b3702 None admin] RBAC: Adding query filter params (role.id=4913cb9f208f4c4892f61e1433923571, scope.project.id=d678307757524765a2599dd485cbbb7e, user.id=f14ef762a3d64df4b065679e5aa846f8) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:25.494756 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac48623-9f87-4467-9ef9-e01b563b3702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:25.496213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac48623-9f87-4467-9ef9-e01b563b3702 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:25.503184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 162/318] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:25 2022] GET /identity/v3/role_assignments?user.id=f14ef762a3d64df4b065679e5aa846f8&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=4913cb9f208f4c4892f61e1433923571 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:25.905967 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a502e-ab6a-438e-a96a-1bfb93038919 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:25.906363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a502e-ab6a-438e-a96a-1bfb93038919 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:25.906583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a502e-ab6a-438e-a96a-1bfb93038919 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:25.907844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 157/319] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:25.913606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418302-237a-470d-9134-7f6425357c99 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:25.913892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418302-237a-470d-9134-7f6425357c99 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:25.914168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418302-237a-470d-9134-7f6425357c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:25.932284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-aa418302-237a-470d-9134-7f6425357c99 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:25.933509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-aa418302-237a-470d-9134-7f6425357c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:26.001447 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 163/320] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:26.274099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a502e-ab6a-438e-a96a-1bfb93038919 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:26.393722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a502e-ab6a-438e-a96a-1bfb93038919 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:26.423451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:26.426498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b52628-302b-463d-9bee-a204b528169f None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:26.426945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b52628-302b-463d-9bee-a204b528169f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:26.427054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b52628-302b-463d-9bee-a204b528169f None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:26.428436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 164/321] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:26.430966 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62cee-5fa2-4a16-acaf-9358580de384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:26.431609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62cee-5fa2-4a16-acaf-9358580de384 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:26.431896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62cee-5fa2-4a16-acaf-9358580de384 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:26.432168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd62cee-5fa2-4a16-acaf-9358580de384 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:26.433320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd62cee-5fa2-4a16-acaf-9358580de384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:26.442375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7826f89-b2e0-4af6-b9c2-3d96f25208d9 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:26.442375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7826f89-b2e0-4af6-b9c2-3d96f25208d9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:26.442375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7826f89-b2e0-4af6-b9c2-3d96f25208d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:26.442621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd62cee-5fa2-4a16-acaf-9358580de384 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:26.442621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 158/322] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:26.442758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62cee-5fa2-4a16-acaf-9358580de384 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:26.455419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-e7826f89-b2e0-4af6-b9c2-3d96f25208d9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:26.456724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e7826f89-b2e0-4af6-b9c2-3d96f25208d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:26.516637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:26.536837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 165/323] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:26.554794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd62cee-5fa2-4a16-acaf-9358580de384 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:26.590798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c0f7-0293-4d86-96c0-4a3cf6fb4547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:26.591492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c0f7-0293-4d86-96c0-4a3cf6fb4547 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:26.591921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c0f7-0293-4d86-96c0-4a3cf6fb4547 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:26.592337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c0f7-0293-4d86-96c0-4a3cf6fb4547 None admin] PATH_INFO: `/v3/groups` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:26.592969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20c0f7-0293-4d86-96c0-4a3cf6fb4547 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:26.594388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20c0f7-0293-4d86-96c0-4a3cf6fb4547 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:26.722054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 159/324] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Aug 24 16:56:26 2022] POST /identity/v3/groups => generated 226 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:56:26.807640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7826f89-b2e0-4af6-b9c2-3d96f25208d9 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:26.953550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7826f89-b2e0-4af6-b9c2-3d96f25208d9 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:26.990310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813c55f-da9e-4eb6-bf49-95acdc26a7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:26.990948 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813c55f-da9e-4eb6-bf49-95acdc26a7fe None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:26.991224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813c55f-da9e-4eb6-bf49-95acdc26a7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:26.991491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813c55f-da9e-4eb6-bf49-95acdc26a7fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:27.003434 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813c55f-da9e-4eb6-bf49-95acdc26a7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-6813c55f-da9e-4eb6-bf49-95acdc26a7fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:27.008424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:27.009269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:27.010050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 166/325] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:27.017348 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c0f7-0293-4d86-96c0-4a3cf6fb4547 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:27.085684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:27.131162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c0f7-0293-4d86-96c0-4a3cf6fb4547 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:27.167283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23c398-da30-4f09-993a-8ed5fbe0294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:27.167948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23c398-da30-4f09-993a-8ed5fbe0294f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:27.168333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23c398-da30-4f09-993a-8ed5fbe0294f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:27.168585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23c398-da30-4f09-993a-8ed5fbe0294f None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:27.169246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23c398-da30-4f09-993a-8ed5fbe0294f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:27.170078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23c398-da30-4f09-993a-8ed5fbe0294f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:27.172028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23c398-da30-4f09-993a-8ed5fbe0294f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:27.181269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 160/326] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:27.187915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813c55f-da9e-4eb6-bf49-95acdc26a7fe None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:27.246999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:27.305162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813c55f-da9e-4eb6-bf49-95acdc26a7fe None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:27.323072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb80d14-fa16-4074-ae86-8edd75642968 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:27.323573 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb80d14-fa16-4074-ae86-8edd75642968 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:27.323647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb80d14-fa16-4074-ae86-8edd75642968 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:27.325049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 161/327] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:56:27.330702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fdb32-0ea1-4bac-b0fa-3f8efc9068aa None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:27.330976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fdb32-0ea1-4bac-b0fa-3f8efc9068aa None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:27.331252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fdb32-0ea1-4bac-b0fa-3f8efc9068aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:27.345100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4506bb-91a4-41b3-b68e-55c3251ce4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:27.345716 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4506bb-91a4-41b3-b68e-55c3251ce4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:27.346103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4506bb-91a4-41b3-b68e-55c3251ce4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:27.346320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4506bb-91a4-41b3-b68e-55c3251ce4a5 None admin] PATH_INFO: `/v3/users/a93f242d0d5e44afb7dc2f5e7eb39610` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:27.347556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4506bb-91a4-41b3-b68e-55c3251ce4a5 None admin] RBAC: Authorizing `identity:get_user(user_id=a93f242d0d5e44afb7dc2f5e7eb39610)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:27.349205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4506bb-91a4-41b3-b68e-55c3251ce4a5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:27.350886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 167/328] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:27 2022] GET /identity/v3/users/a93f242d0d5e44afb7dc2f5e7eb39610 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:27.357753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4506bb-91a4-41b3-b68e-55c3251ce4a5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:27.370274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-280fdb32-0ea1-4bac-b0fa-3f8efc9068aa None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:27.371495 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-280fdb32-0ea1-4bac-b0fa-3f8efc9068aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:27.472355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 162/329] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:27.495650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4506bb-91a4-41b3-b68e-55c3251ce4a5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:27.520183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:27.543198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefa4d8-2c9d-4518-b214-7d005892b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:27.543866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa4d8-2c9d-4518-b214-7d005892b141 None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:27.544144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa4d8-2c9d-4518-b214-7d005892b141 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:27.544494 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa4d8-2c9d-4518-b214-7d005892b141 None admin] PATH_INFO: `/v3/system/users/a93f242d0d5e44afb7dc2f5e7eb39610/roles/4913cb9f208f4c4892f61e1433923571` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:27.547041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefa4d8-2c9d-4518-b214-7d005892b141 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a93f242d0d5e44afb7dc2f5e7eb39610, role_id=4913cb9f208f4c4892f61e1433923571)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:27.548523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefa4d8-2c9d-4518-b214-7d005892b141 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:27.631010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 168/330] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Aug 24 16:56:27 2022] PUT /identity/v3/system/users/a93f242d0d5e44afb7dc2f5e7eb39610/roles/4913cb9f208f4c4892f61e1433923571 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:27.772878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fdb32-0ea1-4bac-b0fa-3f8efc9068aa None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:27.840520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:27.910414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fdb32-0ea1-4bac-b0fa-3f8efc9068aa None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:27.950131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09afe40-34ac-42e5-b758-292d3f0f4c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:27.951159 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09afe40-34ac-42e5-b758-292d3f0f4c13 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:27.951660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09afe40-34ac-42e5-b758-292d3f0f4c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:27.952168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09afe40-34ac-42e5-b758-292d3f0f4c13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:27.964331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09afe40-34ac-42e5-b758-292d3f0f4c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-d09afe40-34ac-42e5-b758-292d3f0f4c13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:27.970205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:27.971071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:27.971883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:27.974462 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 163/331] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:56:27.980026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefa4d8-2c9d-4518-b214-7d005892b141 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:28.090155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefa4d8-2c9d-4518-b214-7d005892b141 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:28.127615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02ff8d-d321-4bac-8311-7e7a960fab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:28.128682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02ff8d-d321-4bac-8311-7e7a960fab4d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:28.129181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02ff8d-d321-4bac-8311-7e7a960fab4d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:28.129650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02ff8d-d321-4bac-8311-7e7a960fab4d None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:28.130533 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02ff8d-d321-4bac-8311-7e7a960fab4d None admin] RBAC: Adding query filter params (name=member) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:28.131047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02ff8d-d321-4bac-8311-7e7a960fab4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:28.132702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d02ff8d-d321-4bac-8311-7e7a960fab4d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:28.142107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 169/332] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:28.148031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09afe40-34ac-42e5-b758-292d3f0f4c13 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:28.256118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09afe40-34ac-42e5-b758-292d3f0f4c13 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:28.269585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:28.296759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056723f2-7b78-4741-9c36-792571da0d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:28.297651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056723f2-7b78-4741-9c36-792571da0d8a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:28.297943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056723f2-7b78-4741-9c36-792571da0d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:28.298220 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056723f2-7b78-4741-9c36-792571da0d8a None admin] PATH_INFO: `/v3/users/cffe465dfb36453abc37efb72f2bfa91` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:28.299405 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056723f2-7b78-4741-9c36-792571da0d8a None admin] RBAC: Authorizing `identity:get_user(user_id=cffe465dfb36453abc37efb72f2bfa91)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:28.300909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056723f2-7b78-4741-9c36-792571da0d8a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:28.303043 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 164/333] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:28 2022] GET /identity/v3/users/cffe465dfb36453abc37efb72f2bfa91 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:28.309444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02ff8d-d321-4bac-8311-7e7a960fab4d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:28.375036 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:28.440152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02ff8d-d321-4bac-8311-7e7a960fab4d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:28.482831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732f24e-cdde-4d79-9c6c-ff724ad7b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:28.483768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732f24e-cdde-4d79-9c6c-ff724ad7b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:28.484272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732f24e-cdde-4d79-9c6c-ff724ad7b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:28.484805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732f24e-cdde-4d79-9c6c-ff724ad7b0b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:28.486125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732f24e-cdde-4d79-9c6c-ff724ad7b0b8 None admin] RBAC: Adding query filter params (role.id=24cce6d670834e3ba65b942574313d0a, user.id=cffe465dfb36453abc37efb72f2bfa91, scope.system=all) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:28.486717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732f24e-cdde-4d79-9c6c-ff724ad7b0b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:28.489336 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732f24e-cdde-4d79-9c6c-ff724ad7b0b8 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:28.510852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 170/334] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Aug 24 16:56:28 2022] GET /identity/v3/role_assignments?user.id=cffe465dfb36453abc37efb72f2bfa91&scope.system=all&role.id=24cce6d670834e3ba65b942574313d0a => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:29.427374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eaa51-995d-4282-9817-862bd830a407 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:29.427934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eaa51-995d-4282-9817-862bd830a407 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:29.427934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74eaa51-995d-4282-9817-862bd830a407 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:29.429555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 165/335] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:29.434554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb6b58-c0d8-43e2-83ed-0d5a88dcbaef None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:29.434846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb6b58-c0d8-43e2-83ed-0d5a88dcbaef None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:29.435759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb6b58-c0d8-43e2-83ed-0d5a88dcbaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:29.456258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0bcb6b58-c0d8-43e2-83ed-0d5a88dcbaef None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:29.457450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0bcb6b58-c0d8-43e2-83ed-0d5a88dcbaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:29.551428 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 171/336] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:29.590353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399216c-1aae-414f-8173-c542f63eb13d None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:29.590686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399216c-1aae-414f-8173-c542f63eb13d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:29.590901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399216c-1aae-414f-8173-c542f63eb13d None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:29.592992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 166/337] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:29.598738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e811-0dbe-46b6-9336-ede45b696f08 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:29.599023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e811-0dbe-46b6-9336-ede45b696f08 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:29.599295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59e811-0dbe-46b6-9336-ede45b696f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:29.618803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-6d59e811-0dbe-46b6-9336-ede45b696f08 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:29.619979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6d59e811-0dbe-46b6-9336-ede45b696f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:29.655244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:29.698403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 172/338] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:30.052331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399216c-1aae-414f-8173-c542f63eb13d None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:30.151868 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59e811-0dbe-46b6-9336-ede45b696f08 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:30.176612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399216c-1aae-414f-8173-c542f63eb13d None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:30.216600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db581ab8-bc1c-4cb0-b257-2d7feec0ce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:30.216600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db581ab8-bc1c-4cb0-b257-2d7feec0ce9a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:30.216600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db581ab8-bc1c-4cb0-b257-2d7feec0ce9a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:30.216600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db581ab8-bc1c-4cb0-b257-2d7feec0ce9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:30.231876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db581ab8-bc1c-4cb0-b257-2d7feec0ce9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-db581ab8-bc1c-4cb0-b257-2d7feec0ce9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:30.236903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:30.237996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:30.238989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:30.245819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 167/339] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:30.257226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db581ab8-bc1c-4cb0-b257-2d7feec0ce9a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:30.299625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59e811-0dbe-46b6-9336-ede45b696f08 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:30.313727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:30.346058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e8e00-5da6-4e50-b77d-086251ef055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:30.346718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e8e00-5da6-4e50-b77d-086251ef055f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:30.346997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e8e00-5da6-4e50-b77d-086251ef055f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:30.347264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e8e00-5da6-4e50-b77d-086251ef055f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:30.364492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e8e00-5da6-4e50-b77d-086251ef055f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-ad6e8e00-5da6-4e50-b77d-086251ef055f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:30.369426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:30.370284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:30.371075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 173/340] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:56:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:30.374796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f0990-d7c3-422d-b587-cc09e90f8d00 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:30.375071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f0990-d7c3-422d-b587-cc09e90f8d00 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:30.375379 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f0990-d7c3-422d-b587-cc09e90f8d00 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:30.379484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 174/341] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:30.384818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f0990-d7c3-422d-b587-cc09e90f8d00 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:30.425842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db581ab8-bc1c-4cb0-b257-2d7feec0ce9a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:30.436611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:30.473159 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a24bf-b02e-4d87-81e3-daf0c0a62aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:30.474401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a24bf-b02e-4d87-81e3-daf0c0a62aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:30.474833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a24bf-b02e-4d87-81e3-daf0c0a62aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:30.475251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a24bf-b02e-4d87-81e3-daf0c0a62aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:30.476065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a24bf-b02e-4d87-81e3-daf0c0a62aa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:30.476531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a24bf-b02e-4d87-81e3-daf0c0a62aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:30.478669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a24bf-b02e-4d87-81e3-daf0c0a62aa6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:30.489956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 168/342] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:30.491776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369747-a776-4896-94b8-76d5fde490cb None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:30.492489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369747-a776-4896-94b8-76d5fde490cb None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:30.492920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369747-a776-4896-94b8-76d5fde490cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:30.515220 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5a369747-a776-4896-94b8-76d5fde490cb None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:30.516684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5a369747-a776-4896-94b8-76d5fde490cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:30.620830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f0990-d7c3-422d-b587-cc09e90f8d00 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:30.651179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 169/343] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:30.654743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a369747-a776-4896-94b8-76d5fde490cb None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:30.692375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0ce39-2010-46d8-b91b-acb20f7cccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:30.694111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ce39-2010-46d8-b91b-acb20f7cccbf None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:30.694546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ce39-2010-46d8-b91b-acb20f7cccbf None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:30.695159 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0ce39-2010-46d8-b91b-acb20f7cccbf None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:30.698556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0ce39-2010-46d8-b91b-acb20f7cccbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:30.699037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0ce39-2010-46d8-b91b-acb20f7cccbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:30.701270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c0ce39-2010-46d8-b91b-acb20f7cccbf None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:30.715879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 175/344] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:30.720561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:30.722490 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0ce39-2010-46d8-b91b-acb20f7cccbf None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:30.860727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a369747-a776-4896-94b8-76d5fde490cb None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:30.890768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:30.921713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0ce39-2010-46d8-b91b-acb20f7cccbf None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:30.945014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78c968-ee13-4502-9e02-960cac21019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:30.945640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c968-ee13-4502-9e02-960cac21019a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:30.945925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c968-ee13-4502-9e02-960cac21019a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:30.946199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78c968-ee13-4502-9e02-960cac21019a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:30.963665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8da51-5544-4c5d-9324-e6361ec53aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:30.964792 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8da51-5544-4c5d-9324-e6361ec53aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:30.965262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8da51-5544-4c5d-9324-e6361ec53aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:30.965787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8da51-5544-4c5d-9324-e6361ec53aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.046138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8da51-5544-4c5d-9324-e6361ec53aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:31.048003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8da51-5544-4c5d-9324-e6361ec53aa5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:31.117219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78c968-ee13-4502-9e02-960cac21019a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:31.118725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78c968-ee13-4502-9e02-960cac21019a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:31.143236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:31.165640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 176/345] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:31.167466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:31.188019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8da51-5544-4c5d-9324-e6361ec53aa5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:31.293439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 170/346] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:31.295605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e1d98-bceb-49d2-abb7-7ab340941fed None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:31.296069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e1d98-bceb-49d2-abb7-7ab340941fed None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:31.300613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e1d98-bceb-49d2-abb7-7ab340941fed None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.302384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 171/347] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:31.303283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e1d98-bceb-49d2-abb7-7ab340941fed None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:31.322829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8da51-5544-4c5d-9324-e6361ec53aa5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:31.368551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c5aaf-12d5-4566-aa75-63fa997139f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:31.369596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5aaf-12d5-4566-aa75-63fa997139f5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:31.369877 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5aaf-12d5-4566-aa75-63fa997139f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:31.370151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5aaf-12d5-4566-aa75-63fa997139f5 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.371298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c5aaf-12d5-4566-aa75-63fa997139f5 None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:31.372988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c5aaf-12d5-4566-aa75-63fa997139f5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:31.374872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 177/348] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:31 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:31.375473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c5aaf-12d5-4566-aa75-63fa997139f5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:31.441857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e1d98-bceb-49d2-abb7-7ab340941fed None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:31.442203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:31.481992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:31.491081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffdea6-9ede-4870-9071-51f4d3aa08ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:31.491717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffdea6-9ede-4870-9071-51f4d3aa08ae None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:31.491989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffdea6-9ede-4870-9071-51f4d3aa08ae None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:31.492284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffdea6-9ede-4870-9071-51f4d3aa08ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.501493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c5aaf-12d5-4566-aa75-63fa997139f5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:31.504137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffdea6-9ede-4870-9071-51f4d3aa08ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-adffdea6-9ede-4870-9071-51f4d3aa08ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:31.509997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:31.510921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:31.511784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 172/349] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:31.513528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5928753-09c9-472a-885a-8144692535d3 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:31.513633 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5928753-09c9-472a-885a-8144692535d3 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:31.513948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5928753-09c9-472a-885a-8144692535d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.543730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b5928753-09c9-472a-885a-8144692535d3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:31.544995 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b5928753-09c9-472a-885a-8144692535d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:31.556087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7b0b8-d942-4d54-80f7-9de49a5cb854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:31.556836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7b0b8-d942-4d54-80f7-9de49a5cb854 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:31.557118 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7b0b8-d942-4d54-80f7-9de49a5cb854 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:31.557394 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7b0b8-d942-4d54-80f7-9de49a5cb854 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.558684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7b0b8-d942-4d54-80f7-9de49a5cb854 None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:31.560341 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7b0b8-d942-4d54-80f7-9de49a5cb854 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:31.562237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 178/350] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:31 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:31.563394 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652dd3-1625-4e40-a5ce-72cd73776ec2 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:31.563759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652dd3-1625-4e40-a5ce-72cd73776ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:31.563950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1652dd3-1625-4e40-a5ce-72cd73776ec2 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.565608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 179/351] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:31.566125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1652dd3-1625-4e40-a5ce-72cd73776ec2 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:31.638583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 173/352] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:31.640916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5928753-09c9-472a-885a-8144692535d3 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:31.708722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1652dd3-1625-4e40-a5ce-72cd73776ec2 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:31.734831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:31.756388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f555f-0ca3-448a-b387-d13002eeaad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:31.757032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f555f-0ca3-448a-b387-d13002eeaad9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:31.757312 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f555f-0ca3-448a-b387-d13002eeaad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:31.757584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f555f-0ca3-448a-b387-d13002eeaad9 None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.763793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5928753-09c9-472a-885a-8144692535d3 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:31.769980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f555f-0ca3-448a-b387-d13002eeaad9 None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:31.771489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f555f-0ca3-448a-b387-d13002eeaad9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:31.773829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 180/353] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:31 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:31.774805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f555f-0ca3-448a-b387-d13002eeaad9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:31.788511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:31.802492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e19727-3a4f-426a-87be-5676b72768de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:31.803112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e19727-3a4f-426a-87be-5676b72768de None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:31.803386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e19727-3a4f-426a-87be-5676b72768de None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:31.803680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e19727-3a4f-426a-87be-5676b72768de None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.805278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e19727-3a4f-426a-87be-5676b72768de None admin] RBAC: Adding query filter params (name=member) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:31.805278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e19727-3a4f-426a-87be-5676b72768de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:31.806017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e19727-3a4f-426a-87be-5676b72768de None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:31.818907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 174/354] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:31.821134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730f575-0640-4fe1-8b7a-b11677aef7e2 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:31.821134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730f575-0640-4fe1-8b7a-b11677aef7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:31.821134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730f575-0640-4fe1-8b7a-b11677aef7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.840970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-2730f575-0640-4fe1-8b7a-b11677aef7e2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:31.842182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2730f575-0640-4fe1-8b7a-b11677aef7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:31.906000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f555f-0ca3-448a-b387-d13002eeaad9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:31.923658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 175/355] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:31.925324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454a2d7-7712-41a0-ad9c-4a59699edf39 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:31.925324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454a2d7-7712-41a0-ad9c-4a59699edf39 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:31.925633 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454a2d7-7712-41a0-ad9c-4a59699edf39 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.927199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 176/356] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:31.927979 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454a2d7-7712-41a0-ad9c-4a59699edf39 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:31.953084 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd41f6-3394-4c5f-806b-2d367f73c736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:31.954049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd41f6-3394-4c5f-806b-2d367f73c736 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:31.954335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd41f6-3394-4c5f-806b-2d367f73c736 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:31.954611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd41f6-3394-4c5f-806b-2d367f73c736 None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:31.956542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd41f6-3394-4c5f-806b-2d367f73c736 None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:31.958173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd41f6-3394-4c5f-806b-2d367f73c736 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:31.962148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 181/357] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:31 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:31.963290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd41f6-3394-4c5f-806b-2d367f73c736 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:32.022046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:32.070394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454a2d7-7712-41a0-ad9c-4a59699edf39 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:32.084031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd41f6-3394-4c5f-806b-2d367f73c736 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:32.086879 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:32.111944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8a76-c351-46cb-bad2-c565e09f6e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:32.113292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8a76-c351-46cb-bad2-c565e09f6e20 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:32.113292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8a76-c351-46cb-bad2-c565e09f6e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:32.113292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d8a76-c351-46cb-bad2-c565e09f6e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:32.113959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d8a76-c351-46cb-bad2-c565e09f6e20 None admin] RBAC: Adding query filter params (group.id=95449fe5cdcf41e79e0179d885d5311b, role.id=2837bb5c87054ea7a046150d413d2561, scope.project.id=e4665e2f75a74d40883dbd9e329b0586) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:32.114269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d8a76-c351-46cb-bad2-c565e09f6e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:32.115889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d8a76-c351-46cb-bad2-c565e09f6e20 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:32.124881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 177/358] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Aug 24 16:56:31 2022] GET /identity/v3/role_assignments?group.id=95449fe5cdcf41e79e0179d885d5311b&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=2837bb5c87054ea7a046150d413d2561 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:32.124881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8a76-c351-46cb-bad2-c565e09f6e20 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:32.150515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a02c5-23fd-43c3-9c11-378cdb171896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:32.151145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a02c5-23fd-43c3-9c11-378cdb171896 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:32.151421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a02c5-23fd-43c3-9c11-378cdb171896 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:32.151690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a02c5-23fd-43c3-9c11-378cdb171896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:32.258162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a02c5-23fd-43c3-9c11-378cdb171896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:32.259652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a02c5-23fd-43c3-9c11-378cdb171896 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:32.291580 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d8a76-c351-46cb-bad2-c565e09f6e20 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:32.333864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:32.338828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2b4fb-39f8-4a8c-ba04-928be1cd1407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:32.339435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2b4fb-39f8-4a8c-ba04-928be1cd1407 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:32.339705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2b4fb-39f8-4a8c-ba04-928be1cd1407 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:32.339975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2b4fb-39f8-4a8c-ba04-928be1cd1407 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:32.352429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2b4fb-39f8-4a8c-ba04-928be1cd1407 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-c9b2b4fb-39f8-4a8c-ba04-928be1cd1407 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:32.358254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:32.359424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:32.360480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 178/359] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:56:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:32.361294 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a209435-5840-4b92-a62b-a0c8e32e94c3 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:32.361294 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a209435-5840-4b92-a62b-a0c8e32e94c3 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:32.361446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a209435-5840-4b92-a62b-a0c8e32e94c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:32.381675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1a209435-5840-4b92-a62b-a0c8e32e94c3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:32.382854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1a209435-5840-4b92-a62b-a0c8e32e94c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:32.413338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 182/360] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:32.414420 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a02c5-23fd-43c3-9c11-378cdb171896 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:32.424419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:32.473908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 179/361] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:32.475616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a209435-5840-4b92-a62b-a0c8e32e94c3 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:32.540127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a02c5-23fd-43c3-9c11-378cdb171896 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:32.580222 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd8783-4303-4203-b9a5-bbd10f7e1f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:32.581229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd8783-4303-4203-b9a5-bbd10f7e1f2d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:32.581716 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd8783-4303-4203-b9a5-bbd10f7e1f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:32.582182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd8783-4303-4203-b9a5-bbd10f7e1f2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:32.583099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd8783-4303-4203-b9a5-bbd10f7e1f2d None admin] RBAC: Adding query filter params (group.id=95449fe5cdcf41e79e0179d885d5311b, role.id=24cce6d670834e3ba65b942574313d0a, scope.project.id=e4665e2f75a74d40883dbd9e329b0586) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:32.583597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd8783-4303-4203-b9a5-bbd10f7e1f2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:32.585272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dd8783-4303-4203-b9a5-bbd10f7e1f2d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:32.587499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a209435-5840-4b92-a62b-a0c8e32e94c3 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:32.592630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 183/362] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Aug 24 16:56:32 2022] GET /identity/v3/role_assignments?group.id=95449fe5cdcf41e79e0179d885d5311b&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=24cce6d670834e3ba65b942574313d0a => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:32.593716 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd8783-4303-4203-b9a5-bbd10f7e1f2d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:32.615044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:32.658546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf25d4-736e-4dd6-a6ff-da2d9100ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:32.659616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf25d4-736e-4dd6-a6ff-da2d9100ad34 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:32.660084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf25d4-736e-4dd6-a6ff-da2d9100ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:32.660564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf25d4-736e-4dd6-a6ff-da2d9100ad34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:32.680693 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf25d4-736e-4dd6-a6ff-da2d9100ad34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-49bf25d4-736e-4dd6-a6ff-da2d9100ad34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:32.688154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:32.689219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:56:32.690038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:32.693078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 180/363] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:32.694239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf25d4-736e-4dd6-a6ff-da2d9100ad34 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:32.735279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:32.802195 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd8783-4303-4203-b9a5-bbd10f7e1f2d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:32.856080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e173-34b6-4494-99d9-b28c9711616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:32.857283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e173-34b6-4494-99d9-b28c9711616a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:32.857558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e173-34b6-4494-99d9-b28c9711616a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:32.857831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1e173-34b6-4494-99d9-b28c9711616a None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:32.858090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf25d4-736e-4dd6-a6ff-da2d9100ad34 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:32.858575 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1e173-34b6-4494-99d9-b28c9711616a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:32.858881 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1e173-34b6-4494-99d9-b28c9711616a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:32.862295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1e173-34b6-4494-99d9-b28c9711616a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:32.871335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 184/364] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:32.872196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e173-34b6-4494-99d9-b28c9711616a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:32.899515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47aaadd-d6bf-48af-976d-086abdd89011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:32.900148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aaadd-d6bf-48af-976d-086abdd89011 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:32.900448 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aaadd-d6bf-48af-976d-086abdd89011 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:32.900716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47aaadd-d6bf-48af-976d-086abdd89011 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:32.901962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47aaadd-d6bf-48af-976d-086abdd89011 None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:32.903859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47aaadd-d6bf-48af-976d-086abdd89011 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:32.905701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 181/365] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:32 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:32.906589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47aaadd-d6bf-48af-976d-086abdd89011 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:32.963334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:32.986744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1e173-34b6-4494-99d9-b28c9711616a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:33.012754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:33.021033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47aaadd-d6bf-48af-976d-086abdd89011 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:33.022735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0899c09-53ac-4f3b-aa86-09bc4a160ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:33.022735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0899c09-53ac-4f3b-aa86-09bc4a160ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:33.022735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0899c09-53ac-4f3b-aa86-09bc4a160ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:33.022967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0899c09-53ac-4f3b-aa86-09bc4a160ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:33.023522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0899c09-53ac-4f3b-aa86-09bc4a160ad1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:33.023836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0899c09-53ac-4f3b-aa86-09bc4a160ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:33.025418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0899c09-53ac-4f3b-aa86-09bc4a160ad1 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:33.034803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 185/366] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:33.035654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0899c09-53ac-4f3b-aa86-09bc4a160ad1 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:33.058304 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7cbcd-457f-4893-bf99-f889f02e1e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:33.059034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7cbcd-457f-4893-bf99-f889f02e1e82 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:33.059556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7cbcd-457f-4893-bf99-f889f02e1e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:33.060463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7cbcd-457f-4893-bf99-f889f02e1e82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:33.073179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7cbcd-457f-4893-bf99-f889f02e1e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-2fc7cbcd-457f-4893-bf99-f889f02e1e82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:33.079108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:33.079980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:33.080803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 182/367] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:56:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:33.082060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7cbcd-457f-4893-bf99-f889f02e1e82 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:33.146949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0899c09-53ac-4f3b-aa86-09bc4a160ad1 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:33.181986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d17b19-b2e8-446b-ace6-f30ba11350b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:33.182626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d17b19-b2e8-446b-ace6-f30ba11350b8 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:33.182914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d17b19-b2e8-446b-ace6-f30ba11350b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:33.183198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d17b19-b2e8-446b-ace6-f30ba11350b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:33.195135 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7cbcd-457f-4893-bf99-f889f02e1e82 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:33.200990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:33.237474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bdc80-4d2d-44a8-9e54-dd7069b54311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:33.238139 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bdc80-4d2d-44a8-9e54-dd7069b54311 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:33.238372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bdc80-4d2d-44a8-9e54-dd7069b54311 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:33.238703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bdc80-4d2d-44a8-9e54-dd7069b54311 None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:33.239843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bdc80-4d2d-44a8-9e54-dd7069b54311 None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:33.241440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bdc80-4d2d-44a8-9e54-dd7069b54311 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:33.243443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 183/368] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:33 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:33.244366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bdc80-4d2d-44a8-9e54-dd7069b54311 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:33.260477 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d17b19-b2e8-446b-ace6-f30ba11350b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:33.261971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d17b19-b2e8-446b-ace6-f30ba11350b8 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:33.271180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:33.366718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bdc80-4d2d-44a8-9e54-dd7069b54311 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:33.401102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 186/369] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:33.402109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d17b19-b2e8-446b-ace6-f30ba11350b8 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:33.413625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6472fb-2ea2-4f2f-a8a2-528cf5b16ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:33.414290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6472fb-2ea2-4f2f-a8a2-528cf5b16ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:33.414573 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6472fb-2ea2-4f2f-a8a2-528cf5b16ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:33.414848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6472fb-2ea2-4f2f-a8a2-528cf5b16ed5 None admin] PATH_INFO: `/v3/users/a93f242d0d5e44afb7dc2f5e7eb39610` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:33.416045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6472fb-2ea2-4f2f-a8a2-528cf5b16ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=a93f242d0d5e44afb7dc2f5e7eb39610)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:33.417521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6472fb-2ea2-4f2f-a8a2-528cf5b16ed5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:33.420009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 184/370] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:56:33 2022] GET /identity/v3/users/a93f242d0d5e44afb7dc2f5e7eb39610 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:33.420898 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6472fb-2ea2-4f2f-a8a2-528cf5b16ed5 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:33.452888 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:33.522997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d17b19-b2e8-446b-ace6-f30ba11350b8 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:33.531551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:33.551536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6472fb-2ea2-4f2f-a8a2-528cf5b16ed5 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:33.561793 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb862597-21c1-4ab8-84b1-94f36bbf8889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:33.562409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb862597-21c1-4ab8-84b1-94f36bbf8889 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:33.562684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb862597-21c1-4ab8-84b1-94f36bbf8889 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:33.562951 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb862597-21c1-4ab8-84b1-94f36bbf8889 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:33.563677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb862597-21c1-4ab8-84b1-94f36bbf8889 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:33.563981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb862597-21c1-4ab8-84b1-94f36bbf8889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:33.565378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb862597-21c1-4ab8-84b1-94f36bbf8889 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:33.576105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 187/371] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:33.577299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb862597-21c1-4ab8-84b1-94f36bbf8889 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:33.591889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8a76-e0e9-42fb-b98a-ac23bddb014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:33.593187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8a76-e0e9-42fb-b98a-ac23bddb014c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:33.593757 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8a76-e0e9-42fb-b98a-ac23bddb014c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:33.594279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8a76-e0e9-42fb-b98a-ac23bddb014c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:33.595295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f8a76-e0e9-42fb-b98a-ac23bddb014c None admin] RBAC: Adding query filter params (group.id=95449fe5cdcf41e79e0179d885d5311b, role.id=24cce6d670834e3ba65b942574313d0a, scope.project.id=d678307757524765a2599dd485cbbb7e) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:33.595803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f8a76-e0e9-42fb-b98a-ac23bddb014c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:33.597599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f8a76-e0e9-42fb-b98a-ac23bddb014c None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:33.605602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 185/372] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Aug 24 16:56:33 2022] GET /identity/v3/role_assignments?group.id=95449fe5cdcf41e79e0179d885d5311b&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=24cce6d670834e3ba65b942574313d0a => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:33.607228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8a76-e0e9-42fb-b98a-ac23bddb014c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:33.698361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb862597-21c1-4ab8-84b1-94f36bbf8889 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:33.699955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:33.758753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8a76-e0e9-42fb-b98a-ac23bddb014c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:33.758944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09902496-728b-45bb-aa64-a59d67c9e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:33.758944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902496-728b-45bb-aa64-a59d67c9e25d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:33.758944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902496-728b-45bb-aa64-a59d67c9e25d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:33.758944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902496-728b-45bb-aa64-a59d67c9e25d None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:33.760786 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09902496-728b-45bb-aa64-a59d67c9e25d None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:33.762424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09902496-728b-45bb-aa64-a59d67c9e25d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:33.765355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 188/373] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:33 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:33.766753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09902496-728b-45bb-aa64-a59d67c9e25d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:33.805461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c848d15-f9a6-49d1-9009-c55c6c9702cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:33.806510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c848d15-f9a6-49d1-9009-c55c6c9702cd None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:33.806968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c848d15-f9a6-49d1-9009-c55c6c9702cd None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:33.808189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c848d15-f9a6-49d1-9009-c55c6c9702cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:33.809246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c848d15-f9a6-49d1-9009-c55c6c9702cd None admin] RBAC: Adding query filter params (role.id=4913cb9f208f4c4892f61e1433923571, user.id=a93f242d0d5e44afb7dc2f5e7eb39610, scope.system=all) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:33.809744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c848d15-f9a6-49d1-9009-c55c6c9702cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:33.811724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c848d15-f9a6-49d1-9009-c55c6c9702cd None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:33.826831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 186/374] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Aug 24 16:56:33 2022] GET /identity/v3/role_assignments?user.id=a93f242d0d5e44afb7dc2f5e7eb39610&scope.system=all&role.id=4913cb9f208f4c4892f61e1433923571 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:33.828083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c848d15-f9a6-49d1-9009-c55c6c9702cd None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:33.863218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:33.964021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09902496-728b-45bb-aa64-a59d67c9e25d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:34.030580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910f30b-ff80-40c4-8add-61e1119c2af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:34.031622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f30b-ff80-40c4-8add-61e1119c2af7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:34.032173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f30b-ff80-40c4-8add-61e1119c2af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:34.032689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f30b-ff80-40c4-8add-61e1119c2af7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:34.066635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c848d15-f9a6-49d1-9009-c55c6c9702cd None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:34.112070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:34.118504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93710a-44a3-43f7-bcc4-b7b45c6f2c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:34.119158 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93710a-44a3-43f7-bcc4-b7b45c6f2c98 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:34.119437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93710a-44a3-43f7-bcc4-b7b45c6f2c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:34.119713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93710a-44a3-43f7-bcc4-b7b45c6f2c98 None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:34.120866 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93710a-44a3-43f7-bcc4-b7b45c6f2c98 None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:34.122858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93710a-44a3-43f7-bcc4-b7b45c6f2c98 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:34.133411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 187/375] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:33 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:34.146506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93710a-44a3-43f7-bcc4-b7b45c6f2c98 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:34.151298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910f30b-ff80-40c4-8add-61e1119c2af7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:34.152831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910f30b-ff80-40c4-8add-61e1119c2af7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:34.264193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 189/376] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:34.264853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:34.269998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910f30b-ff80-40c4-8add-61e1119c2af7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:34.289240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93710a-44a3-43f7-bcc4-b7b45c6f2c98 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:34.346815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3b286-958d-4c06-b83d-cdb3ebb6aff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:34.347439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3b286-958d-4c06-b83d-cdb3ebb6aff2 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:34.347722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3b286-958d-4c06-b83d-cdb3ebb6aff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:34.347999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3b286-958d-4c06-b83d-cdb3ebb6aff2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:34.348758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3b286-958d-4c06-b83d-cdb3ebb6aff2 None admin] RBAC: Adding query filter params (group.id=95449fe5cdcf41e79e0179d885d5311b, role.id=2837bb5c87054ea7a046150d413d2561, scope.project.id=d678307757524765a2599dd485cbbb7e) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:34.349069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3b286-958d-4c06-b83d-cdb3ebb6aff2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:34.350503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3b286-958d-4c06-b83d-cdb3ebb6aff2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:34.352529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:34.361054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 188/377] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Aug 24 16:56:34 2022] GET /identity/v3/role_assignments?group.id=95449fe5cdcf41e79e0179d885d5311b&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=2837bb5c87054ea7a046150d413d2561 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:34.389833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910f30b-ff80-40c4-8add-61e1119c2af7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:34.435047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd423a-c6e1-494f-9baa-6da0ad2e3c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:34.436259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd423a-c6e1-494f-9baa-6da0ad2e3c9c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:34.436768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd423a-c6e1-494f-9baa-6da0ad2e3c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:34.437067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd423a-c6e1-494f-9baa-6da0ad2e3c9c None admin] PATH_INFO: `/v3/projects/79cea13f947a4452b851eb72104e1d0d` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:34.438437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd423a-c6e1-494f-9baa-6da0ad2e3c9c None admin] RBAC: Authorizing `identity:get_project(project_id=79cea13f947a4452b851eb72104e1d0d)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:34.439932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd423a-c6e1-494f-9baa-6da0ad2e3c9c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:34.441892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 190/378] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:34 2022] GET /identity/v3/projects/79cea13f947a4452b851eb72104e1d0d => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:34.452254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3b286-958d-4c06-b83d-cdb3ebb6aff2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:34.576921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3b286-958d-4c06-b83d-cdb3ebb6aff2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:34.626660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225fc14-28d0-412f-9141-4ec185e5bffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:34.627530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225fc14-28d0-412f-9141-4ec185e5bffe None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:34.627804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225fc14-28d0-412f-9141-4ec185e5bffe None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:34.628078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225fc14-28d0-412f-9141-4ec185e5bffe None admin] PATH_INFO: `/v3/groups/280bc7f982084954be5db64eb253fccb` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:34.635171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225fc14-28d0-412f-9141-4ec185e5bffe None admin] RBAC: Authorizing `identity:get_group(group_id=280bc7f982084954be5db64eb253fccb)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:34.636674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225fc14-28d0-412f-9141-4ec185e5bffe None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:34.638958 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 189/379] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:34 2022] GET /identity/v3/groups/280bc7f982084954be5db64eb253fccb => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:34.649553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd423a-c6e1-494f-9baa-6da0ad2e3c9c None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:34.792774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd423a-c6e1-494f-9baa-6da0ad2e3c9c None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:34.836164 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee923ee9-553c-4630-8c3d-d4c55ecc79b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:34.836721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee923ee9-553c-4630-8c3d-d4c55ecc79b3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:34.836995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee923ee9-553c-4630-8c3d-d4c55ecc79b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:34.837259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee923ee9-553c-4630-8c3d-d4c55ecc79b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:34.838319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee923ee9-553c-4630-8c3d-d4c55ecc79b3 None admin] RBAC: Adding query filter params (group.id=280bc7f982084954be5db64eb253fccb, role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=79cea13f947a4452b851eb72104e1d0d) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:34.838623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee923ee9-553c-4630-8c3d-d4c55ecc79b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:34.840109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee923ee9-553c-4630-8c3d-d4c55ecc79b3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:34.846996 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 191/380] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Aug 24 16:56:34 2022] GET /identity/v3/role_assignments?group.id=280bc7f982084954be5db64eb253fccb&scope.project.id=79cea13f947a4452b851eb72104e1d0d&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:34.886224 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadce25-52bc-4e6b-8e9b-3477bd826548 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:34.886557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadce25-52bc-4e6b-8e9b-3477bd826548 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:34.886779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadce25-52bc-4e6b-8e9b-3477bd826548 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:34.888763 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 190/381] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:34.894786 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8fdae-f875-4137-b720-a04a053dc06e None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:34.895087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8fdae-f875-4137-b720-a04a053dc06e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:34.895392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8fdae-f875-4137-b720-a04a053dc06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:34.907137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:34.921567 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-95a8fdae-f875-4137-b720-a04a053dc06e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:34.923150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-95a8fdae-f875-4137-b720-a04a053dc06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:35.025970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 192/382] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:35.046823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56e88-1efd-4081-8aa2-6a8eb9bb3413 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:35.047146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56e88-1efd-4081-8aa2-6a8eb9bb3413 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:35.047369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae56e88-1efd-4081-8aa2-6a8eb9bb3413 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:35.048740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 191/383] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:35.055244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575608a-b50b-4625-8fd2-5099c9d5e2e1 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:35.055527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575608a-b50b-4625-8fd2-5099c9d5e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:35.055799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575608a-b50b-4625-8fd2-5099c9d5e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:35.081208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-2575608a-b50b-4625-8fd2-5099c9d5e2e1 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:35.082496 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2575608a-b50b-4625-8fd2-5099c9d5e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:35.178011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 193/384] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:35.397448 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae56e88-1efd-4081-8aa2-6a8eb9bb3413 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:35.412833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:35.533878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae56e88-1efd-4081-8aa2-6a8eb9bb3413 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:35.578417 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713060f-a1ab-4385-b726-e4d5243bb147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:35.579060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713060f-a1ab-4385-b726-e4d5243bb147 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:35.579338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713060f-a1ab-4385-b726-e4d5243bb147 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:35.579610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713060f-a1ab-4385-b726-e4d5243bb147 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:35.590702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713060f-a1ab-4385-b726-e4d5243bb147 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-3713060f-a1ab-4385-b726-e4d5243bb147 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:35.602454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:35.603366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:35.604137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 192/385] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:56:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:35.610386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575608a-b50b-4625-8fd2-5099c9d5e2e1 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:35.713229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:35.733908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713060f-a1ab-4385-b726-e4d5243bb147 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:35.781300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2575608a-b50b-4625-8fd2-5099c9d5e2e1 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:35.832284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d58ef-5a98-4668-9f61-8b62afcb20c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:35.833357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d58ef-5a98-4668-9f61-8b62afcb20c4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:35.833876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d58ef-5a98-4668-9f61-8b62afcb20c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:35.834351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d58ef-5a98-4668-9f61-8b62afcb20c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:35.835221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d58ef-5a98-4668-9f61-8b62afcb20c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:35.835718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d58ef-5a98-4668-9f61-8b62afcb20c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:35.837553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d58ef-5a98-4668-9f61-8b62afcb20c4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:35.847335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:35.849655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 194/386] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:35.859854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d58ef-5a98-4668-9f61-8b62afcb20c4 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:35.895889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713060f-a1ab-4385-b726-e4d5243bb147 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:35.943616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019a911-e1c1-4dc9-9eb9-f72bc64451c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:35.944260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a911-e1c1-4dc9-9eb9-f72bc64451c8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:35.944543 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a911-e1c1-4dc9-9eb9-f72bc64451c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:35.944815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019a911-e1c1-4dc9-9eb9-f72bc64451c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:35.960822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c019a911-e1c1-4dc9-9eb9-f72bc64451c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-c019a911-e1c1-4dc9-9eb9-f72bc64451c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:35.966976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:35.968181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:35.968996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:35.972621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 193/387] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:56:35.977511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019a911-e1c1-4dc9-9eb9-f72bc64451c8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:35.991188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d58ef-5a98-4668-9f61-8b62afcb20c4 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:36.019992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:36.040437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f019-0360-4eb8-a9f9-474645057d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:36.041895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f019-0360-4eb8-a9f9-474645057d8b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:36.042479 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f019-0360-4eb8-a9f9-474645057d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:36.042946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5f019-0360-4eb8-a9f9-474645057d8b None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:36.046373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5f019-0360-4eb8-a9f9-474645057d8b None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:36.048200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5f019-0360-4eb8-a9f9-474645057d8b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:36.050175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 195/388] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:35 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:36.056468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f019-0360-4eb8-a9f9-474645057d8b None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:36.114749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019a911-e1c1-4dc9-9eb9-f72bc64451c8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:36.185797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:36.190065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5f019-0360-4eb8-a9f9-474645057d8b None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:36.202464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a4111-0831-4549-99a7-52e84be6b56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:36.203087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a4111-0831-4549-99a7-52e84be6b56e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:36.203366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a4111-0831-4549-99a7-52e84be6b56e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:36.203638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a4111-0831-4549-99a7-52e84be6b56e None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:36.204355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a4111-0831-4549-99a7-52e84be6b56e None admin] RBAC: Adding query filter params (name=member) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:36.204654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a4111-0831-4549-99a7-52e84be6b56e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:36.206290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a4111-0831-4549-99a7-52e84be6b56e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:36.222551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 194/389] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:36.223670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a4111-0831-4549-99a7-52e84be6b56e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:36.240086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9056a3d-1c28-445c-b362-7dfeb2524264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:36.241264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9056a3d-1c28-445c-b362-7dfeb2524264 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:36.241744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9056a3d-1c28-445c-b362-7dfeb2524264 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:36.242302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9056a3d-1c28-445c-b362-7dfeb2524264 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:36.245479 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9056a3d-1c28-445c-b362-7dfeb2524264 None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:36.248419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9056a3d-1c28-445c-b362-7dfeb2524264 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:36.251148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 196/390] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:36 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:36.260210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9056a3d-1c28-445c-b362-7dfeb2524264 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:36.368398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a4111-0831-4549-99a7-52e84be6b56e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:36.394500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:36.408969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57beba6-1212-49f8-a1bd-ea88df33f3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:36.409617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57beba6-1212-49f8-a1bd-ea88df33f3bd None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:36.409897 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57beba6-1212-49f8-a1bd-ea88df33f3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:36.410167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57beba6-1212-49f8-a1bd-ea88df33f3bd None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:36.411709 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57beba6-1212-49f8-a1bd-ea88df33f3bd None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:36.413198 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57beba6-1212-49f8-a1bd-ea88df33f3bd None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:36.415089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 195/391] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:36 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:36.421511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57beba6-1212-49f8-a1bd-ea88df33f3bd None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:36.467605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9056a3d-1c28-445c-b362-7dfeb2524264 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:36.496563 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:36.533060 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336691c5-14d2-4a21-bb43-4b57f0f6385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:36.534181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336691c5-14d2-4a21-bb43-4b57f0f6385e None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:36.535896 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336691c5-14d2-4a21-bb43-4b57f0f6385e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:36.536440 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336691c5-14d2-4a21-bb43-4b57f0f6385e None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586/groups/95449fe5cdcf41e79e0179d885d5311b/roles/2837bb5c87054ea7a046150d413d2561` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:36.542191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336691c5-14d2-4a21-bb43-4b57f0f6385e None admin] RBAC: Authorizing `identity:create_grant(project_id=e4665e2f75a74d40883dbd9e329b0586, group_id=95449fe5cdcf41e79e0179d885d5311b, role_id=2837bb5c87054ea7a046150d413d2561)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:36.543976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336691c5-14d2-4a21-bb43-4b57f0f6385e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:36.561360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57beba6-1212-49f8-a1bd-ea88df33f3bd None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:36.598886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a3bbf-ea4c-4531-8d9d-ff27b09a7ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:36.600014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3bbf-ea4c-4531-8d9d-ff27b09a7ede None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:36.600625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3bbf-ea4c-4531-8d9d-ff27b09a7ede None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:36.601098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a3bbf-ea4c-4531-8d9d-ff27b09a7ede None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:36.602544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a3bbf-ea4c-4531-8d9d-ff27b09a7ede None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:36.604195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a3bbf-ea4c-4531-8d9d-ff27b09a7ede None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:36.614078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 197/392] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Aug 24 16:56:36 2022] PUT /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586/groups/95449fe5cdcf41e79e0179d885d5311b/roles/2837bb5c87054ea7a046150d413d2561 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:36.614581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 196/393] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:36 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:36.617750 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336691c5-14d2-4a21-bb43-4b57f0f6385e None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:36.758653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336691c5-14d2-4a21-bb43-4b57f0f6385e None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:36.773075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178671-8f7d-4f1f-ad9b-77c76d11d305 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:36.774136 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178671-8f7d-4f1f-ad9b-77c76d11d305 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:36.774612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18178671-8f7d-4f1f-ad9b-77c76d11d305 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:36.776785 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 197/394] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:36.785648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0fb13-555e-4d93-96fd-565fb1ef33fa None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:36.786295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0fb13-555e-4d93-96fd-565fb1ef33fa None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:36.786769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0fb13-555e-4d93-96fd-565fb1ef33fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:36.792833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:36.808772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe2909-d166-46e1-97a1-1c8d63c6642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:36.809527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe2909-d166-46e1-97a1-1c8d63c6642d None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:36.809850 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe2909-d166-46e1-97a1-1c8d63c6642d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:36.810127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe2909-d166-46e1-97a1-1c8d63c6642d None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586/groups/95449fe5cdcf41e79e0179d885d5311b/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:36.816213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe2909-d166-46e1-97a1-1c8d63c6642d None admin] RBAC: Authorizing `identity:create_grant(project_id=e4665e2f75a74d40883dbd9e329b0586, group_id=95449fe5cdcf41e79e0179d885d5311b, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:36.816213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe2909-d166-46e1-97a1-1c8d63c6642d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:36.829415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-86b0fb13-555e-4d93-96fd-565fb1ef33fa None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:36.830735 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-86b0fb13-555e-4d93-96fd-565fb1ef33fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:36.893104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 198/395] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Aug 24 16:56:36 2022] PUT /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586/groups/95449fe5cdcf41e79e0179d885d5311b/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:36.921873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 198/396] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:37.205650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe2909-d166-46e1-97a1-1c8d63c6642d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:37.310287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadaa5f-0cc0-4bf7-bf6a-f9b5899eb512 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:37.313703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadaa5f-0cc0-4bf7-bf6a-f9b5899eb512 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:37.313703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fadaa5f-0cc0-4bf7-bf6a-f9b5899eb512 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:37.314837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 199/397] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:37.321366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417c061-8b80-4c49-91da-f59c2dafb103 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:37.321744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417c061-8b80-4c49-91da-f59c2dafb103 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:37.322214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417c061-8b80-4c49-91da-f59c2dafb103 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:37.323851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 200/398] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:56:37.329581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277643fd-74b1-4c97-8819-5b668726b25f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:37.329857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277643fd-74b1-4c97-8819-5b668726b25f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:37.330204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277643fd-74b1-4c97-8819-5b668726b25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:37.349750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-277643fd-74b1-4c97-8819-5b668726b25f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:37.350963 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-277643fd-74b1-4c97-8819-5b668726b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:37.355741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe2909-d166-46e1-97a1-1c8d63c6642d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:37.401086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819e20f-5f38-4688-824b-0aa677819d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:37.402470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e20f-5f38-4688-824b-0aa677819d10 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:37.403007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e20f-5f38-4688-824b-0aa677819d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:37.403980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819e20f-5f38-4688-824b-0aa677819d10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:37.409914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:37.418168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819e20f-5f38-4688-824b-0aa677819d10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-1819e20f-5f38-4688-824b-0aa677819d10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:37.427112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:37.428200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:37.429224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:37.430859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 199/399] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:37.432348 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e99ca-e540-4424-87fe-e920bfe51bd8 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:37.432770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e99ca-e540-4424-87fe-e920bfe51bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:37.433215 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e99ca-e540-4424-87fe-e920bfe51bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:37.444744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 201/400] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:37.447144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277643fd-74b1-4c97-8819-5b668726b25f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:37.459577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-cd8e99ca-e540-4424-87fe-e920bfe51bd8 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:37.461223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-cd8e99ca-e540-4424-87fe-e920bfe51bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:37.500941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:37.538702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 200/401] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:37.623208 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277643fd-74b1-4c97-8819-5b668726b25f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:37.673220 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c131-89c2-4674-a39d-cfb27436592e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:37.673830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c131-89c2-4674-a39d-cfb27436592e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:37.674110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c131-89c2-4674-a39d-cfb27436592e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:37.674385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52c131-89c2-4674-a39d-cfb27436592e None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:37.675050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c131-89c2-4674-a39d-cfb27436592e None admin] RBAC: Adding query filter params (name=member) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:37.675352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c131-89c2-4674-a39d-cfb27436592e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:37.676754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f52c131-89c2-4674-a39d-cfb27436592e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:37.688348 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 202/402] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:37.693546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e99ca-e540-4424-87fe-e920bfe51bd8 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:37.831407 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c131-89c2-4674-a39d-cfb27436592e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:37.861819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e99ca-e540-4424-87fe-e920bfe51bd8 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:37.898885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:37.926173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2065-b98d-461e-9f0c-1c2d5d8de0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:37.926815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2065-b98d-461e-9f0c-1c2d5d8de0ca None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:37.927094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2065-b98d-461e-9f0c-1c2d5d8de0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:37.927368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2065-b98d-461e-9f0c-1c2d5d8de0ca None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:37.928927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac2065-b98d-461e-9f0c-1c2d5d8de0ca None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:37.930746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac2065-b98d-461e-9f0c-1c2d5d8de0ca None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:37.933318 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 201/403] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:37 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:37.934335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2065-b98d-461e-9f0c-1c2d5d8de0ca None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:37.958371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52c131-89c2-4674-a39d-cfb27436592e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:37.984850 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:38.004176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae0cbf-b35a-411e-908e-7578294f664b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:38.004832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae0cbf-b35a-411e-908e-7578294f664b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:38.005112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae0cbf-b35a-411e-908e-7578294f664b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:38.005385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae0cbf-b35a-411e-908e-7578294f664b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:38.018471 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae0cbf-b35a-411e-908e-7578294f664b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-46ae0cbf-b35a-411e-908e-7578294f664b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:38.023423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:38.024554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:38.025482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:38.026137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 203/404] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:56:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:38.031475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae0cbf-b35a-411e-908e-7578294f664b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:38.065646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2065-b98d-461e-9f0c-1c2d5d8de0ca None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:38.103762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a74552-5629-40a4-aaaa-eb118db25532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:38.104730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a74552-5629-40a4-aaaa-eb118db25532 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:38.105185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a74552-5629-40a4-aaaa-eb118db25532 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:38.105626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a74552-5629-40a4-aaaa-eb118db25532 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:38.117956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a74552-5629-40a4-aaaa-eb118db25532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-25a74552-5629-40a4-aaaa-eb118db25532 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:38.124018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:38.124946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:38.125805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:38.128507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 202/405] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:56:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:38.129641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a74552-5629-40a4-aaaa-eb118db25532 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:38.149905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae0cbf-b35a-411e-908e-7578294f664b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:38.172697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:38.188964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6014dcd-1b0e-4e28-9d5c-aa78a815e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:38.189641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6014dcd-1b0e-4e28-9d5c-aa78a815e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:38.189918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6014dcd-1b0e-4e28-9d5c-aa78a815e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:38.190194 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6014dcd-1b0e-4e28-9d5c-aa78a815e5b9 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:38.191859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6014dcd-1b0e-4e28-9d5c-aa78a815e5b9 None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:38.193026 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6014dcd-1b0e-4e28-9d5c-aa78a815e5b9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:38.195215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 204/406] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:38 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:38.196139 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6014dcd-1b0e-4e28-9d5c-aa78a815e5b9 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:38.241649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:38.246694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a74552-5629-40a4-aaaa-eb118db25532 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:38.284569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcc1d7-1da1-4ce2-b078-fed7b06ce671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:38.285552 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcc1d7-1da1-4ce2-b078-fed7b06ce671 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:38.286029 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcc1d7-1da1-4ce2-b078-fed7b06ce671 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:38.286498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcc1d7-1da1-4ce2-b078-fed7b06ce671 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:38.287390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcc1d7-1da1-4ce2-b078-fed7b06ce671 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:38.288072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcc1d7-1da1-4ce2-b078-fed7b06ce671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:38.289680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcc1d7-1da1-4ce2-b078-fed7b06ce671 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:38.300880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 203/407] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:38.302072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcc1d7-1da1-4ce2-b078-fed7b06ce671 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:38.305012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6014dcd-1b0e-4e28-9d5c-aa78a815e5b9 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:38.345129 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4156b0-bfec-47c0-9504-14f8601adbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:38.345759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4156b0-bfec-47c0-9504-14f8601adbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:38.346079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4156b0-bfec-47c0-9504-14f8601adbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:38.346355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4156b0-bfec-47c0-9504-14f8601adbc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:38.347131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4156b0-bfec-47c0-9504-14f8601adbc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:38.347439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4156b0-bfec-47c0-9504-14f8601adbc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:38.348842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4156b0-bfec-47c0-9504-14f8601adbc0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:38.358136 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 205/408] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:38.358931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4156b0-bfec-47c0-9504-14f8601adbc0 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:38.408622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:38.414653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcc1d7-1da1-4ce2-b078-fed7b06ce671 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:38.452895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684504a-4e30-42bd-9d72-e89113396ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:38.453948 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684504a-4e30-42bd-9d72-e89113396ef3 None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:38.454462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684504a-4e30-42bd-9d72-e89113396ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:38.454927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684504a-4e30-42bd-9d72-e89113396ef3 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e/groups/95449fe5cdcf41e79e0179d885d5311b/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:38.457201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684504a-4e30-42bd-9d72-e89113396ef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d678307757524765a2599dd485cbbb7e, group_id=95449fe5cdcf41e79e0179d885d5311b, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:38.458879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8684504a-4e30-42bd-9d72-e89113396ef3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:38.468122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4156b0-bfec-47c0-9504-14f8601adbc0 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:38.507658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fecc49-be71-48a9-a211-e0dabf020141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:38.508494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fecc49-be71-48a9-a211-e0dabf020141 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:38.508776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fecc49-be71-48a9-a211-e0dabf020141 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:38.509056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fecc49-be71-48a9-a211-e0dabf020141 None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:38.510236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fecc49-be71-48a9-a211-e0dabf020141 None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:38.511653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fecc49-be71-48a9-a211-e0dabf020141 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:38.518458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 206/409] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:38 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:38.518458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fecc49-be71-48a9-a211-e0dabf020141 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:38.556096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 204/410] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Aug 24 16:56:38 2022] PUT /identity/v3/projects/d678307757524765a2599dd485cbbb7e/groups/95449fe5cdcf41e79e0179d885d5311b/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:38.557621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684504a-4e30-42bd-9d72-e89113396ef3 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:38.587046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:38.634037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fecc49-be71-48a9-a211-e0dabf020141 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:38.642559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:38.673148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f78e7-6421-491a-8dcb-f113c6fe9a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:38.673840 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f78e7-6421-491a-8dcb-f113c6fe9a52 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:38.674148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f78e7-6421-491a-8dcb-f113c6fe9a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:38.674391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f78e7-6421-491a-8dcb-f113c6fe9a52 None admin] PATH_INFO: `/v3/groups/280bc7f982084954be5db64eb253fccb` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:38.675738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f78e7-6421-491a-8dcb-f113c6fe9a52 None admin] RBAC: Authorizing `identity:get_group(group_id=280bc7f982084954be5db64eb253fccb)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:38.677346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f78e7-6421-491a-8dcb-f113c6fe9a52 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:38.683295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 207/411] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:38 2022] GET /identity/v3/groups/280bc7f982084954be5db64eb253fccb => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:38.685441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f78e7-6421-491a-8dcb-f113c6fe9a52 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:38.688586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684504a-4e30-42bd-9d72-e89113396ef3 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:38.729788 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267eab7-5649-492f-a5ae-24e327f06757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:38.730820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267eab7-5649-492f-a5ae-24e327f06757 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:38.731304 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267eab7-5649-492f-a5ae-24e327f06757 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:38.733260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267eab7-5649-492f-a5ae-24e327f06757 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:38.734691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267eab7-5649-492f-a5ae-24e327f06757 None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:38.736515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e267eab7-5649-492f-a5ae-24e327f06757 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:38.738836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 205/412] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:38 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:38.745080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267eab7-5649-492f-a5ae-24e327f06757 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:38.802389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f78e7-6421-491a-8dcb-f113c6fe9a52 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:38.854674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecc69c-35ef-45bb-9822-1e45e092e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:38.855444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc69c-35ef-45bb-9822-1e45e092e015 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:38.855658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc69c-35ef-45bb-9822-1e45e092e015 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:38.855931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc69c-35ef-45bb-9822-1e45e092e015 None admin] PATH_INFO: `/v3/projects/79cea13f947a4452b851eb72104e1d0d` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:38.857720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecc69c-35ef-45bb-9822-1e45e092e015 None admin] RBAC: Authorizing `identity:get_project(project_id=79cea13f947a4452b851eb72104e1d0d)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:38.859404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecc69c-35ef-45bb-9822-1e45e092e015 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:38.863006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:38.864913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 208/413] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:38 2022] GET /identity/v3/projects/79cea13f947a4452b851eb72104e1d0d => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:38.867243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecc69c-35ef-45bb-9822-1e45e092e015 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:38.881013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267eab7-5649-492f-a5ae-24e327f06757 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:38.916791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:38.930506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ce16f1-54e5-4679-b532-4ae18bde9a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:38.932119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce16f1-54e5-4679-b532-4ae18bde9a11 None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:38.932947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce16f1-54e5-4679-b532-4ae18bde9a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:38.933451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ce16f1-54e5-4679-b532-4ae18bde9a11 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e/groups/95449fe5cdcf41e79e0179d885d5311b/roles/2837bb5c87054ea7a046150d413d2561` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:38.938191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce16f1-54e5-4679-b532-4ae18bde9a11 None admin] RBAC: Authorizing `identity:create_grant(project_id=d678307757524765a2599dd485cbbb7e, group_id=95449fe5cdcf41e79e0179d885d5311b, role_id=2837bb5c87054ea7a046150d413d2561)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:38.941149 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ce16f1-54e5-4679-b532-4ae18bde9a11 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:38.985014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecc69c-35ef-45bb-9822-1e45e092e015 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:39.008751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 206/414] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Aug 24 16:56:38 2022] PUT /identity/v3/projects/d678307757524765a2599dd485cbbb7e/groups/95449fe5cdcf41e79e0179d885d5311b/roles/2837bb5c87054ea7a046150d413d2561 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:39.025014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071fb4c-f377-4796-b150-6149c8292ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:39.025683 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071fb4c-f377-4796-b150-6149c8292ec8 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:39.026035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071fb4c-f377-4796-b150-6149c8292ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:39.026377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071fb4c-f377-4796-b150-6149c8292ec8 None admin] PATH_INFO: `/v3/projects/79cea13f947a4452b851eb72104e1d0d/groups/280bc7f982084954be5db64eb253fccb/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:39.029180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071fb4c-f377-4796-b150-6149c8292ec8 None admin] RBAC: Authorizing `identity:create_grant(project_id=79cea13f947a4452b851eb72104e1d0d, group_id=280bc7f982084954be5db64eb253fccb, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:39.030883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1071fb4c-f377-4796-b150-6149c8292ec8 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:39.105577 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 209/415] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Aug 24 16:56:38 2022] PUT /identity/v3/projects/79cea13f947a4452b851eb72104e1d0d/groups/280bc7f982084954be5db64eb253fccb/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:56:39.177463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb83a88-a6e9-4698-8b21-72a434d43257 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:39.178101 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb83a88-a6e9-4698-8b21-72a434d43257 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:39.178579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb83a88-a6e9-4698-8b21-72a434d43257 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:39.180614 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 207/416] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:39.186802 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df26e-8830-4f46-a9d6-5bcd3f0e8ad2 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:39.186999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa79c-d7d4-4a11-8ae1-b87010581588 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:39.187119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df26e-8830-4f46-a9d6-5bcd3f0e8ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:39.187353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df26e-8830-4f46-a9d6-5bcd3f0e8ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:39.187445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa79c-d7d4-4a11-8ae1-b87010581588 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:39.187829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa79c-d7d4-4a11-8ae1-b87010581588 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:39.189702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 208/417] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:39.196245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065dbb-d250-4a16-a7e5-018e23941028 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:39.196678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065dbb-d250-4a16-a7e5-018e23941028 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:39.197056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48065dbb-d250-4a16-a7e5-018e23941028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:39.213832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ac7df26e-8830-4f46-a9d6-5bcd3f0e8ad2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:39.215080 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ac7df26e-8830-4f46-a9d6-5bcd3f0e8ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:39.218498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-48065dbb-d250-4a16-a7e5-018e23941028 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:39.219922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-48065dbb-d250-4a16-a7e5-018e23941028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:39.302403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 210/418] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:39.326799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 209/419] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:39.588203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df26e-8830-4f46-a9d6-5bcd3f0e8ad2 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:39.624830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:39.693831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48065dbb-d250-4a16-a7e5-018e23941028 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:39.721986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df26e-8830-4f46-a9d6-5bcd3f0e8ad2 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:39.793274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e91de-02c7-46e1-89ab-f2b88d9db8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:39.794433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e91de-02c7-46e1-89ab-f2b88d9db8bb None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:39.794719 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e91de-02c7-46e1-89ab-f2b88d9db8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:39.794992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e91de-02c7-46e1-89ab-f2b88d9db8bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:39.814869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e91de-02c7-46e1-89ab-f2b88d9db8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-069e91de-02c7-46e1-89ab-f2b88d9db8bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:39.819772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:39.820713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:39.821489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 211/420] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:39.826881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e91de-02c7-46e1-89ab-f2b88d9db8bb None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:39.864594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:39.906819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48065dbb-d250-4a16-a7e5-018e23941028 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:39.978678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac2752-85a7-4e0a-8382-ad0a7e866610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:39.979824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac2752-85a7-4e0a-8382-ad0a7e866610 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:39.981020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac2752-85a7-4e0a-8382-ad0a7e866610 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:39.983208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac2752-85a7-4e0a-8382-ad0a7e866610 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:40.006722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac2752-85a7-4e0a-8382-ad0a7e866610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:40.007573 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-16ac2752-85a7-4e0a-8382-ad0a7e866610 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:40.016529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:40.019815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:40.020640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:40.026884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 210/421] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:56:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:40.027548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e91de-02c7-46e1-89ab-f2b88d9db8bb None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:40.029864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac2752-85a7-4e0a-8382-ad0a7e866610 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:40.101044 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af278281-9cff-4dd9-b173-5634c377fc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:40.101581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af278281-9cff-4dd9-b173-5634c377fc96 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:40.101863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af278281-9cff-4dd9-b173-5634c377fc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:40.102138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af278281-9cff-4dd9-b173-5634c377fc96 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:40.102813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af278281-9cff-4dd9-b173-5634c377fc96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:40.103112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af278281-9cff-4dd9-b173-5634c377fc96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:40.104511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af278281-9cff-4dd9-b173-5634c377fc96 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:40.127723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 212/422] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:40.134759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af278281-9cff-4dd9-b173-5634c377fc96 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:40.187536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac2752-85a7-4e0a-8382-ad0a7e866610 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:40.251605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087a553-c1d2-48fc-8b5a-b2b584cf28a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:40.253442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087a553-c1d2-48fc-8b5a-b2b584cf28a2 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:40.255255 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087a553-c1d2-48fc-8b5a-b2b584cf28a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:40.255742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087a553-c1d2-48fc-8b5a-b2b584cf28a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:40.256654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087a553-c1d2-48fc-8b5a-b2b584cf28a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:40.257378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087a553-c1d2-48fc-8b5a-b2b584cf28a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:40.260039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087a553-c1d2-48fc-8b5a-b2b584cf28a2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:40.274901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:40.278921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 211/423] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:40.288342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087a553-c1d2-48fc-8b5a-b2b584cf28a2 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:40.360330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af278281-9cff-4dd9-b173-5634c377fc96 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:40.404105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278a65-c38e-4c6d-8e5f-7ce40a7bfb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:40.404663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278a65-c38e-4c6d-8e5f-7ce40a7bfb13 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:40.404942 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278a65-c38e-4c6d-8e5f-7ce40a7bfb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:40.405217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9278a65-c38e-4c6d-8e5f-7ce40a7bfb13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:40.467070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:40.498207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087a553-c1d2-48fc-8b5a-b2b584cf28a2 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:40.535275 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987d6ee-3e84-4571-9844-50fd9ea9935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:40.536282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987d6ee-3e84-4571-9844-50fd9ea9935e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:40.536761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987d6ee-3e84-4571-9844-50fd9ea9935e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:40.537247 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987d6ee-3e84-4571-9844-50fd9ea9935e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:40.566628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278a65-c38e-4c6d-8e5f-7ce40a7bfb13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:40.568431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9278a65-c38e-4c6d-8e5f-7ce40a7bfb13 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:40.702062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:40.708268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 213/424] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:56:40.709003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987d6ee-3e84-4571-9844-50fd9ea9935e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:40.710471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1987d6ee-3e84-4571-9844-50fd9ea9935e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:40.721428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278a65-c38e-4c6d-8e5f-7ce40a7bfb13 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:40.797992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:40.875796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9278a65-c38e-4c6d-8e5f-7ce40a7bfb13 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:40.886431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 212/425] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:40.894651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987d6ee-3e84-4571-9844-50fd9ea9935e None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:40.946154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18298b5e-7c4a-4ad8-8e3c-d8eb6019da02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:40.946798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18298b5e-7c4a-4ad8-8e3c-d8eb6019da02 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:40.947079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18298b5e-7c4a-4ad8-8e3c-d8eb6019da02 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:40.947353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18298b5e-7c4a-4ad8-8e3c-d8eb6019da02 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:40.948537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18298b5e-7c4a-4ad8-8e3c-d8eb6019da02 None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:40.950611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18298b5e-7c4a-4ad8-8e3c-d8eb6019da02 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:40.952742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 214/426] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:40 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:40.953861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71660132-e331-4d69-8147-b7d66c252fe7 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:40.954146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71660132-e331-4d69-8147-b7d66c252fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:40.954421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71660132-e331-4d69-8147-b7d66c252fe7 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:40.955857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 215/427] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:40.964994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71660132-e331-4d69-8147-b7d66c252fe7 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:41.018057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:41.020798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1987d6ee-3e84-4571-9844-50fd9ea9935e None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:41.055203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce825b5-43e9-48fd-a309-6a4e51a05ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:41.055918 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce825b5-43e9-48fd-a309-6a4e51a05ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.056284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce825b5-43e9-48fd-a309-6a4e51a05ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.056626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce825b5-43e9-48fd-a309-6a4e51a05ff4 None admin] PATH_INFO: `/v3/projects/e4665e2f75a74d40883dbd9e329b0586` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.058020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce825b5-43e9-48fd-a309-6a4e51a05ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=e4665e2f75a74d40883dbd9e329b0586)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:41.060129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce825b5-43e9-48fd-a309-6a4e51a05ff4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:41.066758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 213/428] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:40 2022] GET /identity/v3/projects/e4665e2f75a74d40883dbd9e329b0586 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:41.068209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b282-b150-48c3-94d5-1efea69d2ffc None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.068575 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b282-b150-48c3-94d5-1efea69d2ffc None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.069220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402b282-b150-48c3-94d5-1efea69d2ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.080395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71660132-e331-4d69-8147-b7d66c252fe7 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:41.089070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-f402b282-b150-48c3-94d5-1efea69d2ffc None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:41.090334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f402b282-b150-48c3-94d5-1efea69d2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:41.107165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:41.120748 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546dd69-2a3b-410b-9209-ee1bd90cd6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:41.121695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546dd69-2a3b-410b-9209-ee1bd90cd6ed None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.122822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546dd69-2a3b-410b-9209-ee1bd90cd6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.123433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546dd69-2a3b-410b-9209-ee1bd90cd6ed None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.125186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546dd69-2a3b-410b-9209-ee1bd90cd6ed None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:41.126852 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546dd69-2a3b-410b-9209-ee1bd90cd6ed None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:41.133823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 216/429] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:40 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:41.134918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546dd69-2a3b-410b-9209-ee1bd90cd6ed None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:41.161177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 214/430] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:41.162023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402b282-b150-48c3-94d5-1efea69d2ffc None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:41.249437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546dd69-2a3b-410b-9209-ee1bd90cd6ed None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:41.273549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:41.277834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402b282-b150-48c3-94d5-1efea69d2ffc None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:41.298832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70a19b-9629-4b60-9039-5d40bcecd496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:41.299757 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70a19b-9629-4b60-9039-5d40bcecd496 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.300250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70a19b-9629-4b60-9039-5d40bcecd496 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.300711 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70a19b-9629-4b60-9039-5d40bcecd496 None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.302040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70a19b-9629-4b60-9039-5d40bcecd496 None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:41.303664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70a19b-9629-4b60-9039-5d40bcecd496 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:41.311295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 217/431] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:41 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:41.312819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2aa0a-ec8e-42de-8cff-33ea0f0e906c None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.313289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2aa0a-ec8e-42de-8cff-33ea0f0e906c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.313764 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2aa0a-ec8e-42de-8cff-33ea0f0e906c None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.315431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 218/432] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:41.316387 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2aa0a-ec8e-42de-8cff-33ea0f0e906c None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:41.324168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79523574-82cc-4187-8a3c-d88b05c37434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:41.324814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79523574-82cc-4187-8a3c-d88b05c37434 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.325175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79523574-82cc-4187-8a3c-d88b05c37434 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.325454 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79523574-82cc-4187-8a3c-d88b05c37434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.326313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79523574-82cc-4187-8a3c-d88b05c37434 None admin] RBAC: Adding query filter params (group.id=95449fe5cdcf41e79e0179d885d5311b, role.id=24cce6d670834e3ba65b942574313d0a, scope.project.id=e4665e2f75a74d40883dbd9e329b0586) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:41.326627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79523574-82cc-4187-8a3c-d88b05c37434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:41.328573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79523574-82cc-4187-8a3c-d88b05c37434 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:41.336981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 215/433] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Aug 24 16:56:41 2022] GET /identity/v3/role_assignments?group.id=95449fe5cdcf41e79e0179d885d5311b&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=24cce6d670834e3ba65b942574313d0a => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:41.340909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9c10b-ee78-458c-b001-967870f61d46 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.341513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9c10b-ee78-458c-b001-967870f61d46 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.341983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9c10b-ee78-458c-b001-967870f61d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.380779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-48c9c10b-ee78-458c-b001-967870f61d46 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:41.383205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-48c9c10b-ee78-458c-b001-967870f61d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:41.429361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:41.499871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 216/434] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:41.500538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9c10b-ee78-458c-b001-967870f61d46 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:41.516979 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2aa0a-ec8e-42de-8cff-33ea0f0e906c None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:41.567185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f77d3-baa9-4009-bce4-ab390432732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:41.567797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f77d3-baa9-4009-bce4-ab390432732a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.568080 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f77d3-baa9-4009-bce4-ab390432732a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.568393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f77d3-baa9-4009-bce4-ab390432732a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.569133 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f77d3-baa9-4009-bce4-ab390432732a None admin] RBAC: Adding query filter params (group.id=95449fe5cdcf41e79e0179d885d5311b, role.id=2837bb5c87054ea7a046150d413d2561, scope.project.id=e4665e2f75a74d40883dbd9e329b0586) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:41.569445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f77d3-baa9-4009-bce4-ab390432732a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:41.571621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f77d3-baa9-4009-bce4-ab390432732a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:41.583689 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 219/435] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Aug 24 16:56:41 2022] GET /identity/v3/role_assignments?group.id=95449fe5cdcf41e79e0179d885d5311b&scope.project.id=e4665e2f75a74d40883dbd9e329b0586&role.id=2837bb5c87054ea7a046150d413d2561 => generated 611 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:41.608475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258886c5-8fd2-46b4-b817-46d596360b46 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.608792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258886c5-8fd2-46b4-b817-46d596360b46 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.609149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258886c5-8fd2-46b4-b817-46d596360b46 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.610616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 220/436] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:41.617953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:41.618329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4236fb1-7484-40ec-bc9d-6bd17f3c7e1b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.619544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4236fb1-7484-40ec-bc9d-6bd17f3c7e1b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.620105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4236fb1-7484-40ec-bc9d-6bd17f3c7e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.627955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9c10b-ee78-458c-b001-967870f61d46 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:41.644731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a4236fb1-7484-40ec-bc9d-6bd17f3c7e1b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:41.646938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a4236fb1-7484-40ec-bc9d-6bd17f3c7e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:41.674719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b885-075e-4ac0-bf37-b50721ac911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:41.675745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b885-075e-4ac0-bf37-b50721ac911a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.676258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b885-075e-4ac0-bf37-b50721ac911a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.676682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4b885-075e-4ac0-bf37-b50721ac911a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.692959 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4b885-075e-4ac0-bf37-b50721ac911a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-5ac4b885-075e-4ac0-bf37-b50721ac911a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:41.699061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:41.700593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:41.701393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 217/437] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:41.710126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b885-075e-4ac0-bf37-b50721ac911a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:41.756870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 221/438] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:41.836302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4b885-075e-4ac0-bf37-b50721ac911a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:41.856874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4236fb1-7484-40ec-bc9d-6bd17f3c7e1b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:41.878903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ead8-3e2b-431f-89ef-aa5238d3a034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:41.881745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ead8-3e2b-431f-89ef-aa5238d3a034 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:41.881745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ead8-3e2b-431f-89ef-aa5238d3a034 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:41.881745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524ead8-3e2b-431f-89ef-aa5238d3a034 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:41.881745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ead8-3e2b-431f-89ef-aa5238d3a034 None admin] RBAC: Adding query filter params (name=member) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:41.882225 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ead8-3e2b-431f-89ef-aa5238d3a034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:41.883939 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524ead8-3e2b-431f-89ef-aa5238d3a034 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:41.897303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 218/439] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:56:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:41.905324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ead8-3e2b-431f-89ef-aa5238d3a034 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:41.926717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:41.930896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:41.996056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4236fb1-7484-40ec-bc9d-6bd17f3c7e1b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:42.038822 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524ead8-3e2b-431f-89ef-aa5238d3a034 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:42.044137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556a729-6242-45c3-ae16-ea618140eff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:42.044821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556a729-6242-45c3-ae16-ea618140eff4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:42.045127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556a729-6242-45c3-ae16-ea618140eff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:42.045406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556a729-6242-45c3-ae16-ea618140eff4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:42.057059 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556a729-6242-45c3-ae16-ea618140eff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-6556a729-6242-45c3-ae16-ea618140eff4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:42.062656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:42.063544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:42.064365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:42.065982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 222/440] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:56:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:56:42.065982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556a729-6242-45c3-ae16-ea618140eff4 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:42.081858 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21abd71-a2fd-445a-8a81-069933107b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:42.082483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21abd71-a2fd-445a-8a81-069933107b00 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:42.082769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21abd71-a2fd-445a-8a81-069933107b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:42.083039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21abd71-a2fd-445a-8a81-069933107b00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:42.174531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21abd71-a2fd-445a-8a81-069933107b00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:42.176150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21abd71-a2fd-445a-8a81-069933107b00 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:42.195268 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:42.198647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556a729-6242-45c3-ae16-ea618140eff4 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:42.214190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:42.235944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee227a-681b-4d8a-99bb-a393132d5885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:42.236667 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee227a-681b-4d8a-99bb-a393132d5885 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:42.236947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee227a-681b-4d8a-99bb-a393132d5885 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:42.237222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee227a-681b-4d8a-99bb-a393132d5885 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:42.248488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee227a-681b-4d8a-99bb-a393132d5885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-8aee227a-681b-4d8a-99bb-a393132d5885 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:42.253376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:42.254277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:42.255084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 223/441] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:56:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:42.255751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee227a-681b-4d8a-99bb-a393132d5885 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:42.293798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 219/442] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:42.293798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21abd71-a2fd-445a-8a81-069933107b00 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:42.368641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee227a-681b-4d8a-99bb-a393132d5885 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:42.391095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21abd71-a2fd-445a-8a81-069933107b00 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:42.402914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb1377-1d35-4e10-bf36-30e77789df0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:42.403788 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1377-1d35-4e10-bf36-30e77789df0e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:42.404062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1377-1d35-4e10-bf36-30e77789df0e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:42.404366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb1377-1d35-4e10-bf36-30e77789df0e None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:42.405036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb1377-1d35-4e10-bf36-30e77789df0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:42.405521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb1377-1d35-4e10-bf36-30e77789df0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:42.405625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:42.407094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cb1377-1d35-4e10-bf36-30e77789df0e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:42.419480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 224/443] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:42.419480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb1377-1d35-4e10-bf36-30e77789df0e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:42.430224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070036b-c2c3-4abe-936a-7e5144030e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:42.430224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070036b-c2c3-4abe-936a-7e5144030e32 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:42.430224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070036b-c2c3-4abe-936a-7e5144030e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:42.430224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070036b-c2c3-4abe-936a-7e5144030e32 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:42.430550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070036b-c2c3-4abe-936a-7e5144030e32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:42.430550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070036b-c2c3-4abe-936a-7e5144030e32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:42.430550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070036b-c2c3-4abe-936a-7e5144030e32 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:42.438512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 220/444] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:42.439314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070036b-c2c3-4abe-936a-7e5144030e32 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:42.451786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:42.518691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb1377-1d35-4e10-bf36-30e77789df0e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:42.543160 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070036b-c2c3-4abe-936a-7e5144030e32 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:42.553892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491734dc-397d-47e8-a26d-b5a89672b5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:42.554453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491734dc-397d-47e8-a26d-b5a89672b5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:42.554752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491734dc-397d-47e8-a26d-b5a89672b5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:42.555027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491734dc-397d-47e8-a26d-b5a89672b5f8 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:42.556176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491734dc-397d-47e8-a26d-b5a89672b5f8 None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:42.557658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491734dc-397d-47e8-a26d-b5a89672b5f8 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:42.562771 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 225/445] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:42 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:42.562771 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491734dc-397d-47e8-a26d-b5a89672b5f8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:42.581522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd2097-2dd1-41b0-bb6b-1d4ed7d6d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:42.582136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd2097-2dd1-41b0-bb6b-1d4ed7d6d941 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:42.582439 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd2097-2dd1-41b0-bb6b-1d4ed7d6d941 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:42.582705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd2097-2dd1-41b0-bb6b-1d4ed7d6d941 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:42.629049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:42.652102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd2097-2dd1-41b0-bb6b-1d4ed7d6d941 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:42.653643 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd2097-2dd1-41b0-bb6b-1d4ed7d6d941 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:42.666121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491734dc-397d-47e8-a26d-b5a89672b5f8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:42.667780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:42.701864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744e853-fd58-4c86-9732-8aefae6b0365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:42.702463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744e853-fd58-4c86-9732-8aefae6b0365 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:42.702738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744e853-fd58-4c86-9732-8aefae6b0365 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:42.703004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744e853-fd58-4c86-9732-8aefae6b0365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:42.754072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 221/446] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:42.755256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd2097-2dd1-41b0-bb6b-1d4ed7d6d941 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:42.775255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744e853-fd58-4c86-9732-8aefae6b0365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:42.776762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744e853-fd58-4c86-9732-8aefae6b0365 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:42.837722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:42.861357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd2097-2dd1-41b0-bb6b-1d4ed7d6d941 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:42.878868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 226/447] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:42.880027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744e853-fd58-4c86-9732-8aefae6b0365 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:42.882734 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:42.901721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee460e-f59a-4e46-b7b2-4f904bd7838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:42.902347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee460e-f59a-4e46-b7b2-4f904bd7838b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:42.902642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee460e-f59a-4e46-b7b2-4f904bd7838b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:42.902933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee460e-f59a-4e46-b7b2-4f904bd7838b None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:42.904664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee460e-f59a-4e46-b7b2-4f904bd7838b None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:42.906102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee460e-f59a-4e46-b7b2-4f904bd7838b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:42.907659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 222/448] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:42 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:42.908428 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee460e-f59a-4e46-b7b2-4f904bd7838b None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:42.981528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744e853-fd58-4c86-9732-8aefae6b0365 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:43.007770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee460e-f59a-4e46-b7b2-4f904bd7838b None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:43.014600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083ded2-bf03-4bb0-9372-6e7dfd296158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:43.015263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ded2-bf03-4bb0-9372-6e7dfd296158 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:43.015544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ded2-bf03-4bb0-9372-6e7dfd296158 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:43.015813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ded2-bf03-4bb0-9372-6e7dfd296158 None admin] PATH_INFO: `/v3/projects/d678307757524765a2599dd485cbbb7e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:43.016994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083ded2-bf03-4bb0-9372-6e7dfd296158 None admin] RBAC: Authorizing `identity:get_project(project_id=d678307757524765a2599dd485cbbb7e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:43.018434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083ded2-bf03-4bb0-9372-6e7dfd296158 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:43.020041 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 227/449] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:42 2022] GET /identity/v3/projects/d678307757524765a2599dd485cbbb7e => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:43.020819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083ded2-bf03-4bb0-9372-6e7dfd296158 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:43.046612 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4ad21-7030-40a1-aef9-1fec13414e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:43.047229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ad21-7030-40a1-aef9-1fec13414e6c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:43.047511 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ad21-7030-40a1-aef9-1fec13414e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:43.047787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4ad21-7030-40a1-aef9-1fec13414e6c None admin] PATH_INFO: `/v3/projects/79cea13f947a4452b851eb72104e1d0d` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:43.048921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4ad21-7030-40a1-aef9-1fec13414e6c None admin] RBAC: Authorizing `identity:get_project(project_id=79cea13f947a4452b851eb72104e1d0d)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:43.050354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4ad21-7030-40a1-aef9-1fec13414e6c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:43.052022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 223/450] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:56:42 2022] GET /identity/v3/projects/79cea13f947a4452b851eb72104e1d0d => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:43.052882 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4ad21-7030-40a1-aef9-1fec13414e6c None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:43.067562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:43.091095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:43.120343 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083ded2-bf03-4bb0-9372-6e7dfd296158 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:43.150231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4ad21-7030-40a1-aef9-1fec13414e6c None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:43.152599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60453f-6538-4ac4-a56c-6659779a1f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:43.153730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60453f-6538-4ac4-a56c-6659779a1f70 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:43.154007 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60453f-6538-4ac4-a56c-6659779a1f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:43.154276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60453f-6538-4ac4-a56c-6659779a1f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:43.155003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60453f-6538-4ac4-a56c-6659779a1f70 None admin] RBAC: Adding query filter params (group.id=95449fe5cdcf41e79e0179d885d5311b, role.id=24cce6d670834e3ba65b942574313d0a, scope.project.id=d678307757524765a2599dd485cbbb7e) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:43.155313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60453f-6538-4ac4-a56c-6659779a1f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:43.156794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60453f-6538-4ac4-a56c-6659779a1f70 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:43.162778 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 228/451] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Aug 24 16:56:43 2022] GET /identity/v3/role_assignments?group.id=95449fe5cdcf41e79e0179d885d5311b&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=24cce6d670834e3ba65b942574313d0a => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:43.163614 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60453f-6538-4ac4-a56c-6659779a1f70 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:43.189962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d620e5-6c69-456e-8017-1b6e1ce4e3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:43.190969 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d620e5-6c69-456e-8017-1b6e1ce4e3ac None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:43.191241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d620e5-6c69-456e-8017-1b6e1ce4e3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:43.191513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d620e5-6c69-456e-8017-1b6e1ce4e3ac None admin] PATH_INFO: `/v3/groups/95449fe5cdcf41e79e0179d885d5311b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:43.192730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d620e5-6c69-456e-8017-1b6e1ce4e3ac None admin] RBAC: Authorizing `identity:get_group(group_id=95449fe5cdcf41e79e0179d885d5311b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:43.194199 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d620e5-6c69-456e-8017-1b6e1ce4e3ac None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:43.195852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 224/452] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:43 2022] GET /identity/v3/groups/95449fe5cdcf41e79e0179d885d5311b => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:43.202162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d620e5-6c69-456e-8017-1b6e1ce4e3ac None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:43.293186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60453f-6538-4ac4-a56c-6659779a1f70 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:43.308661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:43.329281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d620e5-6c69-456e-8017-1b6e1ce4e3ac None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:43.334100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10351113-98bf-4c3b-889a-279ab6e5b411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:43.334739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351113-98bf-4c3b-889a-279ab6e5b411 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:43.335019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351113-98bf-4c3b-889a-279ab6e5b411 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:43.335293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10351113-98bf-4c3b-889a-279ab6e5b411 None admin] PATH_INFO: `/v3/groups/280bc7f982084954be5db64eb253fccb` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:43.336583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10351113-98bf-4c3b-889a-279ab6e5b411 None admin] RBAC: Authorizing `identity:get_group(group_id=280bc7f982084954be5db64eb253fccb)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:43.339905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10351113-98bf-4c3b-889a-279ab6e5b411 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:43.340074 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 229/453] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Aug 24 16:56:43 2022] GET /identity/v3/groups/280bc7f982084954be5db64eb253fccb => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:43.346241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10351113-98bf-4c3b-889a-279ab6e5b411 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:43.351877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:43.373528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d70b96-a008-4bbb-af91-62323d0a7434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:43.373528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d70b96-a008-4bbb-af91-62323d0a7434 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:43.373528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d70b96-a008-4bbb-af91-62323d0a7434 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:43.373839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d70b96-a008-4bbb-af91-62323d0a7434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:43.374378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d70b96-a008-4bbb-af91-62323d0a7434 None admin] RBAC: Adding query filter params (group.id=95449fe5cdcf41e79e0179d885d5311b, role.id=2837bb5c87054ea7a046150d413d2561, scope.project.id=d678307757524765a2599dd485cbbb7e) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:43.374678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d70b96-a008-4bbb-af91-62323d0a7434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:43.376133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d70b96-a008-4bbb-af91-62323d0a7434 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:43.382413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 225/454] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Aug 24 16:56:43 2022] GET /identity/v3/role_assignments?group.id=95449fe5cdcf41e79e0179d885d5311b&scope.project.id=d678307757524765a2599dd485cbbb7e&role.id=2837bb5c87054ea7a046150d413d2561 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:43.479304 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10351113-98bf-4c3b-889a-279ab6e5b411 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:43.523542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4e5a06-436d-4333-9883-cd64e381828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:43.524355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e5a06-436d-4333-9883-cd64e381828c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:43.524693 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e5a06-436d-4333-9883-cd64e381828c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:43.524973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e5a06-436d-4333-9883-cd64e381828c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:43.525773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e5a06-436d-4333-9883-cd64e381828c None admin] RBAC: Adding query filter params (group.id=280bc7f982084954be5db64eb253fccb, role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=79cea13f947a4452b851eb72104e1d0d) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:43.526082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e5a06-436d-4333-9883-cd64e381828c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:43.527520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4e5a06-436d-4333-9883-cd64e381828c None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:43.535088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 230/455] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Aug 24 16:56:43 2022] GET /identity/v3/role_assignments?group.id=280bc7f982084954be5db64eb253fccb&scope.project.id=79cea13f947a4452b851eb72104e1d0d&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:45.874507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefd73b-3c43-456f-8c75-e5865846eb1a None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:45.875039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefd73b-3c43-456f-8c75-e5865846eb1a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:45.875452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eefd73b-3c43-456f-8c75-e5865846eb1a None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:45.878232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 226/456] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:45.887777 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad401d-b7bd-4a18-ac82-4d5bb18db22d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:45.888290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad401d-b7bd-4a18-ac82-4d5bb18db22d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:45.888399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad401d-b7bd-4a18-ac82-4d5bb18db22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:45.916151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-3aad401d-b7bd-4a18-ac82-4d5bb18db22d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:45.917385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3aad401d-b7bd-4a18-ac82-4d5bb18db22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:46.029480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:46.044255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 231/457] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:46.181418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a513-6e61-40f7-9c7c-4adb516dad32 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:46.181804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a513-6e61-40f7-9c7c-4adb516dad32 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:46.182287 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18a513-6e61-40f7-9c7c-4adb516dad32 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:46.185946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 227/458] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:46.193561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b24a2-9fbd-41c3-b815-9970e165d56c None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:46.193843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b24a2-9fbd-41c3-b815-9970e165d56c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:46.194112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b24a2-9fbd-41c3-b815-9970e165d56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:46.219704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-884b24a2-9fbd-41c3-b815-9970e165d56c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:46.220917 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-884b24a2-9fbd-41c3-b815-9970e165d56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:46.369911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 232/459] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:46.498552 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a513-6e61-40f7-9c7c-4adb516dad32 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:46.665419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8609b9-bca1-4f9d-8830-fdfdd0ef6291 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:46.666123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8609b9-bca1-4f9d-8830-fdfdd0ef6291 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:46.666706 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8609b9-bca1-4f9d-8830-fdfdd0ef6291 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:46.676935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 233/460] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:46 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:46.687035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9000782-97e3-4d26-a82a-a1b1035e82d7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:46.687494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9000782-97e3-4d26-a82a-a1b1035e82d7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:46.687945 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9000782-97e3-4d26-a82a-a1b1035e82d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:46.719149 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18a513-6e61-40f7-9c7c-4adb516dad32 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:46.751994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e9000782-97e3-4d26-a82a-a1b1035e82d7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:46.754393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e9000782-97e3-4d26-a82a-a1b1035e82d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:46.817985 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6c282-9399-4839-91f5-0487e5784578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:46.818639 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6c282-9399-4839-91f5-0487e5784578 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:46.818907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6c282-9399-4839-91f5-0487e5784578 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:46.819179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6c282-9399-4839-91f5-0487e5784578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:46.849397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6c282-9399-4839-91f5-0487e5784578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:46.850992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6c282-9399-4839-91f5-0487e5784578 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:46.861331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:46.883073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 234/461] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-03e6c282-9399-4839-91f5-0487e5784578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:46.884727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:46.885917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:46.886737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:46.886737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:46.886737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:46.892322 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 228/462] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:46.894629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9000782-97e3-4d26-a82a-a1b1035e82d7 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:46.958831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6c282-9399-4839-91f5-0487e5784578 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:47.000609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:47.075948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9000782-97e3-4d26-a82a-a1b1035e82d7 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:47.139575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f2db7-1ef9-49e7-952d-ec3af0335447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:47.140189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f2db7-1ef9-49e7-952d-ec3af0335447 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:47.140488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f2db7-1ef9-49e7-952d-ec3af0335447 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:47.140755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f2db7-1ef9-49e7-952d-ec3af0335447 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:47.141406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f2db7-1ef9-49e7-952d-ec3af0335447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:47.141703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f2db7-1ef9-49e7-952d-ec3af0335447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:47.144637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6c282-9399-4839-91f5-0487e5784578 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:47.147176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f2db7-1ef9-49e7-952d-ec3af0335447 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:47.191764 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 235/463] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:47.193931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f2db7-1ef9-49e7-952d-ec3af0335447 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:47.216628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e4403-e0b5-406d-b4c1-4a32bb4faa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:47.217651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e4403-e0b5-406d-b4c1-4a32bb4faa29 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:47.217928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e4403-e0b5-406d-b4c1-4a32bb4faa29 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:47.218192 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e4403-e0b5-406d-b4c1-4a32bb4faa29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:47.239786 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e4403-e0b5-406d-b4c1-4a32bb4faa29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:47.241279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e4403-e0b5-406d-b4c1-4a32bb4faa29 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-6d0e4403-e0b5-406d-b4c1-4a32bb4faa29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:47.269919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:47.270841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:47.271647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:47.271647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:47.271647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:47.272260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 229/464] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:47.280587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e4403-e0b5-406d-b4c1-4a32bb4faa29 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:47.367881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f2db7-1ef9-49e7-952d-ec3af0335447 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:47.376351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:47.391761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:47.412907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ac2ec-676a-493b-8109-16e7077c76c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:47.413751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ac2ec-676a-493b-8109-16e7077c76c3 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:47.414036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ac2ec-676a-493b-8109-16e7077c76c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:47.414410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ac2ec-676a-493b-8109-16e7077c76c3 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:47.414956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ac2ec-676a-493b-8109-16e7077c76c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:47.416407 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ac2ec-676a-493b-8109-16e7077c76c3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:47.436925 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e4403-e0b5-406d-b4c1-4a32bb4faa29 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:47.471123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d2f08-32b1-4c5a-9e33-52e1bf3257a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:47.471723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d2f08-32b1-4c5a-9e33-52e1bf3257a6 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:47.472000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d2f08-32b1-4c5a-9e33-52e1bf3257a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:47.472298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d2f08-32b1-4c5a-9e33-52e1bf3257a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:47.472964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d2f08-32b1-4c5a-9e33-52e1bf3257a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:47.473232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d2f08-32b1-4c5a-9e33-52e1bf3257a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:47.474596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d2f08-32b1-4c5a-9e33-52e1bf3257a6 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:47.486448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 230/465] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:47.491771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514a7c-d3c2-4ebc-b9ba-9dd606fbbbd4 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:47.491771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514a7c-d3c2-4ebc-b9ba-9dd606fbbbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:47.491771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514a7c-d3c2-4ebc-b9ba-9dd606fbbbd4 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:47.491771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 231/466] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:47.491771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b514a7c-d3c2-4ebc-b9ba-9dd606fbbbd4 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:47.516397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 236/467] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:56:47 2022] POST /identity/v3/users => generated 246 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:56:47.522982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee778b4e-8dff-46cf-bb93-618af1f1e950 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:47.523268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee778b4e-8dff-46cf-bb93-618af1f1e950 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:47.523542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee778b4e-8dff-46cf-bb93-618af1f1e950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:47.550873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ee778b4e-8dff-46cf-bb93-618af1f1e950 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:47.552748 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ee778b4e-8dff-46cf-bb93-618af1f1e950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:47.630289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b514a7c-d3c2-4ebc-b9ba-9dd606fbbbd4 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:47.643090 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:47.652257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 237/468] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:47.653868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee778b4e-8dff-46cf-bb93-618af1f1e950 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:47.674414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba08fd-48bb-4667-9d50-10f46efd7a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:47.675527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba08fd-48bb-4667-9d50-10f46efd7a23 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:47.676075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba08fd-48bb-4667-9d50-10f46efd7a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:47.676407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba08fd-48bb-4667-9d50-10f46efd7a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:47.693224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba08fd-48bb-4667-9d50-10f46efd7a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:47.694986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba08fd-48bb-4667-9d50-10f46efd7a23 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-58ba08fd-48bb-4667-9d50-10f46efd7a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:47.714585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:47.715814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:47.716717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:47.716717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:47.716717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:47.716717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 232/469] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:47.722267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba08fd-48bb-4667-9d50-10f46efd7a23 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:47.804329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee778b4e-8dff-46cf-bb93-618af1f1e950 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:47.806309 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:47.852300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1515c-daf4-4b57-b081-e6ac4efb4a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:47.853259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1515c-daf4-4b57-b081-e6ac4efb4a4b None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:47.853635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1515c-daf4-4b57-b081-e6ac4efb4a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:47.854269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1515c-daf4-4b57-b081-e6ac4efb4a4b None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:47.855284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1515c-daf4-4b57-b081-e6ac4efb4a4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:47.857369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1515c-daf4-4b57-b081-e6ac4efb4a4b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:47.857964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba08fd-48bb-4667-9d50-10f46efd7a23 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:47.909051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21027ea5-a937-4d10-b81b-f7d06a17fec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:47.909665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21027ea5-a937-4d10-b81b-f7d06a17fec3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:47.909917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21027ea5-a937-4d10-b81b-f7d06a17fec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:47.910191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21027ea5-a937-4d10-b81b-f7d06a17fec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:47.910841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21027ea5-a937-4d10-b81b-f7d06a17fec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:47.911134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21027ea5-a937-4d10-b81b-f7d06a17fec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:47.912534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21027ea5-a937-4d10-b81b-f7d06a17fec3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:47.931282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 233/470] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:47.938284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21027ea5-a937-4d10-b81b-f7d06a17fec3 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:47.962089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:48.023640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 238/471] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:56:47 2022] POST /identity/v3/users => generated 248 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:56:48.028395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1515c-daf4-4b57-b081-e6ac4efb4a4b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:48.093828 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21027ea5-a937-4d10-b81b-f7d06a17fec3 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:48.170999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d8987-b64c-48da-a4ef-9f2314070177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:48.171551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8987-b64c-48da-a4ef-9f2314070177 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:48.171832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8987-b64c-48da-a4ef-9f2314070177 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:48.172104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8987-b64c-48da-a4ef-9f2314070177 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:48.172827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d8987-b64c-48da-a4ef-9f2314070177 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:48.174644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d8987-b64c-48da-a4ef-9f2314070177 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:48.187540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1515c-daf4-4b57-b081-e6ac4efb4a4b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:48.229703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbef2e-285c-40fe-a04f-854a4c357ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:48.230376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbef2e-285c-40fe-a04f-854a4c357ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:48.230659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbef2e-285c-40fe-a04f-854a4c357ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:48.231019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbef2e-285c-40fe-a04f-854a4c357ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:48.243341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbef2e-285c-40fe-a04f-854a4c357ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:48.244882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbef2e-285c-40fe-a04f-854a4c357ad1 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-62bbef2e-285c-40fe-a04f-854a4c357ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:48.261070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:48.262005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:48.263479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:48.263479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:48.263479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:48.263479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 239/472] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:48.264418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ceefb-af5c-4e6b-8fad-3fabf71824fb None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:48.264701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ceefb-af5c-4e6b-8fad-3fabf71824fb None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:48.264970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ceefb-af5c-4e6b-8fad-3fabf71824fb None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:48.266218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 240/473] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:48.269356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ceefb-af5c-4e6b-8fad-3fabf71824fb None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:48.277639 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 234/474] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:56:47 2022] POST /identity/v3/users => generated 248 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:56:48.278850 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142fcb4-9874-4ab5-a60d-99cbe43abd9f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:48.279128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142fcb4-9874-4ab5-a60d-99cbe43abd9f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:48.279401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142fcb4-9874-4ab5-a60d-99cbe43abd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:48.293059 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:48.318001 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b142fcb4-9874-4ab5-a60d-99cbe43abd9f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:48.320387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b142fcb4-9874-4ab5-a60d-99cbe43abd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:48.406563 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ceefb-af5c-4e6b-8fad-3fabf71824fb None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:48.439472 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 235/475] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:48.453983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61f763-3e5f-46a8-8d01-8eb495d693d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:48.454980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61f763-3e5f-46a8-8d01-8eb495d693d2 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:48.455456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61f763-3e5f-46a8-8d01-8eb495d693d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:48.455920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61f763-3e5f-46a8-8d01-8eb495d693d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:48.456860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61f763-3e5f-46a8-8d01-8eb495d693d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:48.457359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61f763-3e5f-46a8-8d01-8eb495d693d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:48.458971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf61f763-3e5f-46a8-8d01-8eb495d693d2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:48.472437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 241/476] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:48.478307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142fcb4-9874-4ab5-a60d-99cbe43abd9f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:48.492185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:48.586843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142fcb4-9874-4ab5-a60d-99cbe43abd9f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:48.623753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6b5e-0431-41b2-ac82-756869b3a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:48.624457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6b5e-0431-41b2-ac82-756869b3a416 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:48.624736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6b5e-0431-41b2-ac82-756869b3a416 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:48.625006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a6b5e-0431-41b2-ac82-756869b3a416 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:48.625706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a6b5e-0431-41b2-ac82-756869b3a416 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:48.627151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a6b5e-0431-41b2-ac82-756869b3a416 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:48.727590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 236/477] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:56:48 2022] POST /identity/v3/users => generated 249 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:56:48.741869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61f763-3e5f-46a8-8d01-8eb495d693d2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:48.838061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:48.885905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf61f763-3e5f-46a8-8d01-8eb495d693d2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:48.944002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7686311-5a8c-4a73-a078-0d4e449624f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:48.944986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686311-5a8c-4a73-a078-0d4e449624f1 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:48.945270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686311-5a8c-4a73-a078-0d4e449624f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:48.945542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7686311-5a8c-4a73-a078-0d4e449624f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:48.946225 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7686311-5a8c-4a73-a078-0d4e449624f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:48.948454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7686311-5a8c-4a73-a078-0d4e449624f1 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:48.989424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.sql.core [None req-a7686311-5a8c-4a73-a078-0d4e449624f1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 16:56:48.989424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 16:56:48.989424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [parameters: {'id': 'a92fbbc6196645e8848d2df9f2cb99f5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 16:56:48.989424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81946) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-a7686311-5a8c-4a73-a078-0d4e449624f1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result.read() Aug 24 16:56:49.007230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:56:49.008157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application yield resource Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise self.value Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application session.commit() Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 16:56:49.009184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.session.flush() Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application compat.raise_( Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 16:56:49.010025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:56:49.010960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result.read() Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:56:49.014120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [parameters: {'id': 'a92fbbc6196645e8848d2df9f2cb99f5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:49.016189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 16:56:49.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:49.022369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 242/478] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Aug 24 16:56:48 2022] POST /identity/v3/roles => generated 144 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:49.027155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6b5e-0431-41b2-ac82-756869b3a416 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:49.101584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:49.146251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a6b5e-0431-41b2-ac82-756869b3a416 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:49.185596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe499b64-8448-41ae-b0ea-af48307787e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:49.186633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe499b64-8448-41ae-b0ea-af48307787e7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:49.187183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe499b64-8448-41ae-b0ea-af48307787e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:49.187701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe499b64-8448-41ae-b0ea-af48307787e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:49.202294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe499b64-8448-41ae-b0ea-af48307787e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-fe499b64-8448-41ae-b0ea-af48307787e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:49.207564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:49.208504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:49.209277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 237/479] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:56:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:49.221281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7686311-5a8c-4a73-a078-0d4e449624f1 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:49.406160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7686311-5a8c-4a73-a078-0d4e449624f1 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:49.457086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36187cbb-f791-4483-9b7e-2d9d2cb660c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:49.457698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187cbb-f791-4483-9b7e-2d9d2cb660c6 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:49.457971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187cbb-f791-4483-9b7e-2d9d2cb660c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:49.458239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36187cbb-f791-4483-9b7e-2d9d2cb660c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:49.458913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36187cbb-f791-4483-9b7e-2d9d2cb660c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:49.459208 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36187cbb-f791-4483-9b7e-2d9d2cb660c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:49.460597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36187cbb-f791-4483-9b7e-2d9d2cb660c6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:49.462104 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:49.474296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 243/480] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:49.926354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cebfa-46b3-46d9-9f67-302651fef460 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:49.926741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cebfa-46b3-46d9-9f67-302651fef460 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:49.926932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cebfa-46b3-46d9-9f67-302651fef460 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:49.928370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 238/481] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:49.934468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c76e-2443-410f-b973-5471279e1b6f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:49.935160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c76e-2443-410f-b973-5471279e1b6f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:49.935966 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c76e-2443-410f-b973-5471279e1b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:49.960113 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a276c76e-2443-410f-b973-5471279e1b6f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:49.961881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a276c76e-2443-410f-b973-5471279e1b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:50.034186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 244/482] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:50.337258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cebfa-46b3-46d9-9f67-302651fef460 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:50.378604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e85ab1-3ff7-465c-981c-36e38ac95b3c None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:50.379144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e85ab1-3ff7-465c-981c-36e38ac95b3c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:50.379144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e85ab1-3ff7-465c-981c-36e38ac95b3c None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:50.384299 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 245/483] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:50.388252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8335-edf7-4556-b135-0ae21fb7d50d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:50.388252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8335-edf7-4556-b135-0ae21fb7d50d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:50.388252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a8335-edf7-4556-b135-0ae21fb7d50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:50.407720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-408a8335-edf7-4556-b135-0ae21fb7d50d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:50.409333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-408a8335-edf7-4556-b135-0ae21fb7d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:50.503361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 246/484] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:56:50.542690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cebfa-46b3-46d9-9f67-302651fef460 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:50.583024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:50.600444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc71fc5-68c9-4a13-b117-8b0fd94f20b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:50.601089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71fc5-68c9-4a13-b117-8b0fd94f20b2 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:50.601493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71fc5-68c9-4a13-b117-8b0fd94f20b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:50.601647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc71fc5-68c9-4a13-b117-8b0fd94f20b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:50.624455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc71fc5-68c9-4a13-b117-8b0fd94f20b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-4fc71fc5-68c9-4a13-b117-8b0fd94f20b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:50.629469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:50.630349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:50.631137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:50.633276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 239/485] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:56:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:50.638493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a8335-edf7-4556-b135-0ae21fb7d50d None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:50.726716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:50.795539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a8335-edf7-4556-b135-0ae21fb7d50d None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:50.846786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db5b90-abed-4ac7-a0a2-740eeed9a7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:50.847499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db5b90-abed-4ac7-a0a2-740eeed9a7ff None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:50.847786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db5b90-abed-4ac7-a0a2-740eeed9a7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:50.849059 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db5b90-abed-4ac7-a0a2-740eeed9a7ff None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:50.849059 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db5b90-abed-4ac7-a0a2-740eeed9a7ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:50.849365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db5b90-abed-4ac7-a0a2-740eeed9a7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:50.850532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db5b90-abed-4ac7-a0a2-740eeed9a7ff None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:50.860042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 247/486] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:56:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:50.865527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc71fc5-68c9-4a13-b117-8b0fd94f20b2 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:50.869676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db5b90-abed-4ac7-a0a2-740eeed9a7ff None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:51.040637 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db5b90-abed-4ac7-a0a2-740eeed9a7ff None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:51.065847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:51.075453 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc71fc5-68c9-4a13-b117-8b0fd94f20b2 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:51.090989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f9daa-788c-41b1-a79c-c6581bf5e838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:51.092306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9daa-788c-41b1-a79c-c6581bf5e838 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.092799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9daa-788c-41b1-a79c-c6581bf5e838 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.093802 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f9daa-788c-41b1-a79c-c6581bf5e838 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.110774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f9daa-788c-41b1-a79c-c6581bf5e838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-fb7f9daa-788c-41b1-a79c-c6581bf5e838 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:51.118234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:51.119130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:51.119943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:51.120603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb1925-5158-41ce-8879-5830b063a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:51.120603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1925-5158-41ce-8879-5830b063a589 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.120747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1925-5158-41ce-8879-5830b063a589 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.122131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb1925-5158-41ce-8879-5830b063a589 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.123404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 248/487] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:56:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:51.129411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930162-482a-41ca-9154-91f9cafcc958 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.130129 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930162-482a-41ca-9154-91f9cafcc958 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.130619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930162-482a-41ca-9154-91f9cafcc958 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.132668 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 249/488] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:51.133588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de930162-482a-41ca-9154-91f9cafcc958 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:51.140533 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb1925-5158-41ce-8879-5830b063a589 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:51.142113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb1925-5158-41ce-8879-5830b063a589 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-f2bb1925-5158-41ce-8879-5830b063a589 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:51.160590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:51.161561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:51.162473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:51.162473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:51.162473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:51.162473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 240/489] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:51.163244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f8c2-99e5-4314-bae6-0e7083473ec1 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.164020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f8c2-99e5-4314-bae6-0e7083473ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.164334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5f8c2-99e5-4314-bae6-0e7083473ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.188841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b2a5f8c2-99e5-4314-bae6-0e7083473ec1 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:51.190056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b2a5f8c2-99e5-4314-bae6-0e7083473ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:51.226010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:51.268789 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de930162-482a-41ca-9154-91f9cafcc958 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:51.296320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 241/490] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:51.297607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5f8c2-99e5-4314-bae6-0e7083473ec1 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:51.321306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8bda3-6856-4468-8b4b-876c1208508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:51.322346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8bda3-6856-4468-8b4b-876c1208508c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.322685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8bda3-6856-4468-8b4b-876c1208508c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.323021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8bda3-6856-4468-8b4b-876c1208508c None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.323756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8bda3-6856-4468-8b4b-876c1208508c None admin] RBAC: Adding query filter params (name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:51.324138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8bda3-6856-4468-8b4b-876c1208508c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:51.326141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8bda3-6856-4468-8b4b-876c1208508c None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:51.339669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 250/491] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:56:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:51.339669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b793e6-de76-4bca-95b7-69714c147819 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.339669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b793e6-de76-4bca-95b7-69714c147819 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.339669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b793e6-de76-4bca-95b7-69714c147819 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.342493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 251/492] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:51.343386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b793e6-de76-4bca-95b7-69714c147819 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:51.389642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:51.436777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5f8c2-99e5-4314-bae6-0e7083473ec1 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:51.455553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b793e6-de76-4bca-95b7-69714c147819 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:51.487989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195a394-855d-4b70-90d4-f47338704d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:51.489219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195a394-855d-4b70-90d4-f47338704d92 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.489670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195a394-855d-4b70-90d4-f47338704d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.490085 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195a394-855d-4b70-90d4-f47338704d92 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.490895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195a394-855d-4b70-90d4-f47338704d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:51.491446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195a394-855d-4b70-90d4-f47338704d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:51.492847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9cf4-9eb3-4e5c-9028-202d6d69050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:51.493311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195a394-855d-4b70-90d4-f47338704d92 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:51.493757 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9cf4-9eb3-4e5c-9028-202d6d69050d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.494132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9cf4-9eb3-4e5c-9028-202d6d69050d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.494521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9cf4-9eb3-4e5c-9028-202d6d69050d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.509335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 242/493] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:51.510870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb565f37-27c0-4734-aaad-1cd9ac39b0bb None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.511288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb565f37-27c0-4734-aaad-1cd9ac39b0bb None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.511703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb565f37-27c0-4734-aaad-1cd9ac39b0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.516846 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea9cf4-9eb3-4e5c-9028-202d6d69050d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:51.519444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea9cf4-9eb3-4e5c-9028-202d6d69050d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:51.535476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-bb565f37-27c0-4734-aaad-1cd9ac39b0bb None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:51.537036 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bb565f37-27c0-4734-aaad-1cd9ac39b0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-09ea9cf4-9eb3-4e5c-9028-202d6d69050d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:51.537367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:51.538354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:51.539187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:51.539187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:51.539187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:51.543595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 252/494] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:51.544476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9cf4-9eb3-4e5c-9028-202d6d69050d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:51.563907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:51.632390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 243/495] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:51.632390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb565f37-27c0-4734-aaad-1cd9ac39b0bb None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:51.658288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:51.667813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9cf4-9eb3-4e5c-9028-202d6d69050d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:51.707355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132462b-5d82-4440-a516-ea8f6e5b8812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:51.708481 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132462b-5d82-4440-a516-ea8f6e5b8812 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.709052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132462b-5d82-4440-a516-ea8f6e5b8812 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.709554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132462b-5d82-4440-a516-ea8f6e5b8812 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.718584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132462b-5d82-4440-a516-ea8f6e5b8812 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:51.720398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132462b-5d82-4440-a516-ea8f6e5b8812 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-0132462b-5d82-4440-a516-ea8f6e5b8812 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:56:51.735003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:51.735935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:51.736947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:51.736947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:51.736947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:56:51.736947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:56:51.736947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:56:51.736947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:56:51.736947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:56:51.736947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:56:51.736947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:56:51.736947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:51.739260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 253/496] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Aug 24 16:56:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:51.740171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132462b-5d82-4440-a516-ea8f6e5b8812 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:51.765333 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb565f37-27c0-4734-aaad-1cd9ac39b0bb None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:51.807861 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebd7c8-831e-4d21-8e70-2e0738b25bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:51.809586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebd7c8-831e-4d21-8e70-2e0738b25bdb None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.810118 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebd7c8-831e-4d21-8e70-2e0738b25bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.810889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebd7c8-831e-4d21-8e70-2e0738b25bdb None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.811780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebd7c8-831e-4d21-8e70-2e0738b25bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:51.812308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebd7c8-831e-4d21-8e70-2e0738b25bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:51.814066 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebd7c8-831e-4d21-8e70-2e0738b25bdb None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:51.827818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 244/497] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:51.829182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebd7c8-831e-4d21-8e70-2e0738b25bdb None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:51.848199 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:51.859062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132462b-5d82-4440-a516-ea8f6e5b8812 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:51.896085 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4015ca-a015-475e-816a-35acf8863dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:51.896827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4015ca-a015-475e-816a-35acf8863dce None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.897114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4015ca-a015-475e-816a-35acf8863dce None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.897389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4015ca-a015-475e-816a-35acf8863dce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.912946 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4015ca-a015-475e-816a-35acf8863dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-9d4015ca-a015-475e-816a-35acf8863dce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:51.919624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:51.920792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 254/498] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:56:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:51.921594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4015ca-a015-475e-816a-35acf8863dce None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:51.940532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:51.950603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebd7c8-831e-4d21-8e70-2e0738b25bdb None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:51.994371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf877d5-f71f-4249-bcd9-e9eac528890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:51.995774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf877d5-f71f-4249-bcd9-e9eac528890b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:51.996061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf877d5-f71f-4249-bcd9-e9eac528890b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:51.997032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf877d5-f71f-4249-bcd9-e9eac528890b None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:51.997775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf877d5-f71f-4249-bcd9-e9eac528890b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:51.998080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf877d5-f71f-4249-bcd9-e9eac528890b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:51.999526 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf877d5-f71f-4249-bcd9-e9eac528890b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:52.030994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4015ca-a015-475e-816a-35acf8863dce None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:52.036445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 245/499] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Aug 24 16:56:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:52.037280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf877d5-f71f-4249-bcd9-e9eac528890b None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:52.069165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433b64d-7991-4a2b-b59c-33868c9ac542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:52.069783 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433b64d-7991-4a2b-b59c-33868c9ac542 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:52.070057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433b64d-7991-4a2b-b59c-33868c9ac542 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:52.070324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433b64d-7991-4a2b-b59c-33868c9ac542 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:52.078075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433b64d-7991-4a2b-b59c-33868c9ac542 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:52.079513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433b64d-7991-4a2b-b59c-33868c9ac542 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-c433b64d-7991-4a2b-b59c-33868c9ac542 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:56:52.090641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:52.091529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 255/500] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:52.093216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433b64d-7991-4a2b-b59c-33868c9ac542 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:52.109022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:52.138962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf877d5-f71f-4249-bcd9-e9eac528890b None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:52.165597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:52.173012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17d3b3-dfaa-4f0f-ba3d-cd09fdc272a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:52.173626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d3b3-dfaa-4f0f-ba3d-cd09fdc272a4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:52.173910 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d3b3-dfaa-4f0f-ba3d-cd09fdc272a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:52.177177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17d3b3-dfaa-4f0f-ba3d-cd09fdc272a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:52.177177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17d3b3-dfaa-4f0f-ba3d-cd09fdc272a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:52.177177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17d3b3-dfaa-4f0f-ba3d-cd09fdc272a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:52.177177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17d3b3-dfaa-4f0f-ba3d-cd09fdc272a4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:52.185393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 246/501] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:56:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:52.186580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23229e-b97f-4e78-9f5b-1d3cf4955ca2 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:52.186859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23229e-b97f-4e78-9f5b-1d3cf4955ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:52.187129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23229e-b97f-4e78-9f5b-1d3cf4955ca2 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:52.188710 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 247/502] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:52.189233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23229e-b97f-4e78-9f5b-1d3cf4955ca2 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:52.201757 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433b64d-7991-4a2b-b59c-33868c9ac542 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:52.235674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12149db9-e2c4-42bb-b07d-a965ac2ece55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:52.236321 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12149db9-e2c4-42bb-b07d-a965ac2ece55 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:52.236599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12149db9-e2c4-42bb-b07d-a965ac2ece55 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:52.236862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12149db9-e2c4-42bb-b07d-a965ac2ece55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:52.247610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12149db9-e2c4-42bb-b07d-a965ac2ece55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-12149db9-e2c4-42bb-b07d-a965ac2ece55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:52.252915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:52.253938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 256/503] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:56:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:52.254894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12149db9-e2c4-42bb-b07d-a965ac2ece55 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:52.295211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23229e-b97f-4e78-9f5b-1d3cf4955ca2 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:52.331428 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939e213-ec96-4cc6-a8a8-9906f38a6910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:52.332038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939e213-ec96-4cc6-a8a8-9906f38a6910 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:52.332331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939e213-ec96-4cc6-a8a8-9906f38a6910 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:52.332601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939e213-ec96-4cc6-a8a8-9906f38a6910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:52.335168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:52.363065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12149db9-e2c4-42bb-b07d-a965ac2ece55 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:52.392930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:52.397944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b86c7-317d-49d3-8e3f-d48168fe49b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:52.398549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b86c7-317d-49d3-8e3f-d48168fe49b9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:52.398822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b86c7-317d-49d3-8e3f-d48168fe49b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:52.399088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b86c7-317d-49d3-8e3f-d48168fe49b9 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:52.399822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b86c7-317d-49d3-8e3f-d48168fe49b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:52.400121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b86c7-317d-49d3-8e3f-d48168fe49b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:52.400781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939e213-ec96-4cc6-a8a8-9906f38a6910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:52.405107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b86c7-317d-49d3-8e3f-d48168fe49b9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:52.405216 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939e213-ec96-4cc6-a8a8-9906f38a6910 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:52.439270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 257/504] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Aug 24 16:56:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:52.440038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b86c7-317d-49d3-8e3f-d48168fe49b9 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:52.504816 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 248/505] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:52.506109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa4d05-f133-49dd-9b8c-be832948ffe5 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:52.506306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa4d05-f133-49dd-9b8c-be832948ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:52.506577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa4d05-f133-49dd-9b8c-be832948ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:52.527066 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-cfaa4d05-f133-49dd-9b8c-be832948ffe5 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:52.528476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-cfaa4d05-f133-49dd-9b8c-be832948ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:52.546770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b86c7-317d-49d3-8e3f-d48168fe49b9 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:52.555289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:52.586268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9358b-8784-48c5-aa76-b41600be9add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:52.586894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9358b-8784-48c5-aa76-b41600be9add None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:52.587175 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9358b-8784-48c5-aa76-b41600be9add None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:52.587446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9358b-8784-48c5-aa76-b41600be9add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:52.595925 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 249/506] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:52.596793 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa4d05-f133-49dd-9b8c-be832948ffe5 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:52.598066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9358b-8784-48c5-aa76-b41600be9add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:52.599533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9358b-8784-48c5-aa76-b41600be9add None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-10c9358b-8784-48c5-aa76-b41600be9add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:52.615334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:52.616366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:52.617205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:52.617205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:52.617205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:52.617205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 258/507] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:52.618221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9358b-8784-48c5-aa76-b41600be9add None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:52.665752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:52.726895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa4d05-f133-49dd-9b8c-be832948ffe5 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:52.728485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9358b-8784-48c5-aa76-b41600be9add None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:52.763675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a5e50-c4f3-4be6-bea3-35dbd2b6e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:52.763986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96456b-018c-4c9f-938f-4a1fee7cb7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:52.764307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5e50-c4f3-4be6-bea3-35dbd2b6e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:52.764590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5e50-c4f3-4be6-bea3-35dbd2b6e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:52.764864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a5e50-c4f3-4be6-bea3-35dbd2b6e6a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:52.764952 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96456b-018c-4c9f-938f-4a1fee7cb7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:52.765410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96456b-018c-4c9f-938f-4a1fee7cb7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:52.765751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96456b-018c-4c9f-938f-4a1fee7cb7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:52.766464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96456b-018c-4c9f-938f-4a1fee7cb7e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:52.766864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96456b-018c-4c9f-938f-4a1fee7cb7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:52.768370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96456b-018c-4c9f-938f-4a1fee7cb7e9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:52.782289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 250/508] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:56:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:52.783293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96456b-018c-4c9f-938f-4a1fee7cb7e9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:52.814166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:52.840610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a5e50-c4f3-4be6-bea3-35dbd2b6e6a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:52.841964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a5e50-c4f3-4be6-bea3-35dbd2b6e6a3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:52.885942 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:52.893935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96456b-018c-4c9f-938f-4a1fee7cb7e9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:52.928136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544839a-2d4c-4ca4-996c-3850add2f33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:52.928791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544839a-2d4c-4ca4-996c-3850add2f33f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:52.929070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544839a-2d4c-4ca4-996c-3850add2f33f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:52.929341 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f544839a-2d4c-4ca4-996c-3850add2f33f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:52.940594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544839a-2d4c-4ca4-996c-3850add2f33f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:52.942088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f544839a-2d4c-4ca4-996c-3850add2f33f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:52.944553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 259/509] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:52.945397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a5e50-c4f3-4be6-bea3-35dbd2b6e6a3 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-f544839a-2d4c-4ca4-996c-3850add2f33f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:52.961679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:52.962790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:52.963629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:52.963629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:52.963629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:52.963629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 251/510] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:52.963848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544839a-2d4c-4ca4-996c-3850add2f33f None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.046546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a5e50-c4f3-4be6-bea3-35dbd2b6e6a3 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.047049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:53.069367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f544839a-2d4c-4ca4-996c-3850add2f33f None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.081778 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6dc64-f539-4e0e-bf3d-69430c41b3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.082376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6dc64-f539-4e0e-bf3d-69430c41b3ed None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.082648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6dc64-f539-4e0e-bf3d-69430c41b3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.082911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6dc64-f539-4e0e-bf3d-69430c41b3ed None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.083536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6dc64-f539-4e0e-bf3d-69430c41b3ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:53.083829 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6dc64-f539-4e0e-bf3d-69430c41b3ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.085257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6dc64-f539-4e0e-bf3d-69430c41b3ed None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.096770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 260/511] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:53.097553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6dc64-f539-4e0e-bf3d-69430c41b3ed None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.100451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:53.110064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f3d1-72fa-4043-b826-c0cb588634de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.110707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f3d1-72fa-4043-b826-c0cb588634de None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.110996 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f3d1-72fa-4043-b826-c0cb588634de None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.111272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6f3d1-72fa-4043-b826-c0cb588634de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.122125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6f3d1-72fa-4043-b826-c0cb588634de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.123638 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6f3d1-72fa-4043-b826-c0cb588634de None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-10e6f3d1-72fa-4043-b826-c0cb588634de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:53.138057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:53.139108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:53.140345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:53.140345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:53.140345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:53.140345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 252/512] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:53.140345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f3d1-72fa-4043-b826-c0cb588634de None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.201743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6dc64-f539-4e0e-bf3d-69430c41b3ed None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.235674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e42cb-720d-411b-b72a-b3e158ef6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.236314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e42cb-720d-411b-b72a-b3e158ef6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.236599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e42cb-720d-411b-b72a-b3e158ef6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.236865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e42cb-720d-411b-b72a-b3e158ef6aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.245816 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6f3d1-72fa-4043-b826-c0cb588634de None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.247197 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e42cb-720d-411b-b72a-b3e158ef6aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.248675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e42cb-720d-411b-b72a-b3e158ef6aa0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-a10e42cb-720d-411b-b72a-b3e158ef6aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:53.263102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:53.263999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:53.264865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:53.264865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:53.264865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:53.264865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 261/513] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:53.265078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e42cb-720d-411b-b72a-b3e158ef6aa0 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.277083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:53.283843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba691c0-5274-47ee-9434-44b661436eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.284954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba691c0-5274-47ee-9434-44b661436eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.285231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba691c0-5274-47ee-9434-44b661436eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.285504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba691c0-5274-47ee-9434-44b661436eb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.298265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba691c0-5274-47ee-9434-44b661436eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.299672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba691c0-5274-47ee-9434-44b661436eb0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-0ba691c0-5274-47ee-9434-44b661436eb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:53.315726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:53.316774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:53.322243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:53.322243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:53.322243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:53.322243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 253/514] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:53.322243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba691c0-5274-47ee-9434-44b661436eb0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.329345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:53.375052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e42cb-720d-411b-b72a-b3e158ef6aa0 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.410542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d93f8c-155c-4baf-a9b7-48b0a10c6b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.411226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d93f8c-155c-4baf-a9b7-48b0a10c6b18 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.411507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d93f8c-155c-4baf-a9b7-48b0a10c6b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.411782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d93f8c-155c-4baf-a9b7-48b0a10c6b18 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.412456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d93f8c-155c-4baf-a9b7-48b0a10c6b18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:53.412763 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d93f8c-155c-4baf-a9b7-48b0a10c6b18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.414168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d93f8c-155c-4baf-a9b7-48b0a10c6b18 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.419807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba691c0-5274-47ee-9434-44b661436eb0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.426102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 262/515] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:53.426932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d93f8c-155c-4baf-a9b7-48b0a10c6b18 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.455067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8766b-a3a1-49a7-bec8-9fbfa635e1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.455692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8766b-a3a1-49a7-bec8-9fbfa635e1f2 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.455970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8766b-a3a1-49a7-bec8-9fbfa635e1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.456262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8766b-a3a1-49a7-bec8-9fbfa635e1f2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.463653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8766b-a3a1-49a7-bec8-9fbfa635e1f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.465726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8766b-a3a1-49a7-bec8-9fbfa635e1f2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-e8e8766b-a3a1-49a7-bec8-9fbfa635e1f2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:56:53.478053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:53.479123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:53.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:53.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:53.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:56:53.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:56:53.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:56:53.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:56:53.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:56:53.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:56:53.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:56:53.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:53.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 254/516] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:53.480702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8766b-a3a1-49a7-bec8-9fbfa635e1f2 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.526153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:53.532562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d93f8c-155c-4baf-a9b7-48b0a10c6b18 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.547866 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:53.571279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776e49b-ed25-401b-9aba-aae8af48fb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.571811 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776e49b-ed25-401b-9aba-aae8af48fb0b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.572087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776e49b-ed25-401b-9aba-aae8af48fb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.572409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776e49b-ed25-401b-9aba-aae8af48fb0b None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.573057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776e49b-ed25-401b-9aba-aae8af48fb0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:53.573373 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776e49b-ed25-401b-9aba-aae8af48fb0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.575739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776e49b-ed25-401b-9aba-aae8af48fb0b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.586957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 263/517] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:53.587762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776e49b-ed25-401b-9aba-aae8af48fb0b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.594936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8766b-a3a1-49a7-bec8-9fbfa635e1f2 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.629905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa3ba6-579f-4506-8d5c-d8dc35448e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.630660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3ba6-579f-4506-8d5c-d8dc35448e9d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.630943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3ba6-579f-4506-8d5c-d8dc35448e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.631213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3ba6-579f-4506-8d5c-d8dc35448e9d None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.631852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa3ba6-579f-4506-8d5c-d8dc35448e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:53.632148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa3ba6-579f-4506-8d5c-d8dc35448e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.633651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa3ba6-579f-4506-8d5c-d8dc35448e9d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.646187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 255/518] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:53.647111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa3ba6-579f-4506-8d5c-d8dc35448e9d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.691099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776e49b-ed25-401b-9aba-aae8af48fb0b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.724277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b409ea-ec37-4730-bc43-94fb350d9791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.724878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b409ea-ec37-4730-bc43-94fb350d9791 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.725157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b409ea-ec37-4730-bc43-94fb350d9791 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.725437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b409ea-ec37-4730-bc43-94fb350d9791 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.726180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b409ea-ec37-4730-bc43-94fb350d9791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:53.726480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b409ea-ec37-4730-bc43-94fb350d9791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.727843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b409ea-ec37-4730-bc43-94fb350d9791 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.739587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 264/519] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:53.740414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b409ea-ec37-4730-bc43-94fb350d9791 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.748820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa3ba6-579f-4506-8d5c-d8dc35448e9d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.750312 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:53.773940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:53.783946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf2935-d41c-44e6-b720-922ad8c770f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.784630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf2935-d41c-44e6-b720-922ad8c770f3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.784911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf2935-d41c-44e6-b720-922ad8c770f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.785182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf2935-d41c-44e6-b720-922ad8c770f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.791853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf2935-d41c-44e6-b720-922ad8c770f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.793399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf2935-d41c-44e6-b720-922ad8c770f3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-0adf2935-d41c-44e6-b720-922ad8c770f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:56:53.806162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:53.807044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:53.807859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:56:53.807859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:56:53.807859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:56:53.807859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:56:53.807859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:56:53.807859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:56:53.807859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:56:53.807859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:53.807859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 256/520] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:53.808364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf2935-d41c-44e6-b720-922ad8c770f3 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.847483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b409ea-ec37-4730-bc43-94fb350d9791 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.883620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4129388-b9ec-42ba-8277-aea412672cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.884259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129388-b9ec-42ba-8277-aea412672cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.884525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129388-b9ec-42ba-8277-aea412672cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.884880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129388-b9ec-42ba-8277-aea412672cf2 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.885612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4129388-b9ec-42ba-8277-aea412672cf2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:53.885916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4129388-b9ec-42ba-8277-aea412672cf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.887778 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4129388-b9ec-42ba-8277-aea412672cf2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.905260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 265/521] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Aug 24 16:56:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:53.906503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4129388-b9ec-42ba-8277-aea412672cf2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:53.914073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf2935-d41c-44e6-b720-922ad8c770f3 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:53.949307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c08b6-950a-47df-9257-0fa8819f3b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:53.950096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c08b6-950a-47df-9257-0fa8819f3b54 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:53.950373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c08b6-950a-47df-9257-0fa8819f3b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:53.950661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c08b6-950a-47df-9257-0fa8819f3b54 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:53.958296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c08b6-950a-47df-9257-0fa8819f3b54 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:53.959852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c08b6-950a-47df-9257-0fa8819f3b54 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-177c08b6-950a-47df-9257-0fa8819f3b54 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:56:53.973220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:53.974206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 257/522] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:56:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:53.975079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c08b6-950a-47df-9257-0fa8819f3b54 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:54.001391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:54.003982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:54.012705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4129388-b9ec-42ba-8277-aea412672cf2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:54.046548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1a639-5391-4be7-9ea5-9e5575caaf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:54.047151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1a639-5391-4be7-9ea5-9e5575caaf0a None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:54.047427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1a639-5391-4be7-9ea5-9e5575caaf0a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:54.047695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1a639-5391-4be7-9ea5-9e5575caaf0a None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:54.048424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1a639-5391-4be7-9ea5-9e5575caaf0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:54.049849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1a639-5391-4be7-9ea5-9e5575caaf0a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:54.080594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c08b6-950a-47df-9257-0fa8819f3b54 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:54.113618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f2953-7d69-479f-8303-b8811b5a1d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:54.114175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f2953-7d69-479f-8303-b8811b5a1d73 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:54.114447 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f2953-7d69-479f-8303-b8811b5a1d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:54.114713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f2953-7d69-479f-8303-b8811b5a1d73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:54.121837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f2953-7d69-479f-8303-b8811b5a1d73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:54.123283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f2953-7d69-479f-8303-b8811b5a1d73 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-cf6f2953-7d69-479f-8303-b8811b5a1d73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:56:54.134155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:54.134999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:54.135977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:56:54.135977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:56:54.135977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:56:54.135977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:56:54.135977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:56:54.135977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:56:54.135977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:56:54.135977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:54.135977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 258/523] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:54.148261 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 266/524] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:56:53 2022] POST /identity/v3/users => generated 247 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:56:54.148261 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1a639-5391-4be7-9ea5-9e5575caaf0a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:54.148554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f2953-7d69-479f-8303-b8811b5a1d73 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:54.238777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:54.265724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f2953-7d69-479f-8303-b8811b5a1d73 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:54.269180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1a639-5391-4be7-9ea5-9e5575caaf0a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:54.306711 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050025f-26bb-44ea-b747-9f15e6c6d1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:54.307470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050025f-26bb-44ea-b747-9f15e6c6d1ff None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:54.307832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050025f-26bb-44ea-b747-9f15e6c6d1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:54.308177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050025f-26bb-44ea-b747-9f15e6c6d1ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:54.317225 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0628b-28ea-4a92-b1a8-6e43e441f8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:54.317843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0628b-28ea-4a92-b1a8-6e43e441f8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:54.318129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0628b-28ea-4a92-b1a8-6e43e441f8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:54.318401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0628b-28ea-4a92-b1a8-6e43e441f8b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:54.319106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0628b-28ea-4a92-b1a8-6e43e441f8b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:54.319425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0628b-28ea-4a92-b1a8-6e43e441f8b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:54.320897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0628b-28ea-4a92-b1a8-6e43e441f8b2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:54.332495 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:54.340352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 259/525] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:56:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:54.345775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0628b-28ea-4a92-b1a8-6e43e441f8b2 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:54.388657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050025f-26bb-44ea-b747-9f15e6c6d1ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:54.390158 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050025f-26bb-44ea-b747-9f15e6c6d1ff None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:54.454015 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0628b-28ea-4a92-b1a8-6e43e441f8b2 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:54.492903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2326b4-5b4c-4272-90f9-432b72adee30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:54.493778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2326b4-5b4c-4272-90f9-432b72adee30 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:54.494058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2326b4-5b4c-4272-90f9-432b72adee30 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:54.494330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2326b4-5b4c-4272-90f9-432b72adee30 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:54.495062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2326b4-5b4c-4272-90f9-432b72adee30 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:54.495359 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2326b4-5b4c-4272-90f9-432b72adee30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:54.496966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2326b4-5b4c-4272-90f9-432b72adee30 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:54.507221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 267/526] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:54.507221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050025f-26bb-44ea-b747-9f15e6c6d1ff None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:54.518666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:54.526743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 260/527] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Aug 24 16:56:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:54.526743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2326b4-5b4c-4272-90f9-432b72adee30 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:54.562097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:54.620778 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050025f-26bb-44ea-b747-9f15e6c6d1ff None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:54.639015 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2326b4-5b4c-4272-90f9-432b72adee30 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:54.658021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a898e-2a58-4067-8489-df36a6b5cd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:54.658628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a898e-2a58-4067-8489-df36a6b5cd65 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:54.658906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a898e-2a58-4067-8489-df36a6b5cd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:54.659176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a898e-2a58-4067-8489-df36a6b5cd65 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:54.659924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a898e-2a58-4067-8489-df36a6b5cd65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:54.660297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a898e-2a58-4067-8489-df36a6b5cd65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:54.661714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a898e-2a58-4067-8489-df36a6b5cd65 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:54.675443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114a04a-9556-4f85-8e2a-05df940d8458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:54.676203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114a04a-9556-4f85-8e2a-05df940d8458 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:54.676609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114a04a-9556-4f85-8e2a-05df940d8458 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:54.676986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114a04a-9556-4f85-8e2a-05df940d8458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:54.677828 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114a04a-9556-4f85-8e2a-05df940d8458 None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=8af51476b48e45efbc3b626f9780e0be) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:54.678140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114a04a-9556-4f85-8e2a-05df940d8458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:54.679595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114a04a-9556-4f85-8e2a-05df940d8458 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:54.686808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 268/528] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:56:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:54.686808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a898e-2a58-4067-8489-df36a6b5cd65 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:54.692638 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 261/529] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:54 2022] GET /identity/v3/role_assignments?user.id=8af51476b48e45efbc3b626f9780e0be&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:54.700409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114a04a-9556-4f85-8e2a-05df940d8458 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:54.776306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:54.823260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114a04a-9556-4f85-8e2a-05df940d8458 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:54.841653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a898e-2a58-4067-8489-df36a6b5cd65 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:54.861127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:54.866144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6116a1-1fda-4d16-b0b6-c3b9dfab6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:54.867684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6116a1-1fda-4d16-b0b6-c3b9dfab6648 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:54.868453 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6116a1-1fda-4d16-b0b6-c3b9dfab6648 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:54.868825 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6116a1-1fda-4d16-b0b6-c3b9dfab6648 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:54.891193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99268c82-5b51-4f72-a979-914932c0aa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:54.892472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99268c82-5b51-4f72-a979-914932c0aa46 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:54.892920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99268c82-5b51-4f72-a979-914932c0aa46 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:54.893335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99268c82-5b51-4f72-a979-914932c0aa46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:54.907340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99268c82-5b51-4f72-a979-914932c0aa46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:54.909262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99268c82-5b51-4f72-a979-914932c0aa46 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-99268c82-5b51-4f72-a979-914932c0aa46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:54.929408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:54.930593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:54.931646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:54.931646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:54.931646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:54.933100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 269/530] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:54.934750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99268c82-5b51-4f72-a979-914932c0aa46 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:54.954657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6116a1-1fda-4d16-b0b6-c3b9dfab6648 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:54.956604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6116a1-1fda-4d16-b0b6-c3b9dfab6648 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:55.028507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:55.063722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99268c82-5b51-4f72-a979-914932c0aa46 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:55.076652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 262/531] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:55.077580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6116a1-1fda-4d16-b0b6-c3b9dfab6648 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:55.110532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c4ec8-cdc8-4da3-a7ee-444805dce6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:55.111517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4ec8-cdc8-4da3-a7ee-444805dce6cd None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:55.111945 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4ec8-cdc8-4da3-a7ee-444805dce6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:55.112521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c4ec8-cdc8-4da3-a7ee-444805dce6cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:55.113326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c4ec8-cdc8-4da3-a7ee-444805dce6cd None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=1684abe7e6aa44a0873e43dfc146c1b3) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:55.113645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c4ec8-cdc8-4da3-a7ee-444805dce6cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:55.115107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c4ec8-cdc8-4da3-a7ee-444805dce6cd None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:55.128701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 270/532] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:54 2022] GET /identity/v3/role_assignments?user.id=1684abe7e6aa44a0873e43dfc146c1b3&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:55.129953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c4ec8-cdc8-4da3-a7ee-444805dce6cd None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:55.181976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:55.207352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6116a1-1fda-4d16-b0b6-c3b9dfab6648 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:55.261296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567ec1a-46bb-4c11-afc4-49c8fbef2bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:55.262524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567ec1a-46bb-4c11-afc4-49c8fbef2bcf None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:55.262803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567ec1a-46bb-4c11-afc4-49c8fbef2bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:55.263078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567ec1a-46bb-4c11-afc4-49c8fbef2bcf None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:55.263951 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567ec1a-46bb-4c11-afc4-49c8fbef2bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:55.264277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567ec1a-46bb-4c11-afc4-49c8fbef2bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:55.265686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567ec1a-46bb-4c11-afc4-49c8fbef2bcf None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:55.302809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 263/533] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:55.310343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567ec1a-46bb-4c11-afc4-49c8fbef2bcf None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:55.343094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c4ec8-cdc8-4da3-a7ee-444805dce6cd None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:55.356862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:55.409063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efaabf-7c23-42de-9d99-2e3b5ccb15e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:55.409806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efaabf-7c23-42de-9d99-2e3b5ccb15e2 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:55.410083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efaabf-7c23-42de-9d99-2e3b5ccb15e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:55.410388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efaabf-7c23-42de-9d99-2e3b5ccb15e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:55.423784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efaabf-7c23-42de-9d99-2e3b5ccb15e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:55.425341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efaabf-7c23-42de-9d99-2e3b5ccb15e2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-07efaabf-7c23-42de-9d99-2e3b5ccb15e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:55.456332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:55.457243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:55.458073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:55.458073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:55.458073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:55.463121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 271/534] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:55.464663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efaabf-7c23-42de-9d99-2e3b5ccb15e2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:55.495619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567ec1a-46bb-4c11-afc4-49c8fbef2bcf None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:55.566941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bd462-2bd0-401c-b273-5d26a5b0b9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:55.567569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bd462-2bd0-401c-b273-5d26a5b0b9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:55.567846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bd462-2bd0-401c-b273-5d26a5b0b9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:55.568113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35bd462-2bd0-401c-b273-5d26a5b0b9e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:55.581905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bd462-2bd0-401c-b273-5d26a5b0b9e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:55.583415 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35bd462-2bd0-401c-b273-5d26a5b0b9e7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-f35bd462-2bd0-401c-b273-5d26a5b0b9e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:56:55.603795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:55.604729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:55.605686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:56:55.605686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:56:55.605686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:56:55.605686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:56:55.605686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:56:55.605686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:56:55.605686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:56:55.605686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:55.612112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 264/535] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:55.618294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bd462-2bd0-401c-b273-5d26a5b0b9e7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:55.620929 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:55.662766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efaabf-7c23-42de-9d99-2e3b5ccb15e2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:55.724528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ec50-a720-4bb1-84e7-a11f7f0f0aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:55.725421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ec50-a720-4bb1-84e7-a11f7f0f0aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:55.725709 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ec50-a720-4bb1-84e7-a11f7f0f0aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:55.725987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10ec50-a720-4bb1-84e7-a11f7f0f0aa0 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:55.726921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ec50-a720-4bb1-84e7-a11f7f0f0aa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:55.727231 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ec50-a720-4bb1-84e7-a11f7f0f0aa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:55.729194 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10ec50-a720-4bb1-84e7-a11f7f0f0aa0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:55.744663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 272/536] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:55.751379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ec50-a720-4bb1-84e7-a11f7f0f0aa0 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:55.770619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:55.787795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35bd462-2bd0-401c-b273-5d26a5b0b9e7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:55.827610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6231e95-3976-4d0b-8ff6-6893d0f0e967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:55.828201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231e95-3976-4d0b-8ff6-6893d0f0e967 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:55.828521 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231e95-3976-4d0b-8ff6-6893d0f0e967 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:55.828789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6231e95-3976-4d0b-8ff6-6893d0f0e967 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:55.829537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6231e95-3976-4d0b-8ff6-6893d0f0e967 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:55.829836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6231e95-3976-4d0b-8ff6-6893d0f0e967 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:55.831519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6231e95-3976-4d0b-8ff6-6893d0f0e967 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:55.850936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 265/537] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:56:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:55.852431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6231e95-3976-4d0b-8ff6-6893d0f0e967 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:55.881534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10ec50-a720-4bb1-84e7-a11f7f0f0aa0 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:55.928338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea7798-afbc-42e8-92d8-85e2fdc296b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:55.928960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea7798-afbc-42e8-92d8-85e2fdc296b6 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:55.929237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea7798-afbc-42e8-92d8-85e2fdc296b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:55.929503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea7798-afbc-42e8-92d8-85e2fdc296b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:55.932565 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:55.940982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea7798-afbc-42e8-92d8-85e2fdc296b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:55.942563 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea7798-afbc-42e8-92d8-85e2fdc296b6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-6aea7798-afbc-42e8-92d8-85e2fdc296b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:56:55.956355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:55.957249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:55.958081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:56:55.958081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:56:55.958081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:56:55.958081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:56:55.958081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:56:55.958081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:56:55.958081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:56:55.958081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:55.958081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 273/538] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:56:55.966498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea7798-afbc-42e8-92d8-85e2fdc296b6 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:55.995936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6231e95-3976-4d0b-8ff6-6893d0f0e967 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:56.066425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb32ba-d83d-4766-9cb5-d9d34c6d4db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:56.067404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb32ba-d83d-4766-9cb5-d9d34c6d4db7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:56.068578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb32ba-d83d-4766-9cb5-d9d34c6d4db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:56.069115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb32ba-d83d-4766-9cb5-d9d34c6d4db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:56.070751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb32ba-d83d-4766-9cb5-d9d34c6d4db7 None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=009e5ad7d256449495c74dad67741f3f) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:56.071367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb32ba-d83d-4766-9cb5-d9d34c6d4db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:56.076178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb32ba-d83d-4766-9cb5-d9d34c6d4db7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:56.096393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 266/539] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:55 2022] GET /identity/v3/role_assignments?user.id=009e5ad7d256449495c74dad67741f3f&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:56:56.187025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea7798-afbc-42e8-92d8-85e2fdc296b6 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:56.245504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f575b65-5ffb-41ac-b944-b10a5b63fa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:56.246600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f575b65-5ffb-41ac-b944-b10a5b63fa4a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:56.246837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f575b65-5ffb-41ac-b944-b10a5b63fa4a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:56.247117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f575b65-5ffb-41ac-b944-b10a5b63fa4a None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:56.247842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f575b65-5ffb-41ac-b944-b10a5b63fa4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:56.248148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f575b65-5ffb-41ac-b944-b10a5b63fa4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:56.249671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f575b65-5ffb-41ac-b944-b10a5b63fa4a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:56.266592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 274/540] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:56:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:56.272696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb32ba-d83d-4766-9cb5-d9d34c6d4db7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:56.288627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:56.371657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34d094-1b7c-45c9-8bc6-4a97f96f89ea None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:56.372030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34d094-1b7c-45c9-8bc6-4a97f96f89ea None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:56.372416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34d094-1b7c-45c9-8bc6-4a97f96f89ea None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:56.373914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 275/541] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:56.379779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd46de-6a63-4432-8b0e-c199329ec315 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:56.380067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd46de-6a63-4432-8b0e-c199329ec315 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:56.380383 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd46de-6a63-4432-8b0e-c199329ec315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:56.393204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb32ba-d83d-4766-9cb5-d9d34c6d4db7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:56.425271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-41cd46de-6a63-4432-8b0e-c199329ec315 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:56.426499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-41cd46de-6a63-4432-8b0e-c199329ec315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:56.430520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d87c0c-3c74-4104-bd2a-31fcce58195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:56.431184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d87c0c-3c74-4104-bd2a-31fcce58195c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:56.431463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d87c0c-3c74-4104-bd2a-31fcce58195c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:56.431727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d87c0c-3c74-4104-bd2a-31fcce58195c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:56.432478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d87c0c-3c74-4104-bd2a-31fcce58195c None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=e303777e78b7499fbff457254d14d360) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:56.432784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d87c0c-3c74-4104-bd2a-31fcce58195c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:56.434348 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d87c0c-3c74-4104-bd2a-31fcce58195c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:56.441519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 267/542] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:56:56 2022] GET /identity/v3/role_assignments?user.id=e303777e78b7499fbff457254d14d360&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:56.524787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:56.555005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 276/543] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:56.870463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d87c0c-3c74-4104-bd2a-31fcce58195c None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:56.895460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89777c-b3a0-4235-8869-5063c270674d None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:56.895969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89777c-b3a0-4235-8869-5063c270674d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:56.895969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89777c-b3a0-4235-8869-5063c270674d None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:56.897609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 277/544] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:56:56.917738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff936-5b15-4e2e-8fe8-531a073b7d39 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:56.918571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff936-5b15-4e2e-8fe8-531a073b7d39 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:56.918804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ff936-5b15-4e2e-8fe8-531a073b7d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:56.949251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-bf5ff936-5b15-4e2e-8fe8-531a073b7d39 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:56.950446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-bf5ff936-5b15-4e2e-8fe8-531a073b7d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:56.956586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:57.004709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d87c0c-3c74-4104-bd2a-31fcce58195c None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:57.042648 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed522bce-a565-4f74-a11b-2b8ca8195a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:57.044399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed522bce-a565-4f74-a11b-2b8ca8195a52 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:57.044757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed522bce-a565-4f74-a11b-2b8ca8195a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:57.045033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed522bce-a565-4f74-a11b-2b8ca8195a52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:57.058181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed522bce-a565-4f74-a11b-2b8ca8195a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-ed522bce-a565-4f74-a11b-2b8ca8195a52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:57.065719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:57.066601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:57.067390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 268/545] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:56:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:57.070448 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 278/546] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:57.077231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed522bce-a565-4f74-a11b-2b8ca8195a52 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:57.220407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed522bce-a565-4f74-a11b-2b8ca8195a52 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:57.272622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:57.286670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987689-3d14-4521-9ff4-61971bb517b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:57.287597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987689-3d14-4521-9ff4-61971bb517b7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:57.288038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987689-3d14-4521-9ff4-61971bb517b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:57.296437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987689-3d14-4521-9ff4-61971bb517b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:57.296437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b987689-3d14-4521-9ff4-61971bb517b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:57.296437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b987689-3d14-4521-9ff4-61971bb517b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:57.296437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b987689-3d14-4521-9ff4-61971bb517b7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:57.307555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 269/547] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:56:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:57.317345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ff936-5b15-4e2e-8fe8-531a073b7d39 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:57.442351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987689-3d14-4521-9ff4-61971bb517b7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:57.478966 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ff936-5b15-4e2e-8fe8-531a073b7d39 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:57.499338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:57.518892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bd532-663b-4fdb-8c85-6942cbfe46b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:57.519546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bd532-663b-4fdb-8c85-6942cbfe46b6 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:57.519825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bd532-663b-4fdb-8c85-6942cbfe46b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:57.520092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bd532-663b-4fdb-8c85-6942cbfe46b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:57.531547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906bd532-663b-4fdb-8c85-6942cbfe46b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:57.533029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906bd532-663b-4fdb-8c85-6942cbfe46b6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-906bd532-663b-4fdb-8c85-6942cbfe46b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:57.548466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:57.549377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:57.550712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:57.550712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:57.550712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:57.550712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 279/548] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:57.552355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ce853-40c6-42fd-b5fb-469563deb76e None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:57.552355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ce853-40c6-42fd-b5fb-469563deb76e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:57.552355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ce853-40c6-42fd-b5fb-469563deb76e None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:57.553754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 280/549] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:57.560151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5a061-1c8a-4848-a6cd-da4012e15dd9 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:57.560521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5a061-1c8a-4848-a6cd-da4012e15dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:57.560793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5a061-1c8a-4848-a6cd-da4012e15dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:57.580597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-73a5a061-1c8a-4848-a6cd-da4012e15dd9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:57.581848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-73a5a061-1c8a-4848-a6cd-da4012e15dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:57.599198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987689-3d14-4521-9ff4-61971bb517b7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:57.641423 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7753302-d569-4769-b2f8-1d06b1954018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:57.642222 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7753302-d569-4769-b2f8-1d06b1954018 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:57.642599 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7753302-d569-4769-b2f8-1d06b1954018 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:57.643127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7753302-d569-4769-b2f8-1d06b1954018 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:57.654708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7753302-d569-4769-b2f8-1d06b1954018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-d7753302-d569-4769-b2f8-1d06b1954018 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:57.661670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:57.663537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:57.665518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:57.670045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 270/550] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:56:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:56:57.670045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7753302-d569-4769-b2f8-1d06b1954018 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:57.672270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 281/551] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:57.673806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5a061-1c8a-4848-a6cd-da4012e15dd9 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:57.782218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:57.786638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5a061-1c8a-4848-a6cd-da4012e15dd9 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:57.794594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:57.831221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c0c09-138f-4cb5-91ca-15b33fb8968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:57.832255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c0c09-138f-4cb5-91ca-15b33fb8968a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:57.833553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c0c09-138f-4cb5-91ca-15b33fb8968a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:57.834026 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c0c09-138f-4cb5-91ca-15b33fb8968a None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:57.835881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c0c09-138f-4cb5-91ca-15b33fb8968a None admin] RBAC: Adding query filter params (name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:57.836422 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c0c09-138f-4cb5-91ca-15b33fb8968a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:57.841504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c0c09-138f-4cb5-91ca-15b33fb8968a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:57.860488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 282/552] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:56:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:57.865859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c0c09-138f-4cb5-91ca-15b33fb8968a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:57.885618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7753302-d569-4769-b2f8-1d06b1954018 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:57.942008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa93b7e-19af-4a36-acd7-20501a5ccf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:57.943097 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa93b7e-19af-4a36-acd7-20501a5ccf42 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:57.944779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa93b7e-19af-4a36-acd7-20501a5ccf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:57.945261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa93b7e-19af-4a36-acd7-20501a5ccf42 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:57.950446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa93b7e-19af-4a36-acd7-20501a5ccf42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:57.951059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa93b7e-19af-4a36-acd7-20501a5ccf42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:57.952751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa93b7e-19af-4a36-acd7-20501a5ccf42 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:57.982893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 271/553] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:57.989056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa93b7e-19af-4a36-acd7-20501a5ccf42 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:58.063449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c0c09-138f-4cb5-91ca-15b33fb8968a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:58.101413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa93b7e-19af-4a36-acd7-20501a5ccf42 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:58.102310 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7297b-b699-4da4-9067-d0082c91e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:58.103240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7297b-b699-4da4-9067-d0082c91e665 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:58.103797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7297b-b699-4da4-9067-d0082c91e665 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:58.104271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7297b-b699-4da4-9067-d0082c91e665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:58.116721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7297b-b699-4da4-9067-d0082c91e665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:58.117244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:58.119641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7297b-b699-4da4-9067-d0082c91e665 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-67f7297b-b699-4da4-9067-d0082c91e665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:58.135272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:58.136479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:58.137882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:58.137882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:58.137882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:58.138067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 283/554] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:58.139342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7297b-b699-4da4-9067-d0082c91e665 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:58.141973 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59d163-edf3-44c6-a2ac-968673096260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:58.142926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59d163-edf3-44c6-a2ac-968673096260 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:58.143207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59d163-edf3-44c6-a2ac-968673096260 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:58.143468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59d163-edf3-44c6-a2ac-968673096260 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:58.151707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59d163-edf3-44c6-a2ac-968673096260 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:58.153876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59d163-edf3-44c6-a2ac-968673096260 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:58.160377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-aa59d163-edf3-44c6-a2ac-968673096260 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:56:58.168051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:58.174777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 272/555] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:56:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:56:58.175673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59d163-edf3-44c6-a2ac-968673096260 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:58.257826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7297b-b699-4da4-9067-d0082c91e665 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:58.287548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59d163-edf3-44c6-a2ac-968673096260 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:58.307279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7830-97ed-4c2c-be0c-dbc8e612fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:58.309079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7830-97ed-4c2c-be0c-dbc8e612fadf None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:58.310318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7830-97ed-4c2c-be0c-dbc8e612fadf None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:58.310772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa7830-97ed-4c2c-be0c-dbc8e612fadf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:58.322435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa7830-97ed-4c2c-be0c-dbc8e612fadf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:58.329086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ae509-1d31-447e-96e3-551745d7ea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:58.329787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ae509-1d31-447e-96e3-551745d7ea2a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-3cfa7830-97ed-4c2c-be0c-dbc8e612fadf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:58.330102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:58.331311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:58.332608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:58.333241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ae509-1d31-447e-96e3-551745d7ea2a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:58.333241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ae509-1d31-447e-96e3-551745d7ea2a None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:58.333241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ae509-1d31-447e-96e3-551745d7ea2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:58.333241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ae509-1d31-447e-96e3-551745d7ea2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:58.333241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ae509-1d31-447e-96e3-551745d7ea2a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:58.335591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 284/556] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:56:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:58.336617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7830-97ed-4c2c-be0c-dbc8e612fadf None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:58.348107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 273/557] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:58.349253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ae509-1d31-447e-96e3-551745d7ea2a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:58.389547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:58.424663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:58.452538 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa7830-97ed-4c2c-be0c-dbc8e612fadf None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:58.464056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ae509-1d31-447e-96e3-551745d7ea2a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:58.491900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d54191-7252-4ee1-acf5-101e19697520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:58.492556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54191-7252-4ee1-acf5-101e19697520 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:58.492836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54191-7252-4ee1-acf5-101e19697520 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:58.493112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54191-7252-4ee1-acf5-101e19697520 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:58.493886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d54191-7252-4ee1-acf5-101e19697520 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:58.494185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d54191-7252-4ee1-acf5-101e19697520 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:58.495615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d54191-7252-4ee1-acf5-101e19697520 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:58.503079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55046424-d41a-4ee4-ac0d-7c276d955fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:58.503692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55046424-d41a-4ee4-ac0d-7c276d955fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:58.503974 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55046424-d41a-4ee4-ac0d-7c276d955fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:58.504271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55046424-d41a-4ee4-ac0d-7c276d955fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:58.504977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55046424-d41a-4ee4-ac0d-7c276d955fb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:58.505283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55046424-d41a-4ee4-ac0d-7c276d955fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:58.506668 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55046424-d41a-4ee4-ac0d-7c276d955fb8 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:58.515957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 274/558] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:56:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:58.516464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 285/559] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Aug 24 16:56:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:58.518025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78522198-5d6b-4a3d-998a-93506446b855 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:58.518493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78522198-5d6b-4a3d-998a-93506446b855 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:58.519049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78522198-5d6b-4a3d-998a-93506446b855 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:58.520630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 286/560] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:58.521030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55046424-d41a-4ee4-ac0d-7c276d955fb8 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:58.521765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78522198-5d6b-4a3d-998a-93506446b855 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:58.628826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:58.633625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78522198-5d6b-4a3d-998a-93506446b855 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:58.634536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55046424-d41a-4ee4-ac0d-7c276d955fb8 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:58.663733 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:58.671361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1f52c-cc8b-4e51-a409-b2386f5c3777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:58.671839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d377-afd0-4973-af1b-74853aab6130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:58.672049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f52c-cc8b-4e51-a409-b2386f5c3777 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:58.672305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f52c-cc8b-4e51-a409-b2386f5c3777 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:58.672516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d377-afd0-4973-af1b-74853aab6130 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:58.672613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1f52c-cc8b-4e51-a409-b2386f5c3777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:58.672815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d377-afd0-4973-af1b-74853aab6130 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:58.673124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471d377-afd0-4973-af1b-74853aab6130 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:58.681363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471d377-afd0-4973-af1b-74853aab6130 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:58.682831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471d377-afd0-4973-af1b-74853aab6130 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:58.684326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1f52c-cc8b-4e51-a409-b2386f5c3777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:58.686645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1f52c-cc8b-4e51-a409-b2386f5c3777 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-f471d377-afd0-4973-af1b-74853aab6130 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:56:58.701616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:58.702799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:58.704165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:58.704165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:58.704165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:56:58.704165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:56:58.704165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:56:58.704165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:56:58.704165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:56:58.704165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:56:58.704165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:56:58.704165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:58.707610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 275/561] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Aug 24 16:56:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:58.708294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d377-afd0-4973-af1b-74853aab6130 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-b0b1f52c-cc8b-4e51-a409-b2386f5c3777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:58.710800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:58.711994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:58.713215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:58.713215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:58.713215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:58.721242 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 287/562] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:58.721242 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ef004-657f-4ea1-b54b-ff4756a50bd6 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:58.721242 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ef004-657f-4ea1-b54b-ff4756a50bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:58.721242 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ef004-657f-4ea1-b54b-ff4756a50bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:58.748834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-092ef004-657f-4ea1-b54b-ff4756a50bd6 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:58.750861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-092ef004-657f-4ea1-b54b-ff4756a50bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:58.818028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471d377-afd0-4973-af1b-74853aab6130 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:58.853869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5ae19-1fc9-4ee9-8867-2232f7e7cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:58.854895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5ae19-1fc9-4ee9-8867-2232f7e7cc58 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:58.856026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5ae19-1fc9-4ee9-8867-2232f7e7cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:58.856504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5ae19-1fc9-4ee9-8867-2232f7e7cc58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:58.872376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 288/563] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:58.872376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ef004-657f-4ea1-b54b-ff4756a50bd6 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:58.908671 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:58.957385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5ae19-1fc9-4ee9-8867-2232f7e7cc58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:58.958992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5ae19-1fc9-4ee9-8867-2232f7e7cc58 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:58.995177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ef004-657f-4ea1-b54b-ff4756a50bd6 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:59.008742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:59.030861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d061346-8d66-4582-95b8-05e87b2ea4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:59.031482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061346-8d66-4582-95b8-05e87b2ea4ee None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.031767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061346-8d66-4582-95b8-05e87b2ea4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.032031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d061346-8d66-4582-95b8-05e87b2ea4ee None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.032804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d061346-8d66-4582-95b8-05e87b2ea4ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:59.033107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d061346-8d66-4582-95b8-05e87b2ea4ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:59.034609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d061346-8d66-4582-95b8-05e87b2ea4ee None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:59.053949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 289/564] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Aug 24 16:56:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:59.055023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d061346-8d66-4582-95b8-05e87b2ea4ee None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:59.072310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 276/565] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:56:59.073954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776915d-72ac-4903-87b6-4316410a0b69 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.074513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776915d-72ac-4903-87b6-4316410a0b69 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.074955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776915d-72ac-4903-87b6-4316410a0b69 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.076771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 277/566] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:56:59.077639 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776915d-72ac-4903-87b6-4316410a0b69 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:59.140351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:59.170540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d061346-8d66-4582-95b8-05e87b2ea4ee None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:59.186326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776915d-72ac-4903-87b6-4316410a0b69 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:59.205287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f96cfd-08f1-4bfd-ab00-be38b7b0d90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:59.205892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96cfd-08f1-4bfd-ab00-be38b7b0d90b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.206178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96cfd-08f1-4bfd-ab00-be38b7b0d90b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.206453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f96cfd-08f1-4bfd-ab00-be38b7b0d90b None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.207092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f96cfd-08f1-4bfd-ab00-be38b7b0d90b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:59.207394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f96cfd-08f1-4bfd-ab00-be38b7b0d90b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:59.208811 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f96cfd-08f1-4bfd-ab00-be38b7b0d90b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:59.220404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285acd5-f558-4266-a715-9e90d53c9890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:59.220677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 290/567] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:59.221030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285acd5-f558-4266-a715-9e90d53c9890 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.221305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285acd5-f558-4266-a715-9e90d53c9890 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.221463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f96cfd-08f1-4bfd-ab00-be38b7b0d90b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:59.221556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285acd5-f558-4266-a715-9e90d53c9890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.231968 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285acd5-f558-4266-a715-9e90d53c9890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:59.233502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285acd5-f558-4266-a715-9e90d53c9890 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-4285acd5-f558-4266-a715-9e90d53c9890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:59.247851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:59.248915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:59.249767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:59.249767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:59.249767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:59.249767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 278/568] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:59.250151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c18b-b98c-4848-88dc-ebd7aa08f3f1 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.250467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c18b-b98c-4848-88dc-ebd7aa08f3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.250687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22c18b-b98c-4848-88dc-ebd7aa08f3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.258200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:59.269019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-3b22c18b-b98c-4848-88dc-ebd7aa08f3f1 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:56:59.276757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3b22c18b-b98c-4848-88dc-ebd7aa08f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:56:59.338396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f96cfd-08f1-4bfd-ab00-be38b7b0d90b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:59.342762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 279/569] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:56:59.343618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22c18b-b98c-4848-88dc-ebd7aa08f3f1 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:59.377538 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e54b-2c97-4e7e-aceb-d10af108de03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:59.378320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e54b-2c97-4e7e-aceb-d10af108de03 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.378598 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e54b-2c97-4e7e-aceb-d10af108de03 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.378872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1e54b-2c97-4e7e-aceb-d10af108de03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.390451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:59.391878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1e54b-2c97-4e7e-aceb-d10af108de03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:59.393472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1e54b-2c97-4e7e-aceb-d10af108de03 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-e9e1e54b-2c97-4e7e-aceb-d10af108de03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:56:59.410662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:59.411880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:56:59.412974 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:56:59.412974 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:56:59.412974 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:59.413930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 291/570] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:59.414751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e54b-2c97-4e7e-aceb-d10af108de03 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:59.460413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22c18b-b98c-4848-88dc-ebd7aa08f3f1 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:59.498026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a304e-478d-49d9-bf62-3483a49bfe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:59.498720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a304e-478d-49d9-bf62-3483a49bfe2a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.498998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a304e-478d-49d9-bf62-3483a49bfe2a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.499268 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a304e-478d-49d9-bf62-3483a49bfe2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.508709 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:59.510389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a304e-478d-49d9-bf62-3483a49bfe2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-cf8a304e-478d-49d9-bf62-3483a49bfe2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:56:59.515942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:59.529499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 280/571] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:56:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:59.530321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a304e-478d-49d9-bf62-3483a49bfe2a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:59.535695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1e54b-2c97-4e7e-aceb-d10af108de03 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:59.576183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafb153-e066-4028-890e-313bb8805bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:59.576974 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafb153-e066-4028-890e-313bb8805bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.577267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafb153-e066-4028-890e-313bb8805bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.577529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafb153-e066-4028-890e-313bb8805bf9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.585309 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafb153-e066-4028-890e-313bb8805bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:59.586748 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafb153-e066-4028-890e-313bb8805bf9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-5bafb153-e066-4028-890e-313bb8805bf9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:56:59.599287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:56:59.600339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 292/572] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:56:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:56:59.601306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafb153-e066-4028-890e-313bb8805bf9 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:59.634460 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:59.639351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a304e-478d-49d9-bf62-3483a49bfe2a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:59.674108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301d2dd-d32a-4b2d-8401-dc05ac42aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:59.674715 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301d2dd-d32a-4b2d-8401-dc05ac42aa3a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.674996 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301d2dd-d32a-4b2d-8401-dc05ac42aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.675268 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301d2dd-d32a-4b2d-8401-dc05ac42aa3a None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.675905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301d2dd-d32a-4b2d-8401-dc05ac42aa3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:59.676206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301d2dd-d32a-4b2d-8401-dc05ac42aa3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:59.677640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301d2dd-d32a-4b2d-8401-dc05ac42aa3a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:59.690310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 281/573] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:59.691128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301d2dd-d32a-4b2d-8401-dc05ac42aa3a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:59.710730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafb153-e066-4028-890e-313bb8805bf9 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:59.745210 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9c39d-a169-407d-bc4d-0539391811df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:59.746297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9c39d-a169-407d-bc4d-0539391811df None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.746621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9c39d-a169-407d-bc4d-0539391811df None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.746896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9c39d-a169-407d-bc4d-0539391811df None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.747540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9c39d-a169-407d-bc4d-0539391811df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:59.747844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9c39d-a169-407d-bc4d-0539391811df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:59.749249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9c39d-a169-407d-bc4d-0539391811df None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:59.760916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 293/574] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:59.762349 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9c39d-a169-407d-bc4d-0539391811df None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:59.765116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:59.795166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301d2dd-d32a-4b2d-8401-dc05ac42aa3a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:59.830897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb68bb8-3d10-488c-9836-06b38cd01262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:59.831502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb68bb8-3d10-488c-9836-06b38cd01262 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.831778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb68bb8-3d10-488c-9836-06b38cd01262 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.832046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb68bb8-3d10-488c-9836-06b38cd01262 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.832737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb68bb8-3d10-488c-9836-06b38cd01262 None admin] RBAC: Adding query filter params (name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:59.833035 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb68bb8-3d10-488c-9836-06b38cd01262 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:59.834402 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb68bb8-3d10-488c-9836-06b38cd01262 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:59.842995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 282/575] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:56:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:59.843825 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb68bb8-3d10-488c-9836-06b38cd01262 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:59.868751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:59.874720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9c39d-a169-407d-bc4d-0539391811df None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:59.907882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce6bf4-bd1b-479e-aff5-7c64f289739c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:59.908515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce6bf4-bd1b-479e-aff5-7c64f289739c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.908795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce6bf4-bd1b-479e-aff5-7c64f289739c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.909065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce6bf4-bd1b-479e-aff5-7c64f289739c None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.909787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce6bf4-bd1b-479e-aff5-7c64f289739c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:56:59.910089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce6bf4-bd1b-479e-aff5-7c64f289739c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:56:59.911506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce6bf4-bd1b-479e-aff5-7c64f289739c None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:56:59.929205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 294/576] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Aug 24 16:56:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:56:59.930015 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce6bf4-bd1b-479e-aff5-7c64f289739c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:56:59.950659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb68bb8-3d10-488c-9836-06b38cd01262 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:56:59.986948 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fe5d0-e11e-4d96-909f-e027a5073646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:56:59.987592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fe5d0-e11e-4d96-909f-e027a5073646 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:56:59.987920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fe5d0-e11e-4d96-909f-e027a5073646 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:56:59.988203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fe5d0-e11e-4d96-909f-e027a5073646 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:56:59.991533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:56:59.999714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945fe5d0-e11e-4d96-909f-e027a5073646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-945fe5d0-e11e-4d96-909f-e027a5073646 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:00.005223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:00.006218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:00.007080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 283/577] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:56:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:00.007820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fe5d0-e11e-4d96-909f-e027a5073646 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.039890 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce6bf4-bd1b-479e-aff5-7c64f289739c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.074103 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc21a3-f540-4421-8346-d0bf192132a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.074789 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc21a3-f540-4421-8346-d0bf192132a8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.075074 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc21a3-f540-4421-8346-d0bf192132a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.075346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc21a3-f540-4421-8346-d0bf192132a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.082087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc21a3-f540-4421-8346-d0bf192132a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.083560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc21a3-f540-4421-8346-d0bf192132a8 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-f9bc21a3-f540-4421-8346-d0bf192132a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:00.095747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:00.096718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:00.097579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:00.097579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:00.097579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:00.097579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:00.097579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:00.097579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:00.097579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:00.097579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:00.097579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 295/578] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:56:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:00.098079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc21a3-f540-4421-8346-d0bf192132a8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.109483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945fe5d0-e11e-4d96-909f-e027a5073646 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.142473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f4d75-efdb-4fbf-b787-d7d83f2d5859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.143098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4d75-efdb-4fbf-b787-d7d83f2d5859 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.143377 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4d75-efdb-4fbf-b787-d7d83f2d5859 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.143647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f4d75-efdb-4fbf-b787-d7d83f2d5859 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.150084 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f4d75-efdb-4fbf-b787-d7d83f2d5859 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.151600 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f4d75-efdb-4fbf-b787-d7d83f2d5859 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-169f4d75-efdb-4fbf-b787-d7d83f2d5859 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:00.162629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:00.163588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:00.164532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:00.164532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:00.164532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:00.164532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:00.164532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:00.164532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:00.164532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:00.164532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:00.164532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 284/579] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:00.164532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f4d75-efdb-4fbf-b787-d7d83f2d5859 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.203507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc21a3-f540-4421-8346-d0bf192132a8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.237183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4d3e2-59ed-4d9f-8366-280460fd66b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.237742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d3e2-59ed-4d9f-8366-280460fd66b4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.238015 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d3e2-59ed-4d9f-8366-280460fd66b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.238285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4d3e2-59ed-4d9f-8366-280460fd66b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.248427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4d3e2-59ed-4d9f-8366-280460fd66b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.249859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4d3e2-59ed-4d9f-8366-280460fd66b4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.253846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-01f4d3e2-59ed-4d9f-8366-280460fd66b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:00.263604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:00.264658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:00.265556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:00.265556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:00.265556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:00.265556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 296/580] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:00.265556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4d3e2-59ed-4d9f-8366-280460fd66b4 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.277699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f4d75-efdb-4fbf-b787-d7d83f2d5859 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.311216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:00.313619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5daad8-6299-4301-b499-727103967f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.314062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5daad8-6299-4301-b499-727103967f62 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.314344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5daad8-6299-4301-b499-727103967f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.314615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5daad8-6299-4301-b499-727103967f62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.325430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5daad8-6299-4301-b499-727103967f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.326900 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5daad8-6299-4301-b499-727103967f62 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-8f5daad8-6299-4301-b499-727103967f62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:00.341507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:00.342990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:00.343893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:00.343893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:00.343893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:00.343893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 285/581] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:00.343893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5daad8-6299-4301-b499-727103967f62 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.361290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:00.372615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4d3e2-59ed-4d9f-8366-280460fd66b4 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.406856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0696f-48a8-4478-84a7-6dc049b6b5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.410720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0696f-48a8-4478-84a7-6dc049b6b5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.410720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0696f-48a8-4478-84a7-6dc049b6b5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.410720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0696f-48a8-4478-84a7-6dc049b6b5d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.410720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0696f-48a8-4478-84a7-6dc049b6b5d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:00.410720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0696f-48a8-4478-84a7-6dc049b6b5d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.410720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0696f-48a8-4478-84a7-6dc049b6b5d6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.419488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 297/582] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:00.420339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0696f-48a8-4478-84a7-6dc049b6b5d6 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.449366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5daad8-6299-4301-b499-727103967f62 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.456085 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:00.484379 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cf2d4-220c-4a74-9d25-d93f9ae2b6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.485104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cf2d4-220c-4a74-9d25-d93f9ae2b6eb None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.485324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cf2d4-220c-4a74-9d25-d93f9ae2b6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.485597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cf2d4-220c-4a74-9d25-d93f9ae2b6eb None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.486289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cf2d4-220c-4a74-9d25-d93f9ae2b6eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:00.486596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cf2d4-220c-4a74-9d25-d93f9ae2b6eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.488088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cf2d4-220c-4a74-9d25-d93f9ae2b6eb None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.500103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 286/583] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:00.500941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cf2d4-220c-4a74-9d25-d93f9ae2b6eb None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.522509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0696f-48a8-4478-84a7-6dc049b6b5d6 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.557193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:00.560816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf71fb-ff52-494a-a827-e1414210f8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.561427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf71fb-ff52-494a-a827-e1414210f8fb None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.561706 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf71fb-ff52-494a-a827-e1414210f8fb None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.561978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf71fb-ff52-494a-a827-e1414210f8fb None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.562669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf71fb-ff52-494a-a827-e1414210f8fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:00.562977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf71fb-ff52-494a-a827-e1414210f8fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.564439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf71fb-ff52-494a-a827-e1414210f8fb None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.576091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 298/584] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:00.576999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf71fb-ff52-494a-a827-e1414210f8fb None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.606154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cf2d4-220c-4a74-9d25-d93f9ae2b6eb None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.640864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fe2aa-ddec-4402-b640-9b1b2c8e5d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.641482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fe2aa-ddec-4402-b640-9b1b2c8e5d34 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.641756 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fe2aa-ddec-4402-b640-9b1b2c8e5d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.642033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fe2aa-ddec-4402-b640-9b1b2c8e5d34 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.642682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fe2aa-ddec-4402-b640-9b1b2c8e5d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:00.642984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fe2aa-ddec-4402-b640-9b1b2c8e5d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.644378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fe2aa-ddec-4402-b640-9b1b2c8e5d34 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.656464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 287/585] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:00.657272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fe2aa-ddec-4402-b640-9b1b2c8e5d34 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.675926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:00.683012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf71fb-ff52-494a-a827-e1414210f8fb None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.719033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea34d91-6725-4128-94b5-d810a3a6bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.719645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34d91-6725-4128-94b5-d810a3a6bb9a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.719923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34d91-6725-4128-94b5-d810a3a6bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.720196 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea34d91-6725-4128-94b5-d810a3a6bb9a None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.720880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea34d91-6725-4128-94b5-d810a3a6bb9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:00.721181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea34d91-6725-4128-94b5-d810a3a6bb9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.722542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea34d91-6725-4128-94b5-d810a3a6bb9a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.733827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 299/586] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:00.734605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea34d91-6725-4128-94b5-d810a3a6bb9a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.761282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fe2aa-ddec-4402-b640-9b1b2c8e5d34 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.774568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:00.796730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1e798-2a0e-4ef0-b7a3-6bb8332e6c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.797372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e798-2a0e-4ef0-b7a3-6bb8332e6c46 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.797647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e798-2a0e-4ef0-b7a3-6bb8332e6c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.797915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1e798-2a0e-4ef0-b7a3-6bb8332e6c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.809323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1e798-2a0e-4ef0-b7a3-6bb8332e6c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.811073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1e798-2a0e-4ef0-b7a3-6bb8332e6c46 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-58d1e798-2a0e-4ef0-b7a3-6bb8332e6c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:00.825922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:00.826901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:00.827813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:00.827813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:00.827813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:00.827813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 288/587] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:00.827813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1e798-2a0e-4ef0-b7a3-6bb8332e6c46 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.842463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea34d91-6725-4128-94b5-d810a3a6bb9a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.876054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd13fc-c221-449d-bddb-e89cd90b9ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.876751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd13fc-c221-449d-bddb-e89cd90b9ea4 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.877030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd13fc-c221-449d-bddb-e89cd90b9ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.877302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd13fc-c221-449d-bddb-e89cd90b9ea4 None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/8af51476b48e45efbc3b626f9780e0be/roles/fd16473b81a24082b019c8d3effe2e66` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.892542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd13fc-c221-449d-bddb-e89cd90b9ea4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=8af51476b48e45efbc3b626f9780e0be, role_id=fd16473b81a24082b019c8d3effe2e66)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.894112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bd13fc-c221-449d-bddb-e89cd90b9ea4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.933162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1e798-2a0e-4ef0-b7a3-6bb8332e6c46 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:00.960677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 300/588] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:57:00 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/8af51476b48e45efbc3b626f9780e0be/roles/fd16473b81a24082b019c8d3effe2e66 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:57:00.961540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd13fc-c221-449d-bddb-e89cd90b9ea4 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:00.965830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:00.979430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e09d6-9f51-4f13-a93f-34029f0114ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:00.980074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e09d6-9f51-4f13-a93f-34029f0114ea None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:00.980425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e09d6-9f51-4f13-a93f-34029f0114ea None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:00.980732 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e09d6-9f51-4f13-a93f-34029f0114ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:00.981524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e09d6-9f51-4f13-a93f-34029f0114ea None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=84368e89b0b34a54996def03671a1454) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:00.981841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e09d6-9f51-4f13-a93f-34029f0114ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:00.983467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e09d6-9f51-4f13-a93f-34029f0114ea None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:00.990401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 289/589] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/role_assignments?user.id=84368e89b0b34a54996def03671a1454&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:00.991069 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e09d6-9f51-4f13-a93f-34029f0114ea None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:01.024468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:01.095798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd13fc-c221-449d-bddb-e89cd90b9ea4 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:01.121916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e09d6-9f51-4f13-a93f-34029f0114ea None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:01.145778 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b48925-a944-47b2-823e-458102a5ae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:01.146435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48925-a944-47b2-823e-458102a5ae57 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:01.146712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48925-a944-47b2-823e-458102a5ae57 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:01.146981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b48925-a944-47b2-823e-458102a5ae57 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:01.157859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b48925-a944-47b2-823e-458102a5ae57 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:01.159751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b48925-a944-47b2-823e-458102a5ae57 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:01.170678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a72e75-1175-4c0b-822c-a0d59d96e2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:01.171344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a72e75-1175-4c0b-822c-a0d59d96e2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:01.171623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a72e75-1175-4c0b-822c-a0d59d96e2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:01.171899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a72e75-1175-4c0b-822c-a0d59d96e2d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-07b48925-a944-47b2-823e-458102a5ae57 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:01.175712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:01.176713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:01.177679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:01.177679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:01.177679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:01.177679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:01.177679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:01.177679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:01.177679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:01.177679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:01.177679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:57:01.177679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:01.177679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 301/590] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:01.178952 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b48925-a944-47b2-823e-458102a5ae57 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:01.181923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a72e75-1175-4c0b-822c-a0d59d96e2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:01.183956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a72e75-1175-4c0b-822c-a0d59d96e2d7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-c1a72e75-1175-4c0b-822c-a0d59d96e2d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:01.200114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:01.201187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:01.202051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:01.202051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:01.202051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:01.202051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:01.202051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:01.202051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:01.202051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:01.202051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:01.202051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 290/591] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:01.202051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a72e75-1175-4c0b-822c-a0d59d96e2d7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:01.267755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:01.319645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:01.321966 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b48925-a944-47b2-823e-458102a5ae57 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:01.333773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a72e75-1175-4c0b-822c-a0d59d96e2d7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:01.359527 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1a400-dc1e-4013-b5d0-e4a4a00adf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:01.360542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a400-dc1e-4013-b5d0-e4a4a00adf46 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:01.361020 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a400-dc1e-4013-b5d0-e4a4a00adf46 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:01.361490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1a400-dc1e-4013-b5d0-e4a4a00adf46 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:01.362367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1a400-dc1e-4013-b5d0-e4a4a00adf46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:01.362875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1a400-dc1e-4013-b5d0-e4a4a00adf46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:01.364473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1a400-dc1e-4013-b5d0-e4a4a00adf46 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:01.374411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdde98-e7ff-441f-ae22-8153f62f06ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:01.375012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdde98-e7ff-441f-ae22-8153f62f06ac None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:01.375297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdde98-e7ff-441f-ae22-8153f62f06ac None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:01.375568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdde98-e7ff-441f-ae22-8153f62f06ac None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:01.376409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdde98-e7ff-441f-ae22-8153f62f06ac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:01.376738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdde98-e7ff-441f-ae22-8153f62f06ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:01.378172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdde98-e7ff-441f-ae22-8153f62f06ac None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:01.379327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 302/592] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:01.380606 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1a400-dc1e-4013-b5d0-e4a4a00adf46 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:01.399165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 291/593] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Aug 24 16:57:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:01.400159 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdde98-e7ff-441f-ae22-8153f62f06ac None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:01.487973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1a400-dc1e-4013-b5d0-e4a4a00adf46 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:01.514167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdde98-e7ff-441f-ae22-8153f62f06ac None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:01.516649 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:01.524919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ca0c1-a261-4b9a-ba9e-c42e2955992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:01.525816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ca0c1-a261-4b9a-ba9e-c42e2955992a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:01.526376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ca0c1-a261-4b9a-ba9e-c42e2955992a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:01.526902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ca0c1-a261-4b9a-ba9e-c42e2955992a None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:01.528433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ca0c1-a261-4b9a-ba9e-c42e2955992a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:01.528900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ca0c1-a261-4b9a-ba9e-c42e2955992a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:01.530708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ca0c1-a261-4b9a-ba9e-c42e2955992a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:01.544250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 303/594] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:01.545624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ca0c1-a261-4b9a-ba9e-c42e2955992a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:01.551807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9b15a-6e09-4792-84e5-3b952ea0c37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:01.552485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b15a-6e09-4792-84e5-3b952ea0c37d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:01.552828 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b15a-6e09-4792-84e5-3b952ea0c37d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:01.553108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b15a-6e09-4792-84e5-3b952ea0c37d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:01.561956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9b15a-6e09-4792-84e5-3b952ea0c37d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:01.563494 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9b15a-6e09-4792-84e5-3b952ea0c37d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-def9b15a-6e09-4792-84e5-3b952ea0c37d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:01.576880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:01.577871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:01.578764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:01.578764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:01.578764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:01.578764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:01.578764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:01.578764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:01.578764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:01.578764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:01.578764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:57:01.578764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:01.578764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 292/595] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:57:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:01.579347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9b15a-6e09-4792-84e5-3b952ea0c37d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:01.589971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:01.662228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ca0c1-a261-4b9a-ba9e-c42e2955992a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:01.690890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9b15a-6e09-4792-84e5-3b952ea0c37d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:01.701051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74740e-e5e3-4b4f-b1b3-875eaab913c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:01.702008 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74740e-e5e3-4b4f-b1b3-875eaab913c0 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:01.702579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74740e-e5e3-4b4f-b1b3-875eaab913c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:01.703075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74740e-e5e3-4b4f-b1b3-875eaab913c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:01.715742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74740e-e5e3-4b4f-b1b3-875eaab913c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:01.717652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74740e-e5e3-4b4f-b1b3-875eaab913c0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:01.727437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4be22-cd03-46b9-b269-dcd2beb065f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:01.728347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4be22-cd03-46b9-b269-dcd2beb065f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:01.728610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4be22-cd03-46b9-b269-dcd2beb065f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:01.728961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4be22-cd03-46b9-b269-dcd2beb065f5 None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/1684abe7e6aa44a0873e43dfc146c1b3/roles/fd16473b81a24082b019c8d3effe2e66` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-ae74740e-e5e3-4b4f-b1b3-875eaab913c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:01.734583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:01.735485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:01.736410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:01.736410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:01.736410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:01.738592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 304/596] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:01.739563 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74740e-e5e3-4b4f-b1b3-875eaab913c0 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:01.744256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4be22-cd03-46b9-b269-dcd2beb065f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=1684abe7e6aa44a0873e43dfc146c1b3, role_id=fd16473b81a24082b019c8d3effe2e66)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:01.746435 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4be22-cd03-46b9-b269-dcd2beb065f5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:01.779031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:01.810582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 293/597] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:57:01 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/1684abe7e6aa44a0873e43dfc146c1b3/roles/fd16473b81a24082b019c8d3effe2e66 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:57:01.811598 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4be22-cd03-46b9-b269-dcd2beb065f5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:01.878634 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74740e-e5e3-4b4f-b1b3-875eaab913c0 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:01.896894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:01.949911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4be22-cd03-46b9-b269-dcd2beb065f5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:01.993445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46e71-eb4d-4a7b-9436-1f74caa6d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:01.994104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46e71-eb4d-4a7b-9436-1f74caa6d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:01.994401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46e71-eb4d-4a7b-9436-1f74caa6d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:01.994684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46e71-eb4d-4a7b-9436-1f74caa6d9b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:01.995355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a46e71-eb4d-4a7b-9436-1f74caa6d9b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:01.995654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a46e71-eb4d-4a7b-9436-1f74caa6d9b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:01.998187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a46e71-eb4d-4a7b-9436-1f74caa6d9b0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:02.008121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607a4c-3cf4-400e-958c-13d20129849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:02.008769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607a4c-3cf4-400e-958c-13d20129849b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:02.009049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607a4c-3cf4-400e-958c-13d20129849b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:02.009318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607a4c-3cf4-400e-958c-13d20129849b None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:02.010057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb607a4c-3cf4-400e-958c-13d20129849b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:02.010476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb607a4c-3cf4-400e-958c-13d20129849b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:02.012370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb607a4c-3cf4-400e-958c-13d20129849b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:02.013834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 294/598] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:02.020698 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46e71-eb4d-4a7b-9436-1f74caa6d9b0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:02.044996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 305/599] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Aug 24 16:57:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:02.046144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607a4c-3cf4-400e-958c-13d20129849b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:02.164638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:02.174965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607a4c-3cf4-400e-958c-13d20129849b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:02.191044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46e71-eb4d-4a7b-9436-1f74caa6d9b0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:02.221004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef48b2-84a3-4a8e-9d75-ed2ef24e024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:02.221980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef48b2-84a3-4a8e-9d75-ed2ef24e024a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:02.223803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef48b2-84a3-4a8e-9d75-ed2ef24e024a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:02.224526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef48b2-84a3-4a8e-9d75-ed2ef24e024a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:02.226853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:02.253536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef48b2-84a3-4a8e-9d75-ed2ef24e024a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:02.256658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef48b2-84a3-4a8e-9d75-ed2ef24e024a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:02.274487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc74dc-074c-43a4-aaa3-4aa8184f86d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:02.275414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc74dc-074c-43a4-aaa3-4aa8184f86d7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:02.275855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc74dc-074c-43a4-aaa3-4aa8184f86d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:02.276296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc74dc-074c-43a4-aaa3-4aa8184f86d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-04ef48b2-84a3-4a8e-9d75-ed2ef24e024a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:02.287826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:02.289227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:02.290141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:02.290141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:02.290141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:02.295223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 306/600] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:02.296771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc74dc-074c-43a4-aaa3-4aa8184f86d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:02.298411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc74dc-074c-43a4-aaa3-4aa8184f86d7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:02.305496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef48b2-84a3-4a8e-9d75-ed2ef24e024a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-e7bc74dc-074c-43a4-aaa3-4aa8184f86d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:02.327463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:02.328687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:02.329821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:02.329821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:02.329821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:02.329821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:02.329821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:02.329821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:02.329821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:02.329821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:02.329821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 295/601] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:02.337203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc74dc-074c-43a4-aaa3-4aa8184f86d7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:02.470215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef48b2-84a3-4a8e-9d75-ed2ef24e024a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:02.505979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc74dc-074c-43a4-aaa3-4aa8184f86d7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:02.549551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3ec2-a4ec-4093-8dab-081efdb8b5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:02.550936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3ec2-a4ec-4093-8dab-081efdb8b5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:02.551713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2732cc-dda8-4d2c-a4b4-7a1fadac117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:02.552567 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3ec2-a4ec-4093-8dab-081efdb8b5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:02.552994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2732cc-dda8-4d2c-a4b4-7a1fadac117c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:02.553432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f3ec2-a4ec-4093-8dab-081efdb8b5f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:02.553863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2732cc-dda8-4d2c-a4b4-7a1fadac117c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:02.554723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f3ec2-a4ec-4093-8dab-081efdb8b5f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:02.555196 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2732cc-dda8-4d2c-a4b4-7a1fadac117c None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:02.555998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2732cc-dda8-4d2c-a4b4-7a1fadac117c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:02.556486 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f3ec2-a4ec-4093-8dab-081efdb8b5f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:02.558146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f3ec2-a4ec-4093-8dab-081efdb8b5f2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:02.559507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2732cc-dda8-4d2c-a4b4-7a1fadac117c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:02.561350 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2732cc-dda8-4d2c-a4b4-7a1fadac117c None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:02.589341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 307/602] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:02.589986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 296/603] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:02.594200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3ec2-a4ec-4093-8dab-081efdb8b5f2 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:02.595218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2732cc-dda8-4d2c-a4b4-7a1fadac117c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:02.616907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:02.656445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:02.749669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f3ec2-a4ec-4093-8dab-081efdb8b5f2 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:02.801059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5229fba-ad06-4e65-bdfb-d4337e69554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:02.802034 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229fba-ad06-4e65-bdfb-d4337e69554c None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:02.802479 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229fba-ad06-4e65-bdfb-d4337e69554c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:02.803000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5229fba-ad06-4e65-bdfb-d4337e69554c None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/009e5ad7d256449495c74dad67741f3f/roles/fd16473b81a24082b019c8d3effe2e66` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:02.806765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2732cc-dda8-4d2c-a4b4-7a1fadac117c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:02.829665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5229fba-ad06-4e65-bdfb-d4337e69554c None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=009e5ad7d256449495c74dad67741f3f, role_id=fd16473b81a24082b019c8d3effe2e66)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:02.831138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5229fba-ad06-4e65-bdfb-d4337e69554c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:02.843154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500bb27-d979-40dd-9fd2-7f4e391021dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:02.843858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500bb27-d979-40dd-9fd2-7f4e391021dd None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:02.844134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500bb27-d979-40dd-9fd2-7f4e391021dd None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:02.854404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500bb27-d979-40dd-9fd2-7f4e391021dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:02.854404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500bb27-d979-40dd-9fd2-7f4e391021dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:02.854404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500bb27-d979-40dd-9fd2-7f4e391021dd None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-7500bb27-d979-40dd-9fd2-7f4e391021dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:02.865832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:02.866750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:02.867647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:02.867647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:02.867647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:02.867647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:02.867647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:02.867647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:02.867647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:02.867647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:02.867647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 308/604] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:02.873825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500bb27-d979-40dd-9fd2-7f4e391021dd None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:02.943866 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:02.979933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500bb27-d979-40dd-9fd2-7f4e391021dd None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:03.016819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca7ef4-e178-4f2d-9aab-079250f15d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:03.017380 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca7ef4-e178-4f2d-9aab-079250f15d0d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:03.017659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca7ef4-e178-4f2d-9aab-079250f15d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:03.017933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca7ef4-e178-4f2d-9aab-079250f15d0d None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:03.018618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca7ef4-e178-4f2d-9aab-079250f15d0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:03.018920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca7ef4-e178-4f2d-9aab-079250f15d0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:03.020463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca7ef4-e178-4f2d-9aab-079250f15d0d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:03.033517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 309/605] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:03.039099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca7ef4-e178-4f2d-9aab-079250f15d0d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:03.046380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 297/606] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:57:02 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/009e5ad7d256449495c74dad67741f3f/roles/fd16473b81a24082b019c8d3effe2e66 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:57:03.099004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d89fb1-9b00-4d0e-8db1-1accf59dd8c0 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:03.099290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d89fb1-9b00-4d0e-8db1-1accf59dd8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:03.099570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d89fb1-9b00-4d0e-8db1-1accf59dd8c0 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:03.101419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 298/607] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:03.108063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1c0ef-c25c-4c1f-a80f-008ce03c44d2 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:03.108365 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1c0ef-c25c-4c1f-a80f-008ce03c44d2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:03.108641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1c0ef-c25c-4c1f-a80f-008ce03c44d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:03.145417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-98b1c0ef-c25c-4c1f-a80f-008ce03c44d2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:03.146804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-98b1c0ef-c25c-4c1f-a80f-008ce03c44d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:03.193413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca7ef4-e178-4f2d-9aab-079250f15d0d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:03.224676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:03.234737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e050add-4396-4167-b2d5-356c81424486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:03.238701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050add-4396-4167-b2d5-356c81424486 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:03.238701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050add-4396-4167-b2d5-356c81424486 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:03.238701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050add-4396-4167-b2d5-356c81424486 None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/e303777e78b7499fbff457254d14d360/roles/fd16473b81a24082b019c8d3effe2e66` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:03.242233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 299/608] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:57:03.243604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890bb3-490c-4cce-ae90-d5f7c69f2230 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:03.243884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890bb3-490c-4cce-ae90-d5f7c69f2230 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:03.244214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd890bb3-490c-4cce-ae90-d5f7c69f2230 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:03.245853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 300/609] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:03.251799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3968c-d501-4777-85f6-790482c5b3eb None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:03.252086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3968c-d501-4777-85f6-790482c5b3eb None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:03.252388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3968c-d501-4777-85f6-790482c5b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:03.256936 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e050add-4396-4167-b2d5-356c81424486 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=e303777e78b7499fbff457254d14d360, role_id=fd16473b81a24082b019c8d3effe2e66)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:03.258845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e050add-4396-4167-b2d5-356c81424486 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:03.288324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-16b3968c-d501-4777-85f6-790482c5b3eb None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:03.288324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-16b3968c-d501-4777-85f6-790482c5b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:03.298762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:03.348887 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 301/610] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:03.394508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 310/611] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:57:03 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/e303777e78b7499fbff457254d14d360/roles/fd16473b81a24082b019c8d3effe2e66 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:57:03.533640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3968c-d501-4777-85f6-790482c5b3eb None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:03.644748 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e050add-4396-4167-b2d5-356c81424486 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:03.668571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3968c-d501-4777-85f6-790482c5b3eb None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:03.708557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac6dc7-31dc-445c-bd28-963d5b20d1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:03.709166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac6dc7-31dc-445c-bd28-963d5b20d1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:03.709447 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac6dc7-31dc-445c-bd28-963d5b20d1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:03.709718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac6dc7-31dc-445c-bd28-963d5b20d1c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:03.721554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac6dc7-31dc-445c-bd28-963d5b20d1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-62ac6dc7-31dc-445c-bd28-963d5b20d1c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:03.726623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:03.727557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:03.728409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 302/612] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:57:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:03.734365 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac6dc7-31dc-445c-bd28-963d5b20d1c3 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:03.743995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:03.770410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e050add-4396-4167-b2d5-356c81424486 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:03.821001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111bf3a-31e8-45b7-914c-48ef115130f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:03.822130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111bf3a-31e8-45b7-914c-48ef115130f9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:03.822586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111bf3a-31e8-45b7-914c-48ef115130f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:03.823030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111bf3a-31e8-45b7-914c-48ef115130f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:03.837656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111bf3a-31e8-45b7-914c-48ef115130f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-5111bf3a-31e8-45b7-914c-48ef115130f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:03.848257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:03.849192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:03.850025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:03.850641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 311/613] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:57:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:03.858580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac6dc7-31dc-445c-bd28-963d5b20d1c3 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:03.860915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111bf3a-31e8-45b7-914c-48ef115130f9 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:03.923646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a93b3-dd9e-4e24-a6fe-8354d3ef8687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:03.924179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a93b3-dd9e-4e24-a6fe-8354d3ef8687 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:03.924547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a93b3-dd9e-4e24-a6fe-8354d3ef8687 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:03.924818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a93b3-dd9e-4e24-a6fe-8354d3ef8687 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:03.925550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a93b3-dd9e-4e24-a6fe-8354d3ef8687 None admin] RBAC: Adding query filter params (name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:03.925967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a93b3-dd9e-4e24-a6fe-8354d3ef8687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:03.927446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a93b3-dd9e-4e24-a6fe-8354d3ef8687 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:03.938546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 303/614] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:57:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:03.944609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a93b3-dd9e-4e24-a6fe-8354d3ef8687 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:03.958160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:04.026502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:04.088560 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a93b3-dd9e-4e24-a6fe-8354d3ef8687 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:04.113852 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111bf3a-31e8-45b7-914c-48ef115130f9 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:04.158406 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f810b5d-b2c9-40b8-a7df-33bc4d1d1019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:04.159100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f810b5d-b2c9-40b8-a7df-33bc4d1d1019 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:04.159382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f810b5d-b2c9-40b8-a7df-33bc4d1d1019 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:04.159658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f810b5d-b2c9-40b8-a7df-33bc4d1d1019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:04.166008 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685056e7-3786-4369-a575-0d9158bc9bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:04.166645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685056e7-3786-4369-a575-0d9158bc9bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:04.166923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685056e7-3786-4369-a575-0d9158bc9bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:04.167346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685056e7-3786-4369-a575-0d9158bc9bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:04.172739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685056e7-3786-4369-a575-0d9158bc9bd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:04.173051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685056e7-3786-4369-a575-0d9158bc9bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:04.174504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685056e7-3786-4369-a575-0d9158bc9bd7 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:04.184919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f810b5d-b2c9-40b8-a7df-33bc4d1d1019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:04.186378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f810b5d-b2c9-40b8-a7df-33bc4d1d1019 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:04.191051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 312/615] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:57:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:04.196348 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685056e7-3786-4369-a575-0d9158bc9bd7 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-0f810b5d-b2c9-40b8-a7df-33bc4d1d1019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:04.212821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:04.213803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:04.215446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:04.215446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:04.215446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:04.215446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 304/616] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:04.216139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e76fef-6d97-4ce4-8813-f506381ddc41 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:04.216381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e76fef-6d97-4ce4-8813-f506381ddc41 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:04.220248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e76fef-6d97-4ce4-8813-f506381ddc41 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:04.220248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 305/617] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:04.221405 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e76fef-6d97-4ce4-8813-f506381ddc41 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:04.319330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685056e7-3786-4369-a575-0d9158bc9bd7 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:04.333937 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e76fef-6d97-4ce4-8813-f506381ddc41 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:04.334539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:04.356885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:04.357081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b7113-17eb-457f-9895-e5ae3a91d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:04.357526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b7113-17eb-457f-9895-e5ae3a91d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:04.357807 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b7113-17eb-457f-9895-e5ae3a91d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:04.358081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b7113-17eb-457f-9895-e5ae3a91d4e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:04.369349 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b7113-17eb-457f-9895-e5ae3a91d4e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:04.371095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b7113-17eb-457f-9895-e5ae3a91d4e7 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:04.372366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce7bf8-e21a-4867-a5f2-891371aa34f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:04.372991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7bf8-e21a-4867-a5f2-891371aa34f4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:04.373275 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7bf8-e21a-4867-a5f2-891371aa34f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:04.373551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7bf8-e21a-4867-a5f2-891371aa34f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:04.374220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce7bf8-e21a-4867-a5f2-891371aa34f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:04.374530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce7bf8-e21a-4867-a5f2-891371aa34f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:04.376055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce7bf8-e21a-4867-a5f2-891371aa34f4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-ce5b7113-17eb-457f-9895-e5ae3a91d4e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:04.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:04.388409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:04.389498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:04.389498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:04.389498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:04.389498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 313/618] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:04.390329 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 306/619] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:04.390479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32e986-0d01-4ce6-86ff-ec4ceb5bb9da None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:04.390625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32e986-0d01-4ce6-86ff-ec4ceb5bb9da None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:04.395590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32e986-0d01-4ce6-86ff-ec4ceb5bb9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:04.396905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce7bf8-e21a-4867-a5f2-891371aa34f4 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:04.415298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5b32e986-0d01-4ce6-86ff-ec4ceb5bb9da None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:04.416546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5b32e986-0d01-4ce6-86ff-ec4ceb5bb9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:04.513660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 314/620] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:04.514879 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32e986-0d01-4ce6-86ff-ec4ceb5bb9da None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:04.522408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce7bf8-e21a-4867-a5f2-891371aa34f4 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:04.601017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9ae7-ea88-4d44-be69-bd1727b69341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:04.601662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9ae7-ea88-4d44-be69-bd1727b69341 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:04.601943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9ae7-ea88-4d44-be69-bd1727b69341 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:04.602217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b9ae7-ea88-4d44-be69-bd1727b69341 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:04.610286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:04.617302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b9ae7-ea88-4d44-be69-bd1727b69341 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:04.618887 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b9ae7-ea88-4d44-be69-bd1727b69341 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:04.631466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32e986-0d01-4ce6-86ff-ec4ceb5bb9da None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-164b9ae7-ea88-4d44-be69-bd1727b69341 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:04.640213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:04.641468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:04.642441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:04.642441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:04.642441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:04.642441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:04.642441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:04.642441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:04.642441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:04.642441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:04.642441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:57:04.642441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:04.648774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 307/621] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Aug 24 16:57:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:04.655418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9ae7-ea88-4d44-be69-bd1727b69341 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:04.693962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27d70d-041a-45ed-81bb-3ab408a3dfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:04.694628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27d70d-041a-45ed-81bb-3ab408a3dfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:04.694913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27d70d-041a-45ed-81bb-3ab408a3dfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:04.695184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27d70d-041a-45ed-81bb-3ab408a3dfc8 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:04.697124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27d70d-041a-45ed-81bb-3ab408a3dfc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:04.697437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27d70d-041a-45ed-81bb-3ab408a3dfc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:04.701394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27d70d-041a-45ed-81bb-3ab408a3dfc8 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:04.731031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 315/622] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:04.736681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27d70d-041a-45ed-81bb-3ab408a3dfc8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:04.741587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:04.836645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b9ae7-ea88-4d44-be69-bd1727b69341 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:04.903760 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2472c-fec3-4701-9fc7-d2d57b3c6192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:04.904649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2472c-fec3-4701-9fc7-d2d57b3c6192 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:04.904933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2472c-fec3-4701-9fc7-d2d57b3c6192 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:04.905481 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2472c-fec3-4701-9fc7-d2d57b3c6192 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:04.906027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2472c-fec3-4701-9fc7-d2d57b3c6192 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:04.906374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2472c-fec3-4701-9fc7-d2d57b3c6192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:04.907937 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2472c-fec3-4701-9fc7-d2d57b3c6192 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:04.925691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27d70d-041a-45ed-81bb-3ab408a3dfc8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:04.927380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 308/623] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Aug 24 16:57:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:04.928198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2472c-fec3-4701-9fc7-d2d57b3c6192 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:04.963812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e4161-9929-4567-b89a-c500b021048a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:04.965614 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e4161-9929-4567-b89a-c500b021048a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:04.966171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e4161-9929-4567-b89a-c500b021048a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:04.966672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e4161-9929-4567-b89a-c500b021048a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:04.976918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e4161-9929-4567-b89a-c500b021048a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:04.978734 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e4161-9929-4567-b89a-c500b021048a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:04.984574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-a24e4161-9929-4567-b89a-c500b021048a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:04.994022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:04.994970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:04.996024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:04.996024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:04.996024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:04.996024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:04.996024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:04.996024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:04.996024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:04.996024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:04.996024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:57:04.996024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:05.003211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 316/624] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:05.004417 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e4161-9929-4567-b89a-c500b021048a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:05.038842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:05.043591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2472c-fec3-4701-9fc7-d2d57b3c6192 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:05.081523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba851cd-264d-4b51-a482-8e5b651e0b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:05.082206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba851cd-264d-4b51-a482-8e5b651e0b5d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.082419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba851cd-264d-4b51-a482-8e5b651e0b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.082696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba851cd-264d-4b51-a482-8e5b651e0b5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.094769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba851cd-264d-4b51-a482-8e5b651e0b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-9ba851cd-264d-4b51-a482-8e5b651e0b5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:05.099859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:05.100798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:05.101636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 309/625] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:57:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:05.102334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba851cd-264d-4b51-a482-8e5b651e0b5d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:05.124076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e4161-9929-4567-b89a-c500b021048a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:05.162594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e44352-b188-4f52-9eeb-c4a708bce3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:05.163580 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e44352-b188-4f52-9eeb-c4a708bce3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.164057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e44352-b188-4f52-9eeb-c4a708bce3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.164648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e44352-b188-4f52-9eeb-c4a708bce3f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.220719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba851cd-264d-4b51-a482-8e5b651e0b5d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:05.238588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:05.241592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e44352-b188-4f52-9eeb-c4a708bce3f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:05.243351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e44352-b188-4f52-9eeb-c4a708bce3f4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:05.257485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9c534-1c98-4700-83ad-cc6aec2a801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:05.258096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9c534-1c98-4700-83ad-cc6aec2a801a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.258374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9c534-1c98-4700-83ad-cc6aec2a801a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.258642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9c534-1c98-4700-83ad-cc6aec2a801a None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.259456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9c534-1c98-4700-83ad-cc6aec2a801a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:05.259665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9c534-1c98-4700-83ad-cc6aec2a801a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:05.261842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9c534-1c98-4700-83ad-cc6aec2a801a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:05.286932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 310/626] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Aug 24 16:57:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:05.286932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9c534-1c98-4700-83ad-cc6aec2a801a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:05.303789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:05.362025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 317/627] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:05.362790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e44352-b188-4f52-9eeb-c4a708bce3f4 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:05.404839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9c534-1c98-4700-83ad-cc6aec2a801a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:05.443697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e468dbe-9b21-4b05-9696-cbb3a8214d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:05.444350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468dbe-9b21-4b05-9696-cbb3a8214d69 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.444686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468dbe-9b21-4b05-9696-cbb3a8214d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.445011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468dbe-9b21-4b05-9696-cbb3a8214d69 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.445683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e468dbe-9b21-4b05-9696-cbb3a8214d69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:05.445983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e468dbe-9b21-4b05-9696-cbb3a8214d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:05.447348 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e468dbe-9b21-4b05-9696-cbb3a8214d69 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:05.457350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 311/628] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:57:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:05.458566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcebce-20cb-4ddb-b7a1-392fabfdffc2 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.458843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcebce-20cb-4ddb-b7a1-392fabfdffc2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.459116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcebce-20cb-4ddb-b7a1-392fabfdffc2 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.463743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 312/629] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:05.463743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcebce-20cb-4ddb-b7a1-392fabfdffc2 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:05.477989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:05.482224 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e44352-b188-4f52-9eeb-c4a708bce3f4 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:05.520392 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e80d8d-3321-45e9-bfc4-7f22de4da615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:05.521039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e80d8d-3321-45e9-bfc4-7f22de4da615 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.521327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e80d8d-3321-45e9-bfc4-7f22de4da615 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.521586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e80d8d-3321-45e9-bfc4-7f22de4da615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.532537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e80d8d-3321-45e9-bfc4-7f22de4da615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:05.533991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e80d8d-3321-45e9-bfc4-7f22de4da615 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:05.546702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-80e80d8d-3321-45e9-bfc4-7f22de4da615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:05.549489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:05.550594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:05.551612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:05.551612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:05.551612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:05.551612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 318/630] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:05.551845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e80d8d-3321-45e9-bfc4-7f22de4da615 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:05.573474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcebce-20cb-4ddb-b7a1-392fabfdffc2 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:05.614852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24d657-4644-4087-bc17-0efd7d6a032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:05.615745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d657-4644-4087-bc17-0efd7d6a032f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.616258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d657-4644-4087-bc17-0efd7d6a032f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.616703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d657-4644-4087-bc17-0efd7d6a032f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.628778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24d657-4644-4087-bc17-0efd7d6a032f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:05.630609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24d657-4644-4087-bc17-0efd7d6a032f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-0a24d657-4644-4087-bc17-0efd7d6a032f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:05.646239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:05.647407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:05.648489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:05.648489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:05.648489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:05.649841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 313/631] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:05.651183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161590fb-718a-41a7-95ea-b656cbca657c None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.651606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161590fb-718a-41a7-95ea-b656cbca657c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.652054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161590fb-718a-41a7-95ea-b656cbca657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.669296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e80d8d-3321-45e9-bfc4-7f22de4da615 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:05.671338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-161590fb-718a-41a7-95ea-b656cbca657c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:05.672762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-161590fb-718a-41a7-95ea-b656cbca657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:05.713559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5a5c2-f6d8-4e48-ab0d-fc07f08315b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:05.714193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5a5c2-f6d8-4e48-ab0d-fc07f08315b1 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.714498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5a5c2-f6d8-4e48-ab0d-fc07f08315b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.714799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5a5c2-f6d8-4e48-ab0d-fc07f08315b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.725743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5a5c2-f6d8-4e48-ab0d-fc07f08315b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:05.727193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d5a5c2-f6d8-4e48-ab0d-fc07f08315b1 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-67d5a5c2-f6d8-4e48-ab0d-fc07f08315b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:05.740901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:05.742061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:05.743363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:05.743363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:05.743363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:05.743363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 319/632] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:05.743363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5a5c2-f6d8-4e48-ab0d-fc07f08315b1 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:05.745270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 314/633] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:05.747010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161590fb-718a-41a7-95ea-b656cbca657c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:05.748353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:05.809017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:05.850812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161590fb-718a-41a7-95ea-b656cbca657c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:05.851531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5a5c2-f6d8-4e48-ab0d-fc07f08315b1 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:05.889706 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676c013-bb4f-4486-9020-cb171f5c1edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:05.890264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c013-bb4f-4486-9020-cb171f5c1edf None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.890564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c013-bb4f-4486-9020-cb171f5c1edf None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.890943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c013-bb4f-4486-9020-cb171f5c1edf None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.891259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ebf8b-494c-4800-963d-bc3ee1e6edb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:05.891527 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676c013-bb4f-4486-9020-cb171f5c1edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:05.891832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676c013-bb4f-4486-9020-cb171f5c1edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:05.891922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ebf8b-494c-4800-963d-bc3ee1e6edb0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.892143 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ebf8b-494c-4800-963d-bc3ee1e6edb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.892449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ebf8b-494c-4800-963d-bc3ee1e6edb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.893119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ebf8b-494c-4800-963d-bc3ee1e6edb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:05.893286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676c013-bb4f-4486-9020-cb171f5c1edf None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:05.893425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ebf8b-494c-4800-963d-bc3ee1e6edb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:05.895823 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ebf8b-494c-4800-963d-bc3ee1e6edb0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:05.905865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 320/634] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:05.906879 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944916b5-b0c1-430d-85a3-8caea00a2d50 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.907183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944916b5-b0c1-430d-85a3-8caea00a2d50 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.907480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944916b5-b0c1-430d-85a3-8caea00a2d50 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.908984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 321/635] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:05.909509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944916b5-b0c1-430d-85a3-8caea00a2d50 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:05.916896 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 315/636] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:05.919098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac946a89-96da-4a92-8696-f83b6afe2083 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:05.919586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac946a89-96da-4a92-8696-f83b6afe2083 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:05.920098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac946a89-96da-4a92-8696-f83b6afe2083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:05.938907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ac946a89-96da-4a92-8696-f83b6afe2083 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:05.940084 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ac946a89-96da-4a92-8696-f83b6afe2083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:05.982067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:06.010422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 316/637] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:06.011623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac946a89-96da-4a92-8696-f83b6afe2083 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:06.032889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944916b5-b0c1-430d-85a3-8caea00a2d50 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:06.068667 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65054654-f4ae-405c-be7a-679672480cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:06.069272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054654-f4ae-405c-be7a-679672480cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:06.069555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054654-f4ae-405c-be7a-679672480cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:06.069826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054654-f4ae-405c-be7a-679672480cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:06.070470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65054654-f4ae-405c-be7a-679672480cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:06.070774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65054654-f4ae-405c-be7a-679672480cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:06.072141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65054654-f4ae-405c-be7a-679672480cc0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:06.076695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:06.084669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 322/638] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:06.085454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65054654-f4ae-405c-be7a-679672480cc0 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:06.137602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac946a89-96da-4a92-8696-f83b6afe2083 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:06.179356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d8fc-adb3-46ae-a5be-0cecd8669ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:06.179911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d8fc-adb3-46ae-a5be-0cecd8669ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:06.180250 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d8fc-adb3-46ae-a5be-0cecd8669ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:06.180494 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4d8fc-adb3-46ae-a5be-0cecd8669ae9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:06.188360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65054654-f4ae-405c-be7a-679672480cc0 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:06.189663 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4d8fc-adb3-46ae-a5be-0cecd8669ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:06.191185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4d8fc-adb3-46ae-a5be-0cecd8669ae9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-4af4d8fc-adb3-46ae-a5be-0cecd8669ae9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:06.205361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:06.206491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:06.207665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:06.207665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:06.207665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:06.207665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:06.207665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:06.207665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:06.207665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:06.207665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:06.211463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 317/639] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:06.212331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d8fc-adb3-46ae-a5be-0cecd8669ae9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:06.217229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:06.228022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fec222-9285-4b21-b38c-ed277ba7281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:06.228702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fec222-9285-4b21-b38c-ed277ba7281e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:06.228983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fec222-9285-4b21-b38c-ed277ba7281e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:06.233420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fec222-9285-4b21-b38c-ed277ba7281e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:06.236640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fec222-9285-4b21-b38c-ed277ba7281e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:06.238077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fec222-9285-4b21-b38c-ed277ba7281e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-41fec222-9285-4b21-b38c-ed277ba7281e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:06.249542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:06.250502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:06.256894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:06.256894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:06.256894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:06.256894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:06.256894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:06.256894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:06.256894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:06.256894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:06.256894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 323/640] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:06.256894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fec222-9285-4b21-b38c-ed277ba7281e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:06.321451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4d8fc-adb3-46ae-a5be-0cecd8669ae9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:06.332324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:06.365371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fec222-9285-4b21-b38c-ed277ba7281e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:06.366547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1336a-6ea3-48e4-9412-bcc304a242f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:06.367184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1336a-6ea3-48e4-9412-bcc304a242f5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:06.367461 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1336a-6ea3-48e4-9412-bcc304a242f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:06.367727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1336a-6ea3-48e4-9412-bcc304a242f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:06.382087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b1336a-6ea3-48e4-9412-bcc304a242f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-31b1336a-6ea3-48e4-9412-bcc304a242f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:06.386956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:06.387923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:06.388795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 318/641] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:57:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:06.389729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1336a-6ea3-48e4-9412-bcc304a242f5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:06.403056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01821e-4126-44eb-a145-a8aac98a704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:06.403746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01821e-4126-44eb-a145-a8aac98a704f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:06.404025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01821e-4126-44eb-a145-a8aac98a704f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:06.404328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b01821e-4126-44eb-a145-a8aac98a704f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:06.411972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01821e-4126-44eb-a145-a8aac98a704f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:06.413430 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b01821e-4126-44eb-a145-a8aac98a704f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-0b01821e-4126-44eb-a145-a8aac98a704f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:06.425333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:06.426441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:06.427450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:06.427450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:06.427450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:06.427450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:06.427450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:06.427450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:06.427450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:06.427450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:06.427450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:57:06.427450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:06.427450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 324/642] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:57:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:06.428063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01821e-4126-44eb-a145-a8aac98a704f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:06.472612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:06.492201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b1336a-6ea3-48e4-9412-bcc304a242f5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:06.527311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af18f3-920b-40a8-893b-9d4602435aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:06.528111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af18f3-920b-40a8-893b-9d4602435aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:06.528422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af18f3-920b-40a8-893b-9d4602435aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:06.528699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af18f3-920b-40a8-893b-9d4602435aa5 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:06.529403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b01821e-4126-44eb-a145-a8aac98a704f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:06.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af18f3-920b-40a8-893b-9d4602435aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:06.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af18f3-920b-40a8-893b-9d4602435aa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:06.531248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af18f3-920b-40a8-893b-9d4602435aa5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:06.555944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 319/643] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:06.556807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af18f3-920b-40a8-893b-9d4602435aa5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:06.568907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b7a3-41ca-48f7-a440-b92177a1241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:06.569518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b7a3-41ca-48f7-a440-b92177a1241e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:06.569798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b7a3-41ca-48f7-a440-b92177a1241e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:06.570068 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b7a3-41ca-48f7-a440-b92177a1241e None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:06.570822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b7a3-41ca-48f7-a440-b92177a1241e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:06.571127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b7a3-41ca-48f7-a440-b92177a1241e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:06.572602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b7a3-41ca-48f7-a440-b92177a1241e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:06.584881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 325/644] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:06.585705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b7a3-41ca-48f7-a440-b92177a1241e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:06.591297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:06.669749 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af18f3-920b-40a8-893b-9d4602435aa5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:06.692142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b7a3-41ca-48f7-a440-b92177a1241e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:06.694441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:06.705547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a22f-1669-46d9-b800-41ec250b2996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:06.706244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a22f-1669-46d9-b800-41ec250b2996 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:06.706520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a22f-1669-46d9-b800-41ec250b2996 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:06.706824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a22f-1669-46d9-b800-41ec250b2996 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:06.718042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0a22f-1669-46d9-b800-41ec250b2996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-a7e0a22f-1669-46d9-b800-41ec250b2996 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:06.723299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:06.724397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 320/645] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:57:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:06.725221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a22f-1669-46d9-b800-41ec250b2996 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:06.728960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88a352-05a9-4bc0-b936-4e9aa42ed7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:06.729531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88a352-05a9-4bc0-b936-4e9aa42ed7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:06.729828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88a352-05a9-4bc0-b936-4e9aa42ed7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:06.730280 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88a352-05a9-4bc0-b936-4e9aa42ed7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:06.731177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88a352-05a9-4bc0-b936-4e9aa42ed7b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:06.731489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88a352-05a9-4bc0-b936-4e9aa42ed7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:06.733396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88a352-05a9-4bc0-b936-4e9aa42ed7b9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:06.741841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 326/646] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:57:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:06.742600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88a352-05a9-4bc0-b936-4e9aa42ed7b9 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:06.816731 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:06.827105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a22f-1669-46d9-b800-41ec250b2996 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:06.845977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88a352-05a9-4bc0-b936-4e9aa42ed7b9 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:06.861398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fe21e-68d6-41e0-add1-46e03240e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:06.862089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fe21e-68d6-41e0-add1-46e03240e3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:06.862371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fe21e-68d6-41e0-add1-46e03240e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:06.862643 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fe21e-68d6-41e0-add1-46e03240e3b2 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:06.863378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fe21e-68d6-41e0-add1-46e03240e3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:06.863685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fe21e-68d6-41e0-add1-46e03240e3b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:06.865184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fe21e-68d6-41e0-add1-46e03240e3b2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:06.879795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4758c-8678-43a9-8042-50a11b6eaa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:06.880484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4758c-8678-43a9-8042-50a11b6eaa69 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:06.880758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4758c-8678-43a9-8042-50a11b6eaa69 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:06.881024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4758c-8678-43a9-8042-50a11b6eaa69 None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/84368e89b0b34a54996def03671a1454/roles/fd16473b81a24082b019c8d3effe2e66` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:06.883918 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 321/647] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Aug 24 16:57:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:06.884821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fe21e-68d6-41e0-add1-46e03240e3b2 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:06.901276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4758c-8678-43a9-8042-50a11b6eaa69 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=84368e89b0b34a54996def03671a1454, role_id=fd16473b81a24082b019c8d3effe2e66)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:06.903698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4758c-8678-43a9-8042-50a11b6eaa69 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:06.983469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fe21e-68d6-41e0-add1-46e03240e3b2 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:07.011984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 327/648] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:57:06 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/84368e89b0b34a54996def03671a1454/roles/fd16473b81a24082b019c8d3effe2e66 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:57:07.012959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4758c-8678-43a9-8042-50a11b6eaa69 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:07.020253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e9726-d830-44d2-9db6-d375fc694fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:07.020887 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e9726-d830-44d2-9db6-d375fc694fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:07.025094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e9726-d830-44d2-9db6-d375fc694fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:07.025094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e9726-d830-44d2-9db6-d375fc694fe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:07.025094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e9726-d830-44d2-9db6-d375fc694fe9 None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=8af51476b48e45efbc3b626f9780e0be) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:07.025094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e9726-d830-44d2-9db6-d375fc694fe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:07.025094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e9726-d830-44d2-9db6-d375fc694fe9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:07.031221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 322/649] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:06 2022] GET /identity/v3/role_assignments?user.id=8af51476b48e45efbc3b626f9780e0be&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:07.032087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e9726-d830-44d2-9db6-d375fc694fe9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:07.052388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:07.057295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:07.174728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4758c-8678-43a9-8042-50a11b6eaa69 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:07.191704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e9726-d830-44d2-9db6-d375fc694fe9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:07.226624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae319fb-2da0-4fe7-ac41-65537e013861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:07.227583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae319fb-2da0-4fe7-ac41-65537e013861 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:07.228070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae319fb-2da0-4fe7-ac41-65537e013861 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:07.228620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae319fb-2da0-4fe7-ac41-65537e013861 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:07.229582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae319fb-2da0-4fe7-ac41-65537e013861 None admin] RBAC: Adding query filter params (name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:07.230156 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae319fb-2da0-4fe7-ac41-65537e013861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:07.231697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae319fb-2da0-4fe7-ac41-65537e013861 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:07.235637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a15952-1508-41cc-9d35-0c619b225873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:07.236315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a15952-1508-41cc-9d35-0c619b225873 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:07.236601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a15952-1508-41cc-9d35-0c619b225873 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:07.236919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a15952-1508-41cc-9d35-0c619b225873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:07.242593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 328/650] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:57:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:07.243650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae319fb-2da0-4fe7-ac41-65537e013861 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:07.250663 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a15952-1508-41cc-9d35-0c619b225873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:07.252645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a15952-1508-41cc-9d35-0c619b225873 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-c5a15952-1508-41cc-9d35-0c619b225873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:07.270708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:07.271848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:07.272984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:07.272984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:07.272984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:07.274142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 323/651] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:07.275162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a15952-1508-41cc-9d35-0c619b225873 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:07.360157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:07.370017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:07.392868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae319fb-2da0-4fe7-ac41-65537e013861 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:07.395404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a15952-1508-41cc-9d35-0c619b225873 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:07.433757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb054b21-7e9c-4303-aab0-13b06971a405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:07.434806 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb054b21-7e9c-4303-aab0-13b06971a405 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:07.435405 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb054b21-7e9c-4303-aab0-13b06971a405 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:07.435691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb054b21-7e9c-4303-aab0-13b06971a405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:07.440756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84141e-4863-4ac1-bfd9-1b20b764f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:07.441479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84141e-4863-4ac1-bfd9-1b20b764f775 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:07.441857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84141e-4863-4ac1-bfd9-1b20b764f775 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:07.442226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84141e-4863-4ac1-bfd9-1b20b764f775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:07.450018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb054b21-7e9c-4303-aab0-13b06971a405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:07.451568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb054b21-7e9c-4303-aab0-13b06971a405 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-eb054b21-7e9c-4303-aab0-13b06971a405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:07.470943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:07.472120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:07.473467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:07.473467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:07.473467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:07.473467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 324/652] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:07.473467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb054b21-7e9c-4303-aab0-13b06971a405 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:07.533937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84141e-4863-4ac1-bfd9-1b20b764f775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:07.535723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84141e-4863-4ac1-bfd9-1b20b764f775 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:07.592153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb054b21-7e9c-4303-aab0-13b06971a405 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:07.610618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:07.630629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf0f24-f46c-4f3f-8067-9ddc81c17694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:07.631640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf0f24-f46c-4f3f-8067-9ddc81c17694 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:07.632147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf0f24-f46c-4f3f-8067-9ddc81c17694 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:07.632665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf0f24-f46c-4f3f-8067-9ddc81c17694 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:07.633555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf0f24-f46c-4f3f-8067-9ddc81c17694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:07.634058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf0f24-f46c-4f3f-8067-9ddc81c17694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:07.635635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf0f24-f46c-4f3f-8067-9ddc81c17694 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:07.637637 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:07.651250 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 325/653] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:07.652937 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf0f24-f46c-4f3f-8067-9ddc81c17694 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:07.665610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 329/654] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:07.666925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84141e-4863-4ac1-bfd9-1b20b764f775 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:07.781727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84141e-4863-4ac1-bfd9-1b20b764f775 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:07.795879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf0f24-f46c-4f3f-8067-9ddc81c17694 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:07.833592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f0094-7021-41d9-9af5-18f7cb288999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:07.834669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f0094-7021-41d9-9af5-18f7cb288999 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:07.835254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f0094-7021-41d9-9af5-18f7cb288999 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:07.835756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f0094-7021-41d9-9af5-18f7cb288999 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:07.836861 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cfd63-f2dc-4438-871d-7d28fc951444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:07.837547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cfd63-f2dc-4438-871d-7d28fc951444 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:07.837830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cfd63-f2dc-4438-871d-7d28fc951444 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:07.838107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cfd63-f2dc-4438-871d-7d28fc951444 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:07.838753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cfd63-f2dc-4438-871d-7d28fc951444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:07.839054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cfd63-f2dc-4438-871d-7d28fc951444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:07.841955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cfd63-f2dc-4438-871d-7d28fc951444 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:07.846581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f0094-7021-41d9-9af5-18f7cb288999 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:07.848338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f0094-7021-41d9-9af5-18f7cb288999 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:07.856396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 326/655] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:07.857459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cfd63-f2dc-4438-871d-7d28fc951444 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-257f0094-7021-41d9-9af5-18f7cb288999 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:07.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:07.863740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:07.864688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:07.864688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:07.864688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:07.864688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:07.864688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:07.864688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:07.864688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:07.864688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:07.864688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:57:07.864688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:07.867295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 330/656] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:57:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:07.876387 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f0094-7021-41d9-9af5-18f7cb288999 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:07.896063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:07.923213 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:07.982237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cfd63-f2dc-4438-871d-7d28fc951444 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:08.001453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f0094-7021-41d9-9af5-18f7cb288999 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:08.025015 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cec39-7ecb-4f3b-88a7-7c1eaa5847af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:08.025793 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cec39-7ecb-4f3b-88a7-7c1eaa5847af None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:08.026169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cec39-7ecb-4f3b-88a7-7c1eaa5847af None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:08.026535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cec39-7ecb-4f3b-88a7-7c1eaa5847af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:08.039241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d1a4-771d-48db-a2c7-3f6b8f46b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:08.039816 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cec39-7ecb-4f3b-88a7-7c1eaa5847af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:08.040333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d1a4-771d-48db-a2c7-3f6b8f46b7ba None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:08.040763 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d1a4-771d-48db-a2c7-3f6b8f46b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:08.041200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d1a4-771d-48db-a2c7-3f6b8f46b7ba None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:08.041677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cec39-7ecb-4f3b-88a7-7c1eaa5847af None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:08.049748 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d1a4-771d-48db-a2c7-3f6b8f46b7ba None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:08.051119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d1a4-771d-48db-a2c7-3f6b8f46b7ba None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-c17cec39-7ecb-4f3b-88a7-7c1eaa5847af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:08.059019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:08.060204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:08.061146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:08.061146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:08.061146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-61e5d1a4-771d-48db-a2c7-3f6b8f46b7ba None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:08.063472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:08.064414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:08.065360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:08.065360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:08.065360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:08.065360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:08.065360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:08.065360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:08.065360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:08.065360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:08.065360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:57:08.065360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:08.065894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 327/658] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:08.066449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cec39-7ecb-4f3b-88a7-7c1eaa5847af None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:08.069649 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 331/658] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:57:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:08.070515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d1a4-771d-48db-a2c7-3f6b8f46b7ba None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:08.165810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:08.178921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cec39-7ecb-4f3b-88a7-7c1eaa5847af None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:08.204891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:08.209656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d1a4-771d-48db-a2c7-3f6b8f46b7ba None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:08.220047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122caa5a-1783-4078-8e10-57eb1ceef9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:08.221348 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122caa5a-1783-4078-8e10-57eb1ceef9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:08.221862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122caa5a-1783-4078-8e10-57eb1ceef9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:08.222279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122caa5a-1783-4078-8e10-57eb1ceef9b9 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:08.223176 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122caa5a-1783-4078-8e10-57eb1ceef9b9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:08.223641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122caa5a-1783-4078-8e10-57eb1ceef9b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:08.225269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122caa5a-1783-4078-8e10-57eb1ceef9b9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:08.244158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 328/659] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Aug 24 16:57:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:08.245032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122caa5a-1783-4078-8e10-57eb1ceef9b9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:08.260829 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34382ca3-869c-4367-aa86-7345f16438e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:08.262295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34382ca3-869c-4367-aa86-7345f16438e3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:08.262571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34382ca3-869c-4367-aa86-7345f16438e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:08.262844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34382ca3-869c-4367-aa86-7345f16438e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:08.263489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34382ca3-869c-4367-aa86-7345f16438e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:08.263793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34382ca3-869c-4367-aa86-7345f16438e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:08.265399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34382ca3-869c-4367-aa86-7345f16438e3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:08.279369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 332/660] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:08.280344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34382ca3-869c-4367-aa86-7345f16438e3 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:08.361178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122caa5a-1783-4078-8e10-57eb1ceef9b9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:08.397430 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34382ca3-869c-4367-aa86-7345f16438e3 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:08.397755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3eab3-1956-409c-b3b7-efaa986777c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:08.398426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3eab3-1956-409c-b3b7-efaa986777c0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:08.398711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3eab3-1956-409c-b3b7-efaa986777c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:08.399075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3eab3-1956-409c-b3b7-efaa986777c0 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:08.399908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3eab3-1956-409c-b3b7-efaa986777c0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:08.400212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3eab3-1956-409c-b3b7-efaa986777c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:08.402554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3eab3-1956-409c-b3b7-efaa986777c0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:08.421971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 329/661] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Aug 24 16:57:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:08.422909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3eab3-1956-409c-b3b7-efaa986777c0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:08.426649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:08.436115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea8eba-9cc9-4c89-b9a2-4fb94c0d099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:08.436955 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea8eba-9cc9-4c89-b9a2-4fb94c0d099e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:08.437381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea8eba-9cc9-4c89-b9a2-4fb94c0d099e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:08.444821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea8eba-9cc9-4c89-b9a2-4fb94c0d099e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:08.468368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:08.516676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea8eba-9cc9-4c89-b9a2-4fb94c0d099e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:08.518668 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea8eba-9cc9-4c89-b9a2-4fb94c0d099e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:08.533502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3eab3-1956-409c-b3b7-efaa986777c0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:08.570673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f02dd-c43c-42ef-a055-d171e84409c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:08.571318 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f02dd-c43c-42ef-a055-d171e84409c5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:08.571595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f02dd-c43c-42ef-a055-d171e84409c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:08.571864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f02dd-c43c-42ef-a055-d171e84409c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:08.580433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f02dd-c43c-42ef-a055-d171e84409c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:08.582144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f02dd-c43c-42ef-a055-d171e84409c5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-dd1f02dd-c43c-42ef-a055-d171e84409c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:08.594960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:08.596056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:08.597170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:08.597170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:08.597170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:08.597170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:08.597170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:08.597170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:08.597170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:08.597170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:08.600929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 330/662] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:08.601769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f02dd-c43c-42ef-a055-d171e84409c5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:08.633911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 333/663] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:08.635439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea8eba-9cc9-4c89-b9a2-4fb94c0d099e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:08.670487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:08.701134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:08.712885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f02dd-c43c-42ef-a055-d171e84409c5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:08.748952 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea8eba-9cc9-4c89-b9a2-4fb94c0d099e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:08.750221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f4103-ec06-4a73-9983-2da3ccdb3615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:08.750943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f4103-ec06-4a73-9983-2da3ccdb3615 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:08.751224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f4103-ec06-4a73-9983-2da3ccdb3615 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:08.751505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f4103-ec06-4a73-9983-2da3ccdb3615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:08.790353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3793ed-743c-4c6c-afdf-1654ec7f8b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:08.791218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3793ed-743c-4c6c-afdf-1654ec7f8b14 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:08.791672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3793ed-743c-4c6c-afdf-1654ec7f8b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:08.792105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3793ed-743c-4c6c-afdf-1654ec7f8b14 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:08.793369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3793ed-743c-4c6c-afdf-1654ec7f8b14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:08.793829 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3793ed-743c-4c6c-afdf-1654ec7f8b14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:08.795436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3793ed-743c-4c6c-afdf-1654ec7f8b14 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:08.810010 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 334/664] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:08.811065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3793ed-743c-4c6c-afdf-1654ec7f8b14 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:08.830637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f4103-ec06-4a73-9983-2da3ccdb3615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:08.832283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f4103-ec06-4a73-9983-2da3ccdb3615 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:08.900748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:08.928187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3793ed-743c-4c6c-afdf-1654ec7f8b14 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:08.944845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 331/665] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:08.945769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f4103-ec06-4a73-9983-2da3ccdb3615 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:08.949071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:08.968683 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5799d74-b45d-4cb3-ba9d-f4ba4e5e9cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:08.969622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5799d74-b45d-4cb3-ba9d-f4ba4e5e9cce None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:08.970143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5799d74-b45d-4cb3-ba9d-f4ba4e5e9cce None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:08.970609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5799d74-b45d-4cb3-ba9d-f4ba4e5e9cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:08.983040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5799d74-b45d-4cb3-ba9d-f4ba4e5e9cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:08.985054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5799d74-b45d-4cb3-ba9d-f4ba4e5e9cce None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-b5799d74-b45d-4cb3-ba9d-f4ba4e5e9cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:09.001839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:09.002980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:09.003988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:09.003988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:09.003988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:09.005687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 335/666] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:09.006700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5799d74-b45d-4cb3-ba9d-f4ba4e5e9cce None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:09.058285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f4103-ec06-4a73-9983-2da3ccdb3615 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:09.097549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f180e3-a389-455a-ae88-d4e014dd3a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:09.098216 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f180e3-a389-455a-ae88-d4e014dd3a62 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.098488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f180e3-a389-455a-ae88-d4e014dd3a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.098792 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f180e3-a389-455a-ae88-d4e014dd3a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.099528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f180e3-a389-455a-ae88-d4e014dd3a62 None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=1684abe7e6aa44a0873e43dfc146c1b3) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:09.099927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f180e3-a389-455a-ae88-d4e014dd3a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:09.101394 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f180e3-a389-455a-ae88-d4e014dd3a62 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:09.107292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 332/667] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:08 2022] GET /identity/v3/role_assignments?user.id=1684abe7e6aa44a0873e43dfc146c1b3&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:09.108281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f180e3-a389-455a-ae88-d4e014dd3a62 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:09.122806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5799d74-b45d-4cb3-ba9d-f4ba4e5e9cce None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:09.146402 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:09.169229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d32f71-7314-47ed-a331-ba1b84060d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:09.169460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d32f71-7314-47ed-a331-ba1b84060d56 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.169725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d32f71-7314-47ed-a331-ba1b84060d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.170003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d32f71-7314-47ed-a331-ba1b84060d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.182101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d32f71-7314-47ed-a331-ba1b84060d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:09.183931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d32f71-7314-47ed-a331-ba1b84060d56 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-71d32f71-7314-47ed-a331-ba1b84060d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:09.203780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:09.204947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:09.205907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:09.205907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:09.205907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:09.205907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 336/668] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:09.206479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b637aa-a136-4ae7-936d-c9fc3849bc79 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.206760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b637aa-a136-4ae7-936d-c9fc3849bc79 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.207057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b637aa-a136-4ae7-936d-c9fc3849bc79 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.208766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 337/669] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:09.210291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b637aa-a136-4ae7-936d-c9fc3849bc79 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:09.240145 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:09.252739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f180e3-a389-455a-ae88-d4e014dd3a62 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:09.300675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9401628a-bfb6-42b4-8058-9c5fd686ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:09.301299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401628a-bfb6-42b4-8058-9c5fd686ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.301581 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401628a-bfb6-42b4-8058-9c5fd686ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.301852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401628a-bfb6-42b4-8058-9c5fd686ccf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.303862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401628a-bfb6-42b4-8058-9c5fd686ccf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:09.303862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401628a-bfb6-42b4-8058-9c5fd686ccf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:09.304173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9401628a-bfb6-42b4-8058-9c5fd686ccf3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:09.320726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 333/670] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:09.322397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62a2a9-7f98-44dc-9661-223216f2ff40 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.322688 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62a2a9-7f98-44dc-9661-223216f2ff40 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.322963 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62a2a9-7f98-44dc-9661-223216f2ff40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.341566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b637aa-a136-4ae7-936d-c9fc3849bc79 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:09.344064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-bf62a2a9-7f98-44dc-9661-223216f2ff40 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:09.345307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bf62a2a9-7f98-44dc-9661-223216f2ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:09.379247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b00bd1-eeec-4184-ad70-42433dbe46a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:09.379884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b00bd1-eeec-4184-ad70-42433dbe46a3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.380161 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b00bd1-eeec-4184-ad70-42433dbe46a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.380501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b00bd1-eeec-4184-ad70-42433dbe46a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.381142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b00bd1-eeec-4184-ad70-42433dbe46a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:09.381480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b00bd1-eeec-4184-ad70-42433dbe46a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:09.382902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b00bd1-eeec-4184-ad70-42433dbe46a3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:09.396531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 338/671] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:09.397781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863679-2b22-41ea-87c3-638199a15d62 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.398065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863679-2b22-41ea-87c3-638199a15d62 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.398336 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67863679-2b22-41ea-87c3-638199a15d62 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.399582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 339/672] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:09.400286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67863679-2b22-41ea-87c3-638199a15d62 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:09.425283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 334/673] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:09.426057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62a2a9-7f98-44dc-9661-223216f2ff40 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:09.454847 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:09.499617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:09.525083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67863679-2b22-41ea-87c3-638199a15d62 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:09.572070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62a2a9-7f98-44dc-9661-223216f2ff40 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:09.579307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57b1dd-58eb-4568-adeb-96a614542343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:09.579939 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57b1dd-58eb-4568-adeb-96a614542343 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.580213 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57b1dd-58eb-4568-adeb-96a614542343 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.580499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57b1dd-58eb-4568-adeb-96a614542343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.589518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57b1dd-58eb-4568-adeb-96a614542343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:09.591848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57b1dd-58eb-4568-adeb-96a614542343 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-1e57b1dd-58eb-4568-adeb-96a614542343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:09.607632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:09.608575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:09.609466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:09.609466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:09.609466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:09.609466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:09.609466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:09.609466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:09.609466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:09.609466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:09.609466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 340/674] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:09.610441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435b1c1-ab29-413c-ba80-f5a5a54ca65e None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.610604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435b1c1-ab29-413c-ba80-f5a5a54ca65e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.610844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435b1c1-ab29-413c-ba80-f5a5a54ca65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.618106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206567c3-e040-4f3f-a3d6-c9289de379d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:09.620414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206567c3-e040-4f3f-a3d6-c9289de379d9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.621394 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206567c3-e040-4f3f-a3d6-c9289de379d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.621884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206567c3-e040-4f3f-a3d6-c9289de379d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.630535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206567c3-e040-4f3f-a3d6-c9289de379d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:09.632127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0435b1c1-ab29-413c-ba80-f5a5a54ca65e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:09.632572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206567c3-e040-4f3f-a3d6-c9289de379d9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:09.633533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0435b1c1-ab29-413c-ba80-f5a5a54ca65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-206567c3-e040-4f3f-a3d6-c9289de379d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:09.647953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:09.649026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:09.650103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:09.650103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:09.650103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:09.650103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:09.650103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:09.650103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:09.650103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:09.650103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:09.653150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 335/675] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:09.654150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206567c3-e040-4f3f-a3d6-c9289de379d9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:09.724397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 341/676] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:09.725888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435b1c1-ab29-413c-ba80-f5a5a54ca65e None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:09.768606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:09.790062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206567c3-e040-4f3f-a3d6-c9289de379d9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:09.822772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:09.837987 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2188196-c7ab-42bd-9fb5-bc55545ec808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:09.839352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2188196-c7ab-42bd-9fb5-bc55545ec808 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.839784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2188196-c7ab-42bd-9fb5-bc55545ec808 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.840206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2188196-c7ab-42bd-9fb5-bc55545ec808 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.841361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2188196-c7ab-42bd-9fb5-bc55545ec808 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:09.842087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2188196-c7ab-42bd-9fb5-bc55545ec808 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:09.843677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2188196-c7ab-42bd-9fb5-bc55545ec808 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:09.861026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 336/677] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:09.862171 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2188196-c7ab-42bd-9fb5-bc55545ec808 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:09.868076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435b1c1-ab29-413c-ba80-f5a5a54ca65e None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:09.909715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589cae4-4eec-4595-aedb-2637827796b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:09.910497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589cae4-4eec-4595-aedb-2637827796b3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:09.910873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589cae4-4eec-4595-aedb-2637827796b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:09.911243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589cae4-4eec-4595-aedb-2637827796b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:09.912122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589cae4-4eec-4595-aedb-2637827796b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:09.912564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589cae4-4eec-4595-aedb-2637827796b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:09.914155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589cae4-4eec-4595-aedb-2637827796b3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:09.928750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 342/678] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:09.935934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589cae4-4eec-4595-aedb-2637827796b3 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:09.997015 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2188196-c7ab-42bd-9fb5-bc55545ec808 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:10.033365 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccd516-3c7b-42d9-8184-0e03c692affa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:10.033993 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd516-3c7b-42d9-8184-0e03c692affa None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:10.034269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd516-3c7b-42d9-8184-0e03c692affa None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:10.034534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd516-3c7b-42d9-8184-0e03c692affa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:10.041634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:10.047429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccd516-3c7b-42d9-8184-0e03c692affa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:10.050413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589cae4-4eec-4595-aedb-2637827796b3 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-baccd516-3c7b-42d9-8184-0e03c692affa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:10.052063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:10.053213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 337/679] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:57:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:10.054032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccd516-3c7b-42d9-8184-0e03c692affa None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:10.090476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:10.095689 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ff037-e687-4778-838e-2ac7f1b0d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:10.096907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ff037-e687-4778-838e-2ac7f1b0d282 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:10.096907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ff037-e687-4778-838e-2ac7f1b0d282 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:10.096907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ff037-e687-4778-838e-2ac7f1b0d282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:10.097526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ff037-e687-4778-838e-2ac7f1b0d282 None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=009e5ad7d256449495c74dad67741f3f) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:10.097833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ff037-e687-4778-838e-2ac7f1b0d282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:10.099239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ff037-e687-4778-838e-2ac7f1b0d282 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:10.106325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 343/680] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:09 2022] GET /identity/v3/role_assignments?user.id=009e5ad7d256449495c74dad67741f3f&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:10.107134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ff037-e687-4778-838e-2ac7f1b0d282 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:10.188549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccd516-3c7b-42d9-8184-0e03c692affa None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:10.232310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02766bb-84d5-4572-b916-73391a516bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:10.233551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02766bb-84d5-4572-b916-73391a516bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:10.233551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02766bb-84d5-4572-b916-73391a516bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:10.233841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02766bb-84d5-4572-b916-73391a516bc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:10.234681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02766bb-84d5-4572-b916-73391a516bc6 None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=e303777e78b7499fbff457254d14d360) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:10.235107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02766bb-84d5-4572-b916-73391a516bc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:10.236740 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02766bb-84d5-4572-b916-73391a516bc6 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:10.243717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 338/681] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:10 2022] GET /identity/v3/role_assignments?user.id=e303777e78b7499fbff457254d14d360&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:10.244819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02766bb-84d5-4572-b916-73391a516bc6 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:10.251194 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ff037-e687-4778-838e-2ac7f1b0d282 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:10.303038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e71d9-cfe5-435b-88be-506db59ebb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:10.303708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e71d9-cfe5-435b-88be-506db59ebb26 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:10.303991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e71d9-cfe5-435b-88be-506db59ebb26 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:10.304282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813e71d9-cfe5-435b-88be-506db59ebb26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:10.321798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813e71d9-cfe5-435b-88be-506db59ebb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-813e71d9-cfe5-435b-88be-506db59ebb26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:10.328845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:10.329837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:10.330728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 344/682] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:10.338732 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e71d9-cfe5-435b-88be-506db59ebb26 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:10.343927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:10.395776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02766bb-84d5-4572-b916-73391a516bc6 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:10.410127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:10.442909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf680be-3b00-4d3d-9f23-229793428d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:10.443622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf680be-3b00-4d3d-9f23-229793428d2d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:10.444002 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf680be-3b00-4d3d-9f23-229793428d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:10.444375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf680be-3b00-4d3d-9f23-229793428d2d None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:10.445188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf680be-3b00-4d3d-9f23-229793428d2d None admin] RBAC: Adding query filter params (name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:10.445557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf680be-3b00-4d3d-9f23-229793428d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:10.447006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf680be-3b00-4d3d-9f23-229793428d2d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:10.460271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 339/683] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:57:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:10.464483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf680be-3b00-4d3d-9f23-229793428d2d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:10.471061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813e71d9-cfe5-435b-88be-506db59ebb26 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:10.519591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531da968-e11e-4174-94b7-04be05bc523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:10.520595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531da968-e11e-4174-94b7-04be05bc523f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:10.521054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531da968-e11e-4174-94b7-04be05bc523f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:10.521502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531da968-e11e-4174-94b7-04be05bc523f None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:10.522401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531da968-e11e-4174-94b7-04be05bc523f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:10.522880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531da968-e11e-4174-94b7-04be05bc523f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:10.524465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531da968-e11e-4174-94b7-04be05bc523f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:10.536171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 345/684] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:57:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:10.541401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531da968-e11e-4174-94b7-04be05bc523f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:10.589802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf680be-3b00-4d3d-9f23-229793428d2d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:10.616831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:10.629280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f52b0-410b-43c0-a9e4-2f1eec721d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:10.629915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f52b0-410b-43c0-a9e4-2f1eec721d30 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:10.630190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f52b0-410b-43c0-a9e4-2f1eec721d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:10.630466 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f52b0-410b-43c0-a9e4-2f1eec721d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:10.655167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f52b0-410b-43c0-a9e4-2f1eec721d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:10.658073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f52b0-410b-43c0-a9e4-2f1eec721d30 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-d16f52b0-410b-43c0-a9e4-2f1eec721d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:10.687729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:10.688837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:10.689730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:10.689730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:10.689730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:10.692982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 340/685] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:10.696935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f52b0-410b-43c0-a9e4-2f1eec721d30 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:10.703814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531da968-e11e-4174-94b7-04be05bc523f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:10.742884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:10.778767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973df7f-a3f1-4b0c-adb4-caa321d4a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:10.779324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973df7f-a3f1-4b0c-adb4-caa321d4a814 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:10.779599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973df7f-a3f1-4b0c-adb4-caa321d4a814 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:10.779865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973df7f-a3f1-4b0c-adb4-caa321d4a814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:10.796879 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973df7f-a3f1-4b0c-adb4-caa321d4a814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:10.802719 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973df7f-a3f1-4b0c-adb4-caa321d4a814 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-7973df7f-a3f1-4b0c-adb4-caa321d4a814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:10.831458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:10.832492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:10.833420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:10.833420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:10.833420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:10.834115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 346/686] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:10.840281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973df7f-a3f1-4b0c-adb4-caa321d4a814 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:10.894347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f52b0-410b-43c0-a9e4-2f1eec721d30 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:10.960480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b036a8-5f35-460d-8ef4-9b13f3e44dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:10.961481 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b036a8-5f35-460d-8ef4-9b13f3e44dbb None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:10.961966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b036a8-5f35-460d-8ef4-9b13f3e44dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:10.962431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b036a8-5f35-460d-8ef4-9b13f3e44dbb None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:10.963288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b036a8-5f35-460d-8ef4-9b13f3e44dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:10.972265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b036a8-5f35-460d-8ef4-9b13f3e44dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:10.974026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b036a8-5f35-460d-8ef4-9b13f3e44dbb None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:10.996186 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 341/687] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:11.002006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b036a8-5f35-460d-8ef4-9b13f3e44dbb None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:11.005856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973df7f-a3f1-4b0c-adb4-caa321d4a814 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:11.057774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a62cc-4529-4221-bfbe-a2a4a3addfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:11.058328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a62cc-4529-4221-bfbe-a2a4a3addfee None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:11.058794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a62cc-4529-4221-bfbe-a2a4a3addfee None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:11.059068 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a62cc-4529-4221-bfbe-a2a4a3addfee None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:11.059977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a62cc-4529-4221-bfbe-a2a4a3addfee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:11.060380 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a62cc-4529-4221-bfbe-a2a4a3addfee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:11.061676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a62cc-4529-4221-bfbe-a2a4a3addfee None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:11.084708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:11.096054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 347/688] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:11.106026 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a62cc-4529-4221-bfbe-a2a4a3addfee None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:11.127243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b036a8-5f35-460d-8ef4-9b13f3e44dbb None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:11.164315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda06a0-49b0-403e-acae-a4d215503579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:11.165321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda06a0-49b0-403e-acae-a4d215503579 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:11.165789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda06a0-49b0-403e-acae-a4d215503579 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:11.166246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda06a0-49b0-403e-acae-a4d215503579 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:11.174730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda06a0-49b0-403e-acae-a4d215503579 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:11.176626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda06a0-49b0-403e-acae-a4d215503579 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-adda06a0-49b0-403e-acae-a4d215503579 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:11.190595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:11.191566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:11.192522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:11.192522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:11.192522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:11.192522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:11.192522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:11.192522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:11.192522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:11.192522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:11.192522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:57:11.192522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:11.200366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 342/689] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:11.201916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda06a0-49b0-403e-acae-a4d215503579 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:11.217824 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:11.304211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a62cc-4529-4221-bfbe-a2a4a3addfee None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:11.316794 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:11.325396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda06a0-49b0-403e-acae-a4d215503579 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:11.345014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3bc4b-d71e-47e6-ae98-57fbe0458735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:11.345970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3bc4b-d71e-47e6-ae98-57fbe0458735 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:11.346390 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3bc4b-d71e-47e6-ae98-57fbe0458735 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:11.346812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3bc4b-d71e-47e6-ae98-57fbe0458735 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:11.354264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3bc4b-d71e-47e6-ae98-57fbe0458735 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:11.355897 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3bc4b-d71e-47e6-ae98-57fbe0458735 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:11.366423 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e1ccc-4a92-429b-b178-20aae57505fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:11.367580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e1ccc-4a92-429b-b178-20aae57505fd None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:11.368009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e1ccc-4a92-429b-b178-20aae57505fd None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:11.368480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e1ccc-4a92-429b-b178-20aae57505fd None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:11.369361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e1ccc-4a92-429b-b178-20aae57505fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:11.369839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e1ccc-4a92-429b-b178-20aae57505fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:11.371472 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e1ccc-4a92-429b-b178-20aae57505fd None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-49b3bc4b-d71e-47e6-ae98-57fbe0458735 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:11.372818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:11.374024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:11.375111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:11.375111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:11.375111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:11.375111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:11.375111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:11.375111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:11.375111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:11.375111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:11.375111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:57:11.375111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:11.376021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 348/690] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Aug 24 16:57:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:11.377468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740dc1-38b6-4c9a-9571-6a1ba6c8cb20 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:11.377751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740dc1-38b6-4c9a-9571-6a1ba6c8cb20 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:11.378022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa740dc1-38b6-4c9a-9571-6a1ba6c8cb20 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:11.383686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 349/691] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:11.383686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa740dc1-38b6-4c9a-9571-6a1ba6c8cb20 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:11.407900 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 343/692] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Aug 24 16:57:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:11.409682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b12326-104e-4be0-a7c6-c86f670974cd None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:11.410169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b12326-104e-4be0-a7c6-c86f670974cd None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:11.410637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b12326-104e-4be0-a7c6-c86f670974cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:11.430399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-52b12326-104e-4be0-a7c6-c86f670974cd None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:11.432073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-52b12326-104e-4be0-a7c6-c86f670974cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:11.488609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:11.500946 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa740dc1-38b6-4c9a-9571-6a1ba6c8cb20 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:11.512565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 344/693] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:11.513886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b12326-104e-4be0-a7c6-c86f670974cd None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:11.539765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a071f-32ef-478a-9f2a-86656ceec7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:11.540445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a071f-32ef-478a-9f2a-86656ceec7ce None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:11.540723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a071f-32ef-478a-9f2a-86656ceec7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:11.540992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a071f-32ef-478a-9f2a-86656ceec7ce None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:11.541968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a071f-32ef-478a-9f2a-86656ceec7ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:11.542306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a071f-32ef-478a-9f2a-86656ceec7ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:11.545615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a071f-32ef-478a-9f2a-86656ceec7ce None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:11.566241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 350/694] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Aug 24 16:57:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:11.574017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a071f-32ef-478a-9f2a-86656ceec7ce None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:11.678362 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a071f-32ef-478a-9f2a-86656ceec7ce None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:11.716517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:11.740416 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b12326-104e-4be0-a7c6-c86f670974cd None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:11.754577 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d535-e2e9-4296-afd4-f99fab4d32df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:11.755278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d535-e2e9-4296-afd4-f99fab4d32df None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:11.755469 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d535-e2e9-4296-afd4-f99fab4d32df None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:11.755772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d535-e2e9-4296-afd4-f99fab4d32df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:11.785923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434071ea-14a7-497e-a6e3-33b16bb0355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:11.786601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434071ea-14a7-497e-a6e3-33b16bb0355b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:11.786881 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434071ea-14a7-497e-a6e3-33b16bb0355b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:11.787232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434071ea-14a7-497e-a6e3-33b16bb0355b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:11.791824 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:11.868222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1d535-e2e9-4296-afd4-f99fab4d32df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:11.870071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1d535-e2e9-4296-afd4-f99fab4d32df None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:11.898482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434071ea-14a7-497e-a6e3-33b16bb0355b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:11.900391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434071ea-14a7-497e-a6e3-33b16bb0355b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:11.999887 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:12.026267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 345/695] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:12.027162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434071ea-14a7-497e-a6e3-33b16bb0355b None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:12.127386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 351/696] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:12.131392 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d535-e2e9-4296-afd4-f99fab4d32df None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:12.143461 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434071ea-14a7-497e-a6e3-33b16bb0355b None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:12.179651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d22dbc-0433-4dd2-91b8-611839c50b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:12.180321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d22dbc-0433-4dd2-91b8-611839c50b72 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:12.180617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d22dbc-0433-4dd2-91b8-611839c50b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:12.180931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d22dbc-0433-4dd2-91b8-611839c50b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:12.187368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:12.192660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d22dbc-0433-4dd2-91b8-611839c50b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:12.194269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d22dbc-0433-4dd2-91b8-611839c50b72 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-a0d22dbc-0433-4dd2-91b8-611839c50b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:12.210568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:12.211597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:12.212529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:12.212529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:12.212529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:12.216648 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 346/697] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:12.217589 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d22dbc-0433-4dd2-91b8-611839c50b72 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:12.247426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d535-e2e9-4296-afd4-f99fab4d32df None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:12.257134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:12.284112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39884d6-d6f9-4b99-ad02-0cd1c4c7715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:12.285114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39884d6-d6f9-4b99-ad02-0cd1c4c7715b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:12.285592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39884d6-d6f9-4b99-ad02-0cd1c4c7715b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:12.286016 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39884d6-d6f9-4b99-ad02-0cd1c4c7715b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:12.299017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39884d6-d6f9-4b99-ad02-0cd1c4c7715b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:12.300699 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39884d6-d6f9-4b99-ad02-0cd1c4c7715b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-f39884d6-d6f9-4b99-ad02-0cd1c4c7715b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:12.317270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:12.318445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:12.319385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:12.319385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:12.319385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:12.321352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 352/698] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:12.322398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39884d6-d6f9-4b99-ad02-0cd1c4c7715b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:12.342260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d22dbc-0433-4dd2-91b8-611839c50b72 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:12.380276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ddf7a-1502-4c28-956e-d0b65bfe42a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:12.380895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ddf7a-1502-4c28-956e-d0b65bfe42a9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:12.381107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ddf7a-1502-4c28-956e-d0b65bfe42a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:12.381367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ddf7a-1502-4c28-956e-d0b65bfe42a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:12.393733 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ddf7a-1502-4c28-956e-d0b65bfe42a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:12.395116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ddf7a-1502-4c28-956e-d0b65bfe42a9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-7e2ddf7a-1502-4c28-956e-d0b65bfe42a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:12.411813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:12.412826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:12.413706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:12.413706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:12.413706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:12.416389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 347/699] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:12.417832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ddf7a-1502-4c28-956e-d0b65bfe42a9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:12.436962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:12.440514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39884d6-d6f9-4b99-ad02-0cd1c4c7715b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:12.477334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8042-64c6-4a16-86cd-2fdada0af9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:12.478089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8042-64c6-4a16-86cd-2fdada0af9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:12.478464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8042-64c6-4a16-86cd-2fdada0af9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:12.478885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d8042-64c6-4a16-86cd-2fdada0af9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:12.480626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8042-64c6-4a16-86cd-2fdada0af9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:12.481039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8042-64c6-4a16-86cd-2fdada0af9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:12.482667 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d8042-64c6-4a16-86cd-2fdada0af9a2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:12.494888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 353/700] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:12.495651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8042-64c6-4a16-86cd-2fdada0af9a2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:12.521824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:12.535774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ddf7a-1502-4c28-956e-d0b65bfe42a9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:12.573436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9d1ea4-091b-4b63-9a3b-d5e327d3cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:12.574437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1ea4-091b-4b63-9a3b-d5e327d3cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:12.574894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1ea4-091b-4b63-9a3b-d5e327d3cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:12.575373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9d1ea4-091b-4b63-9a3b-d5e327d3cbf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:12.576044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d1ea4-091b-4b63-9a3b-d5e327d3cbf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:12.576376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d1ea4-091b-4b63-9a3b-d5e327d3cbf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:12.577758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9d1ea4-091b-4b63-9a3b-d5e327d3cbf8 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:12.596046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 348/701] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:12.597202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adfb25-f68e-4de6-b7d4-56ee9f2ad271 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:12.597488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adfb25-f68e-4de6-b7d4-56ee9f2ad271 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:12.597766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1adfb25-f68e-4de6-b7d4-56ee9f2ad271 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:12.599026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 349/702] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:12.599704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adfb25-f68e-4de6-b7d4-56ee9f2ad271 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:12.614432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d8042-64c6-4a16-86cd-2fdada0af9a2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:12.649911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673041f8-aeae-4de4-8eff-efddb6cdffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:12.650439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673041f8-aeae-4de4-8eff-efddb6cdffa5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:12.650717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673041f8-aeae-4de4-8eff-efddb6cdffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:12.650989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673041f8-aeae-4de4-8eff-efddb6cdffa5 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:12.652302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673041f8-aeae-4de4-8eff-efddb6cdffa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:12.652607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673041f8-aeae-4de4-8eff-efddb6cdffa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:12.654042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673041f8-aeae-4de4-8eff-efddb6cdffa5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:12.665663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 354/703] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:12.666462 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673041f8-aeae-4de4-8eff-efddb6cdffa5 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:12.689907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:12.706889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1adfb25-f68e-4de6-b7d4-56ee9f2ad271 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:12.741689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a793213-b9cb-4a42-8192-2e294e4519bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:12.742300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793213-b9cb-4a42-8192-2e294e4519bd None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:12.742587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793213-b9cb-4a42-8192-2e294e4519bd None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:12.742867 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a793213-b9cb-4a42-8192-2e294e4519bd None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:12.743503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a793213-b9cb-4a42-8192-2e294e4519bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:12.744972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a793213-b9cb-4a42-8192-2e294e4519bd None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:12.767293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673041f8-aeae-4de4-8eff-efddb6cdffa5 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:12.800944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda79ff9-8120-4468-beb2-1bb71865c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:12.801561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda79ff9-8120-4468-beb2-1bb71865c074 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:12.801838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda79ff9-8120-4468-beb2-1bb71865c074 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:12.802115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda79ff9-8120-4468-beb2-1bb71865c074 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:12.808864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda79ff9-8120-4468-beb2-1bb71865c074 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:12.810547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda79ff9-8120-4468-beb2-1bb71865c074 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:12.811344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 350/704] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:57:12 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:12.812587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cba20-45e7-4223-877f-d8b181d82f4a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:12.812873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cba20-45e7-4223-877f-d8b181d82f4a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:12.813142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cba20-45e7-4223-877f-d8b181d82f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:12.827156 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-cda79ff9-8120-4468-beb2-1bb71865c074 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:12.830265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:12.831149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:12.832077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:12.832077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:12.832077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:12.832077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:12.832077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:12.832077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:12.832077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:12.832077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:12.832077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 355/705] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:12.832077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a76282-25d6-4f70-a157-c3b2e0f38aa8 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:12.832651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a76282-25d6-4f70-a157-c3b2e0f38aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:12.832651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a76282-25d6-4f70-a157-c3b2e0f38aa8 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:12.834201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 356/706] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:12.834781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a76282-25d6-4f70-a157-c3b2e0f38aa8 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:12.849924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-d66cba20-45e7-4223-877f-d8b181d82f4a None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:12.851850 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d66cba20-45e7-4223-877f-d8b181d82f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:12.933640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:12.944277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 351/707] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:12.944277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cba20-45e7-4223-877f-d8b181d82f4a None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:12.972421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a76282-25d6-4f70-a157-c3b2e0f38aa8 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:13.016887 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca3b4e-bc13-4f16-a392-ec6474a6ee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:13.017515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca3b4e-bc13-4f16-a392-ec6474a6ee48 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:13.017795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca3b4e-bc13-4f16-a392-ec6474a6ee48 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:13.018068 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca3b4e-bc13-4f16-a392-ec6474a6ee48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:13.029348 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca3b4e-bc13-4f16-a392-ec6474a6ee48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:13.031934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca3b4e-bc13-4f16-a392-ec6474a6ee48 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-dbca3b4e-bc13-4f16-a392-ec6474a6ee48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:13.047406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:13.048436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:13.049584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:13.049584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:13.049584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:13.049584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:13.049584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:13.049584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:13.049584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:13.049584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:13.050127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 357/708] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:13.055359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5062-0f0d-448b-9ff6-a3f6b514f585 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:13.055359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5062-0f0d-448b-9ff6-a3f6b514f585 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:13.055359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a5062-0f0d-448b-9ff6-a3f6b514f585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:13.067468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cba20-45e7-4223-877f-d8b181d82f4a None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:13.072848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b35a5062-0f0d-448b-9ff6-a3f6b514f585 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:13.074967 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b35a5062-0f0d-448b-9ff6-a3f6b514f585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:13.110968 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b742005-f738-4367-9f3b-9c934fd90e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:13.111588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b742005-f738-4367-9f3b-9c934fd90e9b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:13.111866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b742005-f738-4367-9f3b-9c934fd90e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:13.112139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b742005-f738-4367-9f3b-9c934fd90e9b None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:13.112871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b742005-f738-4367-9f3b-9c934fd90e9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:13.113176 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b742005-f738-4367-9f3b-9c934fd90e9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:13.114735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b742005-f738-4367-9f3b-9c934fd90e9b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:13.116675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:13.132395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 352/709] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:13.133293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b742005-f738-4367-9f3b-9c934fd90e9b None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:13.161268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 358/710] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:13.162117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a5062-0f0d-448b-9ff6-a3f6b514f585 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:13.258567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:13.286126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b742005-f738-4367-9f3b-9c934fd90e9b None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:13.291161 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a5062-0f0d-448b-9ff6-a3f6b514f585 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:13.330902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807879ab-2266-42b6-a76c-41b08b2e1c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:13.331877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807879ab-2266-42b6-a76c-41b08b2e1c42 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:13.332433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807879ab-2266-42b6-a76c-41b08b2e1c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:13.332944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807879ab-2266-42b6-a76c-41b08b2e1c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:13.333970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807879ab-2266-42b6-a76c-41b08b2e1c42 None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=84368e89b0b34a54996def03671a1454) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:13.334444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807879ab-2266-42b6-a76c-41b08b2e1c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:13.334558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40331e-cf0b-448e-b0ea-682bac8b42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:13.335119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40331e-cf0b-448e-b0ea-682bac8b42db None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:13.335398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40331e-cf0b-448e-b0ea-682bac8b42db None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:13.335668 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40331e-cf0b-448e-b0ea-682bac8b42db None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:13.336398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40331e-cf0b-448e-b0ea-682bac8b42db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:13.336833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807879ab-2266-42b6-a76c-41b08b2e1c42 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:13.336986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40331e-cf0b-448e-b0ea-682bac8b42db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:13.338423 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40331e-cf0b-448e-b0ea-682bac8b42db None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:13.352356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 359/711] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:13 2022] GET /identity/v3/role_assignments?user.id=84368e89b0b34a54996def03671a1454&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:13.353626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807879ab-2266-42b6-a76c-41b08b2e1c42 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:13.353920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 353/712] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:13.360009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40331e-cf0b-448e-b0ea-682bac8b42db None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:13.486751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:13.545193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40331e-cf0b-448e-b0ea-682bac8b42db None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:13.558609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807879ab-2266-42b6-a76c-41b08b2e1c42 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:13.590116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6e00b-7b05-4288-86fa-37103b6f7507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:13.590895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6e00b-7b05-4288-86fa-37103b6f7507 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:13.591170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6e00b-7b05-4288-86fa-37103b6f7507 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:13.592024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6e00b-7b05-4288-86fa-37103b6f7507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:13.592802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6e00b-7b05-4288-86fa-37103b6f7507 None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=8af51476b48e45efbc3b626f9780e0be) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:13.593108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6e00b-7b05-4288-86fa-37103b6f7507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:13.594570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6e00b-7b05-4288-86fa-37103b6f7507 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:13.598653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77ea4a-7703-4a53-b2b8-3b94a8a62d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:13.599481 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77ea4a-7703-4a53-b2b8-3b94a8a62d53 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:13.599933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77ea4a-7703-4a53-b2b8-3b94a8a62d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:13.600396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77ea4a-7703-4a53-b2b8-3b94a8a62d53 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:13.600786 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 354/713] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:13 2022] GET /identity/v3/role_assignments?user.id=8af51476b48e45efbc3b626f9780e0be&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:13.601350 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77ea4a-7703-4a53-b2b8-3b94a8a62d53 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:13.601590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6e00b-7b05-4288-86fa-37103b6f7507 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:13.603089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77ea4a-7703-4a53-b2b8-3b94a8a62d53 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:13.606931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-2f77ea4a-7703-4a53-b2b8-3b94a8a62d53 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:13.617193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:13.626847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:13.627894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 360/714] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Aug 24 16:57:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:13.631418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77ea4a-7703-4a53-b2b8-3b94a8a62d53 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:13.732166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6e00b-7b05-4288-86fa-37103b6f7507 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:13.756027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:13.774744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb65b0-3ece-44b4-9be5-380998504832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:13.775842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb65b0-3ece-44b4-9be5-380998504832 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:13.777137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb65b0-3ece-44b4-9be5-380998504832 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:13.777517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb65b0-3ece-44b4-9be5-380998504832 None admin] PATH_INFO: `/v3/services/network` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:13.778220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb65b0-3ece-44b4-9be5-380998504832 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:13.779703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adb65b0-3ece-44b4-9be5-380998504832 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:13.791036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77ea4a-7703-4a53-b2b8-3b94a8a62d53 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-1adb65b0-3ece-44b4-9be5-380998504832 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:13.810500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:13.811753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:13.814944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 355/715] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:13 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:13.819677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb65b0-3ece-44b4-9be5-380998504832 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:13.845004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fe8c1-e5e3-46be-834e-527fb21800a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:13.846359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe8c1-e5e3-46be-834e-527fb21800a4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:13.846786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe8c1-e5e3-46be-834e-527fb21800a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:13.847202 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fe8c1-e5e3-46be-834e-527fb21800a4 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:13.847991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fe8c1-e5e3-46be-834e-527fb21800a4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:13.851646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fe8c1-e5e3-46be-834e-527fb21800a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:13.851646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fe8c1-e5e3-46be-834e-527fb21800a4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:13.862459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 361/716] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Aug 24 16:57:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:13.864427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fe8c1-e5e3-46be-834e-527fb21800a4 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:13.947133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adb65b0-3ece-44b4-9be5-380998504832 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:13.989821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a814-d886-476a-a613-f1ac2a18680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:13.990441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a814-d886-476a-a613-f1ac2a18680a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:13.990720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a814-d886-476a-a613-f1ac2a18680a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:13.990992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a814-d886-476a-a613-f1ac2a18680a None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:13.992054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320a814-d886-476a-a613-f1ac2a18680a None admin] RBAC: Adding query filter params (name=network) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:13.992391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320a814-d886-476a-a613-f1ac2a18680a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:13.993933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320a814-d886-476a-a613-f1ac2a18680a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:13.997133 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:14.001119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 356/717] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:14.009463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a814-d886-476a-a613-f1ac2a18680a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:14.069588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fe8c1-e5e3-46be-834e-527fb21800a4 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:14.108744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:14.140985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d926cea-6f31-4622-a8e9-7d361e3084b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:14.142339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d926cea-6f31-4622-a8e9-7d361e3084b0 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:14.143525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d926cea-6f31-4622-a8e9-7d361e3084b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:14.143930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d926cea-6f31-4622-a8e9-7d361e3084b0 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:14.145389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d926cea-6f31-4622-a8e9-7d361e3084b0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:14.146102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d926cea-6f31-4622-a8e9-7d361e3084b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:14.149234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d926cea-6f31-4622-a8e9-7d361e3084b0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:14.162308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 362/718] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Aug 24 16:57:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:14.201774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a814-d886-476a-a613-f1ac2a18680a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:14.252379 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da78bf3d-6628-4a4e-b230-2bb908831255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:14.253044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78bf3d-6628-4a4e-b230-2bb908831255 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:14.253325 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78bf3d-6628-4a4e-b230-2bb908831255 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:14.253596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78bf3d-6628-4a4e-b230-2bb908831255 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:14.254237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78bf3d-6628-4a4e-b230-2bb908831255 None admin] RBAC: Adding query filter params (type=network) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:14.254539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78bf3d-6628-4a4e-b230-2bb908831255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:14.256025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da78bf3d-6628-4a4e-b230-2bb908831255 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:14.263394 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 357/719] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:15.085332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f562b38-df41-4283-b245-4904d0230d41 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:15.086378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f562b38-df41-4283-b245-4904d0230d41 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:15.086863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f562b38-df41-4283-b245-4904d0230d41 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:15.090265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 363/720] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:15.096044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6701c-c694-46f7-ad89-1fb3e70ee8e3 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:15.097423 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6701c-c694-46f7-ad89-1fb3e70ee8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:15.098226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6701c-c694-46f7-ad89-1fb3e70ee8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:15.123472 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-fcb6701c-c694-46f7-ad89-1fb3e70ee8e3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:15.125078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fcb6701c-c694-46f7-ad89-1fb3e70ee8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:15.213606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 358/721] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:15.609141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f562b38-df41-4283-b245-4904d0230d41 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:15.727204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f562b38-df41-4283-b245-4904d0230d41 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:15.755319 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:15.764037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02adc1c-56b6-4f7a-84f6-eb08273e79ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:15.764991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02adc1c-56b6-4f7a-84f6-eb08273e79ee None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:15.765369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02adc1c-56b6-4f7a-84f6-eb08273e79ee None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:15.765642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02adc1c-56b6-4f7a-84f6-eb08273e79ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:15.778115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02adc1c-56b6-4f7a-84f6-eb08273e79ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-b02adc1c-56b6-4f7a-84f6-eb08273e79ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:15.782998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:15.783901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:15.784761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 364/722] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:57:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:15.790150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6701c-c694-46f7-ad89-1fb3e70ee8e3 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:15.834225 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:15.913241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6701c-c694-46f7-ad89-1fb3e70ee8e3 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:15.960934 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc99f03-6464-4bf7-b271-15395f29e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:15.961611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99f03-6464-4bf7-b271-15395f29e81a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:15.961893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99f03-6464-4bf7-b271-15395f29e81a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:15.962227 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc99f03-6464-4bf7-b271-15395f29e81a None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:15.962894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc99f03-6464-4bf7-b271-15395f29e81a None admin] RBAC: Adding query filter params (name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:15.963238 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc99f03-6464-4bf7-b271-15395f29e81a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:15.965212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc99f03-6464-4bf7-b271-15395f29e81a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:15.973836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 359/723] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:57:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:15.979667 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02adc1c-56b6-4f7a-84f6-eb08273e79ee None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:16.058525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bb383-c057-4747-bab9-f500e6d41bcf None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.058858 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bb383-c057-4747-bab9-f500e6d41bcf None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.059381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bb383-c057-4747-bab9-f500e6d41bcf None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.060874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 360/724] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:16.075068 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc21922-bc38-45f3-ada0-0b5ead58cc01 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.075357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc21922-bc38-45f3-ada0-0b5ead58cc01 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.075638 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc21922-bc38-45f3-ada0-0b5ead58cc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.106888 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-6cc21922-bc38-45f3-ada0-0b5ead58cc01 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:16.108112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6cc21922-bc38-45f3-ada0-0b5ead58cc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:16.130342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02adc1c-56b6-4f7a-84f6-eb08273e79ee None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:16.179373 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9098b8-7b35-4be1-a487-63510edf0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:16.179952 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9098b8-7b35-4be1-a487-63510edf0295 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.180779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9098b8-7b35-4be1-a487-63510edf0295 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.181158 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9098b8-7b35-4be1-a487-63510edf0295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.196268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9098b8-7b35-4be1-a487-63510edf0295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:16.197852 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9098b8-7b35-4be1-a487-63510edf0295 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:16.204622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 361/725] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:16.206347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea1015-eec2-4674-bdd6-da549f5493d7 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.206891 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea1015-eec2-4674-bdd6-da549f5493d7 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.207367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea1015-eec2-4674-bdd6-da549f5493d7 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.212613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 362/726] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-0f9098b8-7b35-4be1-a487-63510edf0295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:16.216270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:16.217186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:16.218067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:16.218067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:16.218067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:16.220323 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 365/727] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:16.221442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea1015-eec2-4674-bdd6-da549f5493d7 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:16.225766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc52bf5-bab6-46a0-b600-2589f937fd42 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.226213 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc52bf5-bab6-46a0-b600-2589f937fd42 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.226632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc52bf5-bab6-46a0-b600-2589f937fd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.248220 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-3cc52bf5-bab6-46a0-b600-2589f937fd42 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:16.249995 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3cc52bf5-bab6-46a0-b600-2589f937fd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:16.300823 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:16.320365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:16.368900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 366/728] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:57:16.436061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea1015-eec2-4674-bdd6-da549f5493d7 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:16.479872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f492da-753b-45f5-95de-f4217840ce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:16.480505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f492da-753b-45f5-95de-f4217840ce04 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.480832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f492da-753b-45f5-95de-f4217840ce04 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.481111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f492da-753b-45f5-95de-f4217840ce04 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.481807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f492da-753b-45f5-95de-f4217840ce04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:16.482113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f492da-753b-45f5-95de-f4217840ce04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:16.483488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f492da-753b-45f5-95de-f4217840ce04 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:16.499153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 363/729] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:16.504821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc52bf5-bab6-46a0-b600-2589f937fd42 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:16.543022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f492da-753b-45f5-95de-f4217840ce04 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:16.670507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc52bf5-bab6-46a0-b600-2589f937fd42 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:16.683537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:16.693781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f492da-753b-45f5-95de-f4217840ce04 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:16.708606 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00fba66-15ec-4288-9277-3a477fbb2059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:16.709237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fba66-15ec-4288-9277-3a477fbb2059 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.709514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fba66-15ec-4288-9277-3a477fbb2059 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.709782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fba66-15ec-4288-9277-3a477fbb2059 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.718144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fba66-15ec-4288-9277-3a477fbb2059 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:16.719687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00fba66-15ec-4288-9277-3a477fbb2059 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:16.730411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1841884-6c47-422f-b848-761c88c03e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:16.731054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1841884-6c47-422f-b848-761c88c03e3f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.731331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1841884-6c47-422f-b848-761c88c03e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-f00fba66-15ec-4288-9277-3a477fbb2059 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:16.731432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:16.732335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:16.733266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:16.733266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:16.733266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:16.733266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:16.733266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:16.733266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:16.733266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:16.733266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:16.733266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:16.733266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:16.733813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1841884-6c47-422f-b848-761c88c03e3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.733884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 367/730] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Aug 24 16:57:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:16.733884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886a33d-668a-48b8-8190-96006db52b2b None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.734004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886a33d-668a-48b8-8190-96006db52b2b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.734713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886a33d-668a-48b8-8190-96006db52b2b None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.735544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 368/731] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:16.736080 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886a33d-668a-48b8-8190-96006db52b2b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:16.752162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1841884-6c47-422f-b848-761c88c03e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-a1841884-6c47-422f-b848-761c88c03e3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:16.757327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:16.758270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:16.759115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 364/732] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:16.759898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1841884-6c47-422f-b848-761c88c03e3f None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:16.768254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:16.842838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886a33d-668a-48b8-8190-96006db52b2b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:16.861915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1841884-6c47-422f-b848-761c88c03e3f None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:16.883572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61470117-4f33-43e4-9438-e426fb7dc1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:16.884218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470117-4f33-43e4-9438-e426fb7dc1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.884517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470117-4f33-43e4-9438-e426fb7dc1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.884828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470117-4f33-43e4-9438-e426fb7dc1c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.895977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61470117-4f33-43e4-9438-e426fb7dc1c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:16.897944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fae1ac-5bb9-402d-b052-c41eccf740d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:16.898652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fae1ac-5bb9-402d-b052-c41eccf740d9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.898934 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fae1ac-5bb9-402d-b052-c41eccf740d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.899208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fae1ac-5bb9-402d-b052-c41eccf740d9 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.899943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fae1ac-5bb9-402d-b052-c41eccf740d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:16.900271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fae1ac-5bb9-402d-b052-c41eccf740d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-61470117-4f33-43e4-9438-e426fb7dc1c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:16.900742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:16.901883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:16.902881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 369/733] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:16.903710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb76cc-f861-4fb0-a554-c082207186ba None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.903710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb76cc-f861-4fb0-a554-c082207186ba None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.903871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb76cc-f861-4fb0-a554-c082207186ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:16.907020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fae1ac-5bb9-402d-b052-c41eccf740d9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:16.926704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 365/734] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Aug 24 16:57:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:16.927554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fae1ac-5bb9-402d-b052-c41eccf740d9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:16.928912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-aecb76cc-f861-4fb0-a554-c082207186ba None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:16.930119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-aecb76cc-f861-4fb0-a554-c082207186ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:16.941549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:16.997715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 370/735] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:16.999230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6084-2cc2-47e8-973a-6d5ad46c1157 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:16.999524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6084-2cc2-47e8-973a-6d5ad46c1157 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:16.999804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd6084-2cc2-47e8-973a-6d5ad46c1157 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:17.001402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 371/736] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:17.001960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd6084-2cc2-47e8-973a-6d5ad46c1157 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:17.024473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:17.036027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fae1ac-5bb9-402d-b052-c41eccf740d9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:17.072983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558b9a3-9387-4215-9aa0-be2b13cf0878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:17.074398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b9a3-9387-4215-9aa0-be2b13cf0878 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:17.074810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b9a3-9387-4215-9aa0-be2b13cf0878 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:17.075205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b9a3-9387-4215-9aa0-be2b13cf0878 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:17.076000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558b9a3-9387-4215-9aa0-be2b13cf0878 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:17.076340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558b9a3-9387-4215-9aa0-be2b13cf0878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:17.077714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558b9a3-9387-4215-9aa0-be2b13cf0878 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:17.087162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 366/737] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:57:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:17.088028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558b9a3-9387-4215-9aa0-be2b13cf0878 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:17.113402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd6084-2cc2-47e8-973a-6d5ad46c1157 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:17.148658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c3ac4-8a80-48e3-a2bd-619b7d5476f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:17.149345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c3ac4-8a80-48e3-a2bd-619b7d5476f4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:17.149611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c3ac4-8a80-48e3-a2bd-619b7d5476f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:17.149788 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c3ac4-8a80-48e3-a2bd-619b7d5476f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:17.150432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c3ac4-8a80-48e3-a2bd-619b7d5476f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:17.150726 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c3ac4-8a80-48e3-a2bd-619b7d5476f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:17.152112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c3ac4-8a80-48e3-a2bd-619b7d5476f4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:17.164645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 372/738] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:17.164645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977c22-e5db-49b0-9fa3-cef1ebc4b6b1 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:17.164645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977c22-e5db-49b0-9fa3-cef1ebc4b6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:17.164645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38977c22-e5db-49b0-9fa3-cef1ebc4b6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:17.178289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:17.180143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-38977c22-e5db-49b0-9fa3-cef1ebc4b6b1 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:17.181418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-38977c22-e5db-49b0-9fa3-cef1ebc4b6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:17.209841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558b9a3-9387-4215-9aa0-be2b13cf0878 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:17.245724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68f530-183f-4b54-ae26-ec70fee15ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:17.246327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f530-183f-4b54-ae26-ec70fee15ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:17.246603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f530-183f-4b54-ae26-ec70fee15ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:17.246866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f530-183f-4b54-ae26-ec70fee15ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:17.256477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 373/739] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:57:17.257062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38977c22-e5db-49b0-9fa3-cef1ebc4b6b1 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:17.270650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:17.336036 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68f530-183f-4b54-ae26-ec70fee15ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:17.337649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68f530-183f-4b54-ae26-ec70fee15ea4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:17.375772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38977c22-e5db-49b0-9fa3-cef1ebc4b6b1 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:17.412724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8d6e6-ef47-4e0f-b8fa-3ae550ffec99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:17.413054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:17.413504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8d6e6-ef47-4e0f-b8fa-3ae550ffec99 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:17.413858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8d6e6-ef47-4e0f-b8fa-3ae550ffec99 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:17.414134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8d6e6-ef47-4e0f-b8fa-3ae550ffec99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:17.425587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8d6e6-ef47-4e0f-b8fa-3ae550ffec99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:17.427151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8d6e6-ef47-4e0f-b8fa-3ae550ffec99 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-0cd8d6e6-ef47-4e0f-b8fa-3ae550ffec99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:17.443404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:17.444468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:17.445407 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:17.445407 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:17.445407 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:17.445407 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 374/740] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:17.445638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8d6e6-ef47-4e0f-b8fa-3ae550ffec99 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:17.453444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 367/741] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:57:17.454994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68f530-183f-4b54-ae26-ec70fee15ea4 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:17.513815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:17.554797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8d6e6-ef47-4e0f-b8fa-3ae550ffec99 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:17.563265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68f530-183f-4b54-ae26-ec70fee15ea4 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:17.589896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86840c24-8e77-483e-a6e1-b379fc25b4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:17.590681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86840c24-8e77-483e-a6e1-b379fc25b4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:17.591282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86840c24-8e77-483e-a6e1-b379fc25b4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:17.591552 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86840c24-8e77-483e-a6e1-b379fc25b4b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:17.598241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8c54e-2690-4f2f-8b8e-711c6c7807b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:17.598843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8c54e-2690-4f2f-8b8e-711c6c7807b6 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:17.599124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8c54e-2690-4f2f-8b8e-711c6c7807b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:17.599385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b8c54e-2690-4f2f-8b8e-711c6c7807b6 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:17.600025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8c54e-2690-4f2f-8b8e-711c6c7807b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:17.601419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b8c54e-2690-4f2f-8b8e-711c6c7807b6 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:17.601985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86840c24-8e77-483e-a6e1-b379fc25b4b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:17.603416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86840c24-8e77-483e-a6e1-b379fc25b4b9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-86840c24-8e77-483e-a6e1-b379fc25b4b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:17.618182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:17.619327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:17.620423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:17.620423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:17.620423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:17.620423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 375/742] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:17.620877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86840c24-8e77-483e-a6e1-b379fc25b4b9 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:17.703157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 368/743] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:57:17 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:17.703990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8c54e-2690-4f2f-8b8e-711c6c7807b6 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:17.725617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86840c24-8e77-483e-a6e1-b379fc25b4b9 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:17.742764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:17.743841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:17.784076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de09c-2751-4370-a265-165cbcf21483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:17.784681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de09c-2751-4370-a265-165cbcf21483 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:17.785040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de09c-2751-4370-a265-165cbcf21483 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:17.785299 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024de09c-2751-4370-a265-165cbcf21483 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:17.785966 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de09c-2751-4370-a265-165cbcf21483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:17.786271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de09c-2751-4370-a265-165cbcf21483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:17.787724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024de09c-2751-4370-a265-165cbcf21483 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:17.801972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 376/744] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:17.802713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de09c-2751-4370-a265-165cbcf21483 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:17.828290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b8c54e-2690-4f2f-8b8e-711c6c7807b6 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:17.870808 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4e927-aefa-417e-865f-fdfe80f77222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:17.871455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4e927-aefa-417e-865f-fdfe80f77222 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:17.871728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4e927-aefa-417e-865f-fdfe80f77222 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:17.871996 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4e927-aefa-417e-865f-fdfe80f77222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:17.883941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4e927-aefa-417e-865f-fdfe80f77222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:17.885427 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4e927-aefa-417e-865f-fdfe80f77222 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-a2c4e927-aefa-417e-865f-fdfe80f77222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:17.903517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:17.904743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:17.911308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:17.911308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:17.911308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:17.911308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 369/745] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:17.911308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4e927-aefa-417e-865f-fdfe80f77222 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:17.933796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024de09c-2751-4370-a265-165cbcf21483 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:17.971594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee4eea-7973-4a53-8c9c-888cd5281310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:17.972248 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee4eea-7973-4a53-8c9c-888cd5281310 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:17.972528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee4eea-7973-4a53-8c9c-888cd5281310 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:17.972796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee4eea-7973-4a53-8c9c-888cd5281310 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:17.973431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee4eea-7973-4a53-8c9c-888cd5281310 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:17.974792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee4eea-7973-4a53-8c9c-888cd5281310 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:17.998150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:18.014128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4e927-aefa-417e-865f-fdfe80f77222 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:18.048588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5eaf3-d99b-4e79-b162-c5c115155c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:18.049107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5eaf3-d99b-4e79-b162-c5c115155c60 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:18.049385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5eaf3-d99b-4e79-b162-c5c115155c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:18.049653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5eaf3-d99b-4e79-b162-c5c115155c60 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:18.050288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5eaf3-d99b-4e79-b162-c5c115155c60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:18.050589 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5eaf3-d99b-4e79-b162-c5c115155c60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:18.051997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5eaf3-d99b-4e79-b162-c5c115155c60 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:18.064173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 370/746] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:18.065123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5eaf3-d99b-4e79-b162-c5c115155c60 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:18.080821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 377/747] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:57:17 2022] POST /identity/v3/services => generated 240 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:18.081941 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee4eea-7973-4a53-8c9c-888cd5281310 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:18.125698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:18.218014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5eaf3-d99b-4e79-b162-c5c115155c60 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:18.231793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee4eea-7973-4a53-8c9c-888cd5281310 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:18.267729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bca03-3ebc-4fd7-9f02-2db9fb42c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:18.268426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bca03-3ebc-4fd7-9f02-2db9fb42c347 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:18.268702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bca03-3ebc-4fd7-9f02-2db9fb42c347 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:18.268988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bca03-3ebc-4fd7-9f02-2db9fb42c347 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:18.278498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bca03-3ebc-4fd7-9f02-2db9fb42c347 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:18.279965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bca03-3ebc-4fd7-9f02-2db9fb42c347 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:18.280143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded966-8e96-41a0-86d4-803836421527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:18.280808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded966-8e96-41a0-86d4-803836421527 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:18.281084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded966-8e96-41a0-86d4-803836421527 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:18.281356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ded966-8e96-41a0-86d4-803836421527 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:18.282003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ded966-8e96-41a0-86d4-803836421527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:18.282300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ded966-8e96-41a0-86d4-803836421527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:18.283649 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ded966-8e96-41a0-86d4-803836421527 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:18.298397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 378/748] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-cf8bca03-3ebc-4fd7-9f02-2db9fb42c347 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:18.299190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:18.300071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:18.301311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:18.301311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:18.301311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:18.301311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:18.301311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:18.301311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:18.301311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:18.301311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:18.301311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:57:18.301311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:18.301844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded966-8e96-41a0-86d4-803836421527 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:18.302282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 371/749] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Aug 24 16:57:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:18.303401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bca03-3ebc-4fd7-9f02-2db9fb42c347 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:18.309547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:18.420199 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bca03-3ebc-4fd7-9f02-2db9fb42c347 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:18.420603 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:18.442965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ded966-8e96-41a0-86d4-803836421527 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:18.458001 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec52f54-cb1e-4707-b43c-40b7eca6a594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:18.458716 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52f54-cb1e-4707-b43c-40b7eca6a594 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:18.459020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52f54-cb1e-4707-b43c-40b7eca6a594 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:18.459429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52f54-cb1e-4707-b43c-40b7eca6a594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:18.466966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec52f54-cb1e-4707-b43c-40b7eca6a594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:18.468457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec52f54-cb1e-4707-b43c-40b7eca6a594 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-eec52f54-cb1e-4707-b43c-40b7eca6a594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:18.480830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:18.481754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:18.482908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:18.482908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:18.482908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:18.482908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:18.482908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:18.482908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:18.482908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:18.482908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:18.482908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 372/750] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:18.483560 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec52f54-cb1e-4707-b43c-40b7eca6a594 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:18.498271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804a7b5-c32b-41ef-8de2-0c12dd50756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:18.499449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a7b5-c32b-41ef-8de2-0c12dd50756f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:18.500116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a7b5-c32b-41ef-8de2-0c12dd50756f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:18.500490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804a7b5-c32b-41ef-8de2-0c12dd50756f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:18.511109 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804a7b5-c32b-41ef-8de2-0c12dd50756f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:18.513416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804a7b5-c32b-41ef-8de2-0c12dd50756f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-d804a7b5-c32b-41ef-8de2-0c12dd50756f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:18.528911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:18.530149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:18.531282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:18.531282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:18.531282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:18.531282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:18.531282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:18.531282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:18.531282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:18.531282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:18.531282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:57:18.531282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:18.533125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 379/751] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:18.534151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804a7b5-c32b-41ef-8de2-0c12dd50756f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:18.562491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:18.614850 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec52f54-cb1e-4707-b43c-40b7eca6a594 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:18.651931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804a7b5-c32b-41ef-8de2-0c12dd50756f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:18.657667 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb0863-1ed5-43ce-8656-0e99d227b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:18.658478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0863-1ed5-43ce-8656-0e99d227b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:18.658932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0863-1ed5-43ce-8656-0e99d227b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:18.659356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb0863-1ed5-43ce-8656-0e99d227b0d6 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:18.660262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb0863-1ed5-43ce-8656-0e99d227b0d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:18.660741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb0863-1ed5-43ce-8656-0e99d227b0d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:18.662335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb0863-1ed5-43ce-8656-0e99d227b0d6 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:18.683363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 373/752] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Aug 24 16:57:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:18.684941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb0863-1ed5-43ce-8656-0e99d227b0d6 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:18.700906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e3d33-d96f-4db0-9f65-cc7121cc756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:18.703417 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e3d33-d96f-4db0-9f65-cc7121cc756d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:18.704265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e3d33-d96f-4db0-9f65-cc7121cc756d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:18.704618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e3d33-d96f-4db0-9f65-cc7121cc756d None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:18.705687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e3d33-d96f-4db0-9f65-cc7121cc756d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:18.706075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e3d33-d96f-4db0-9f65-cc7121cc756d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:18.707923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e3d33-d96f-4db0-9f65-cc7121cc756d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:18.729327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 380/753] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:18.730624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e3d33-d96f-4db0-9f65-cc7121cc756d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:18.742214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:18.816127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb0863-1ed5-43ce-8656-0e99d227b0d6 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:18.848727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e3d33-d96f-4db0-9f65-cc7121cc756d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:18.855434 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:18.863305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57c124-9d07-4324-a82e-6d4802ed55a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:18.864440 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57c124-9d07-4324-a82e-6d4802ed55a9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:18.864731 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57c124-9d07-4324-a82e-6d4802ed55a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:18.865011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57c124-9d07-4324-a82e-6d4802ed55a9 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:18.865780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57c124-9d07-4324-a82e-6d4802ed55a9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:18.866091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57c124-9d07-4324-a82e-6d4802ed55a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:18.867935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb57c124-9d07-4324-a82e-6d4802ed55a9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:18.891310 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32ea18-30c1-4d84-a2ad-21adbbbc5d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:18.892098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32ea18-30c1-4d84-a2ad-21adbbbc5d86 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:18.892536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32ea18-30c1-4d84-a2ad-21adbbbc5d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:18.892988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32ea18-30c1-4d84-a2ad-21adbbbc5d86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:18.893988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 374/754] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Aug 24 16:57:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:18.894986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57c124-9d07-4324-a82e-6d4802ed55a9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:18.907176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32ea18-30c1-4d84-a2ad-21adbbbc5d86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:18.908972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32ea18-30c1-4d84-a2ad-21adbbbc5d86 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-7b32ea18-30c1-4d84-a2ad-21adbbbc5d86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:18.932078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:18.933408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:18.934691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:18.934691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:18.934691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:18.934691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 381/755] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:18.934691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32ea18-30c1-4d84-a2ad-21adbbbc5d86 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:19.009883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:19.023780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57c124-9d07-4324-a82e-6d4802ed55a9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:19.066319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b189-5a04-4ecd-a069-d40155d7692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:19.067009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b189-5a04-4ecd-a069-d40155d7692f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:19.067385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b189-5a04-4ecd-a069-d40155d7692f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:19.067757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b189-5a04-4ecd-a069-d40155d7692f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:19.068186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32ea18-30c1-4d84-a2ad-21adbbbc5d86 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:19.068700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277b189-5a04-4ecd-a069-d40155d7692f None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=aa7e5d51065e4d7dba5b1a433998142e) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:19.069129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277b189-5a04-4ecd-a069-d40155d7692f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:19.070655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277b189-5a04-4ecd-a069-d40155d7692f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:19.084997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 375/756] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:18 2022] GET /identity/v3/role_assignments?user.id=aa7e5d51065e4d7dba5b1a433998142e&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:19.084997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b189-5a04-4ecd-a069-d40155d7692f None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:19.147795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50480a4e-d53c-4c14-995a-68e9134cab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:19.148501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50480a4e-d53c-4c14-995a-68e9134cab8b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:19.148782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50480a4e-d53c-4c14-995a-68e9134cab8b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:19.149053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50480a4e-d53c-4c14-995a-68e9134cab8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:19.184684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:19.253123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b189-5a04-4ecd-a069-d40155d7692f None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:19.314462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b8221-0ca7-4ff7-b3fe-77731cabfa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:19.315119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b8221-0ca7-4ff7-b3fe-77731cabfa85 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:19.319471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b8221-0ca7-4ff7-b3fe-77731cabfa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:19.319471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b8221-0ca7-4ff7-b3fe-77731cabfa85 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:19.319471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b8221-0ca7-4ff7-b3fe-77731cabfa85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:19.319471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b8221-0ca7-4ff7-b3fe-77731cabfa85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:19.319471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b8221-0ca7-4ff7-b3fe-77731cabfa85 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:19.332852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 376/757] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:19.339662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50480a4e-d53c-4c14-995a-68e9134cab8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:19.339662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50480a4e-d53c-4c14-995a-68e9134cab8b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:19.341963 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b8221-0ca7-4ff7-b3fe-77731cabfa85 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:19.467423 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b8221-0ca7-4ff7-b3fe-77731cabfa85 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:19.505080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:19.512701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d985357-d5e4-4cde-9f0d-d53c9aaf52a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:19.513370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985357-d5e4-4cde-9f0d-d53c9aaf52a7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:19.513686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985357-d5e4-4cde-9f0d-d53c9aaf52a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:19.513977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:19.514721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985357-d5e4-4cde-9f0d-d53c9aaf52a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:19.527093 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d985357-d5e4-4cde-9f0d-d53c9aaf52a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:19.528616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d985357-d5e4-4cde-9f0d-d53c9aaf52a7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-7d985357-d5e4-4cde-9f0d-d53c9aaf52a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:19.556131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:19.557114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:19.558695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:19.558695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:19.558695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:19.558695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:19.558695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:19.558695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:19.558695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:19.558695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:19.558695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 377/758] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:19.559452 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 382/759] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:57:19.564112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d985357-d5e4-4cde-9f0d-d53c9aaf52a7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:19.569246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50480a4e-d53c-4c14-995a-68e9134cab8b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:19.707788 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50480a4e-d53c-4c14-995a-68e9134cab8b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:19.746701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563039c-1db2-4637-8b95-8061d3b311d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:19.747318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563039c-1db2-4637-8b95-8061d3b311d0 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:19.747598 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563039c-1db2-4637-8b95-8061d3b311d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:19.747870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563039c-1db2-4637-8b95-8061d3b311d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:19.748613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563039c-1db2-4637-8b95-8061d3b311d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:19.748919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563039c-1db2-4637-8b95-8061d3b311d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:19.750334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563039c-1db2-4637-8b95-8061d3b311d0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:19.768379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 383/760] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:19.769985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563039c-1db2-4637-8b95-8061d3b311d0 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:19.793022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:19.831417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d985357-d5e4-4cde-9f0d-d53c9aaf52a7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:19.872306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd4f85-ac67-445c-b823-cefa4b3abf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:19.872990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4f85-ac67-445c-b823-cefa4b3abf1f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:19.873276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4f85-ac67-445c-b823-cefa4b3abf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:19.873549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd4f85-ac67-445c-b823-cefa4b3abf1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:19.886139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd4f85-ac67-445c-b823-cefa4b3abf1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:19.887980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd4f85-ac67-445c-b823-cefa4b3abf1f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:19.893820 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563039c-1db2-4637-8b95-8061d3b311d0 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-56fd4f85-ac67-445c-b823-cefa4b3abf1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:19.904585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:19.905755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:19.907025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:19.907025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:19.907025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:19.907025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 378/761] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:19.907401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524774-adf3-4216-9a20-35cffe4f8039 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:19.907700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524774-adf3-4216-9a20-35cffe4f8039 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:19.908108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524774-adf3-4216-9a20-35cffe4f8039 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:19.913708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 379/762] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:19.914586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d524774-adf3-4216-9a20-35cffe4f8039 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:19.935234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7548119-da2e-4451-9f4c-c2824144aa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:19.936149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7548119-da2e-4451-9f4c-c2824144aa27 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:19.936636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7548119-da2e-4451-9f4c-c2824144aa27 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:19.937112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7548119-da2e-4451-9f4c-c2824144aa27 None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/8af51476b48e45efbc3b626f9780e0be/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:19.937270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:19.939391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7548119-da2e-4451-9f4c-c2824144aa27 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=8af51476b48e45efbc3b626f9780e0be, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:19.941064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7548119-da2e-4451-9f4c-c2824144aa27 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:20.022985 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d524774-adf3-4216-9a20-35cffe4f8039 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:20.059399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c28104-e270-4eff-870a-fc0dbefb22c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:20.060014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c28104-e270-4eff-870a-fc0dbefb22c8 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:20.060325 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c28104-e270-4eff-870a-fc0dbefb22c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:20.060606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c28104-e270-4eff-870a-fc0dbefb22c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:20.061310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c28104-e270-4eff-870a-fc0dbefb22c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:20.061628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c28104-e270-4eff-870a-fc0dbefb22c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:20.063026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c28104-e270-4eff-870a-fc0dbefb22c8 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:20.079664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 380/763] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:20.079664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b49d-2b6d-4933-b3fd-1529b3775b1f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:20.079664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b49d-2b6d-4933-b3fd-1529b3775b1f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:20.079664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2b49d-2b6d-4933-b3fd-1529b3775b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:20.097955 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 384/764] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:57:19 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/8af51476b48e45efbc3b626f9780e0be/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:57:20.099290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7548119-da2e-4451-9f4c-c2824144aa27 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:20.107050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-65c2b49d-2b6d-4933-b3fd-1529b3775b1f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:20.107050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-65c2b49d-2b6d-4933-b3fd-1529b3775b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:20.237941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 381/765] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:20.239331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10a2c-62c6-4066-ac3f-810fb04d0f0a None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:20.239626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10a2c-62c6-4066-ac3f-810fb04d0f0a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:20.239905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb10a2c-62c6-4066-ac3f-810fb04d0f0a None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:20.241583 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 382/766] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:20.247151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacdfab-56d0-492b-a186-dcadf4ebc20d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:20.247468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacdfab-56d0-492b-a186-dcadf4ebc20d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:20.247702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacdfab-56d0-492b-a186-dcadf4ebc20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:20.270310 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:20.286047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:20.304191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-eaacdfab-56d0-492b-a186-dcadf4ebc20d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:20.305437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-eaacdfab-56d0-492b-a186-dcadf4ebc20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:20.305684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7548119-da2e-4451-9f4c-c2824144aa27 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:20.349681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277548-7a39-482e-9057-d3bd6db01deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:20.350508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277548-7a39-482e-9057-d3bd6db01deb None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:20.351242 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277548-7a39-482e-9057-d3bd6db01deb None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:20.351674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277548-7a39-482e-9057-d3bd6db01deb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:20.362212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5277548-7a39-482e-9057-d3bd6db01deb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:20.364292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5277548-7a39-482e-9057-d3bd6db01deb None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-c5277548-7a39-482e-9057-d3bd6db01deb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:20.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:20.381710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:20.382746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:20.382746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:20.382746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:20.382746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:20.382746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:20.382746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:20.382746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:20.382746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:20.382746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 385/767] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:20.393305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277548-7a39-482e-9057-d3bd6db01deb None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:20.397671 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 383/768] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:20.512251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277548-7a39-482e-9057-d3bd6db01deb None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:20.532089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacdfab-56d0-492b-a186-dcadf4ebc20d None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:20.560116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04119fd2-fca0-4c88-91c6-7919c8024cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:20.561115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119fd2-fca0-4c88-91c6-7919c8024cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:20.561596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119fd2-fca0-4c88-91c6-7919c8024cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:20.562070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119fd2-fca0-4c88-91c6-7919c8024cd5 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:20.562986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04119fd2-fca0-4c88-91c6-7919c8024cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:20.564301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04119fd2-fca0-4c88-91c6-7919c8024cd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:20.566536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04119fd2-fca0-4c88-91c6-7919c8024cd5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:20.579228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:20.587798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 386/769] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:20.594246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04119fd2-fca0-4c88-91c6-7919c8024cd5 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:20.707514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacdfab-56d0-492b-a186-dcadf4ebc20d None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:20.773177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8e710-fbfc-4dca-8a06-bff353332afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:20.773976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8e710-fbfc-4dca-8a06-bff353332afc None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:20.774251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8e710-fbfc-4dca-8a06-bff353332afc None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:20.774519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8e710-fbfc-4dca-8a06-bff353332afc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:20.775109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8e710-fbfc-4dca-8a06-bff353332afc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:20.777182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8e710-fbfc-4dca-8a06-bff353332afc None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:20.782043 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-8ca8e710-fbfc-4dca-8a06-bff353332afc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:20.790140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:20.791170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:20.792591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 384/770] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Aug 24 16:57:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:20.802491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8e710-fbfc-4dca-8a06-bff353332afc None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:20.802743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04119fd2-fca0-4c88-91c6-7919c8024cd5 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:20.842256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ccc3a-428c-4765-acc0-c616f2d442c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:20.842928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ccc3a-428c-4765-acc0-c616f2d442c5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:20.843289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ccc3a-428c-4765-acc0-c616f2d442c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:20.843562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ccc3a-428c-4765-acc0-c616f2d442c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:20.844330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ccc3a-428c-4765-acc0-c616f2d442c5 None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=84368e89b0b34a54996def03671a1454) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:20.844640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ccc3a-428c-4765-acc0-c616f2d442c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:20.846083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ccc3a-428c-4765-acc0-c616f2d442c5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:20.852335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 387/771] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:20 2022] GET /identity/v3/role_assignments?user.id=84368e89b0b34a54996def03671a1454&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:20.857611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ccc3a-428c-4765-acc0-c616f2d442c5 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:20.925189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:20.935013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8e710-fbfc-4dca-8a06-bff353332afc None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:20.972325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ccc3a-428c-4765-acc0-c616f2d442c5 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:21.008825 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23f5f4-493e-463f-8bc6-514fbd5b42f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:21.010451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f5f4-493e-463f-8bc6-514fbd5b42f0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:21.011066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85584c8-d529-4391-9396-f65d43cfdd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:21.011374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f5f4-493e-463f-8bc6-514fbd5b42f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:21.011722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85584c8-d529-4391-9396-f65d43cfdd30 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:21.011998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85584c8-d529-4391-9396-f65d43cfdd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:21.012333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85584c8-d529-4391-9396-f65d43cfdd30 None admin] PATH_INFO: `/v3/services/network` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:21.012627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23f5f4-493e-463f-8bc6-514fbd5b42f0 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:21.012985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85584c8-d529-4391-9396-f65d43cfdd30 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:21.013713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23f5f4-493e-463f-8bc6-514fbd5b42f0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:21.014302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23f5f4-493e-463f-8bc6-514fbd5b42f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:21.014520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85584c8-d529-4391-9396-f65d43cfdd30 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:21.016344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23f5f4-493e-463f-8bc6-514fbd5b42f0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-e85584c8-d529-4391-9396-f65d43cfdd30 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:21.024561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:21.025608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:21.026500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 388/772] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:20 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:21.032184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 385/773] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Aug 24 16:57:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:21.037885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85584c8-d529-4391-9396-f65d43cfdd30 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:21.051239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23f5f4-493e-463f-8bc6-514fbd5b42f0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:21.171227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85584c8-d529-4391-9396-f65d43cfdd30 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:21.204781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:21.207984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082f777-a9b8-4468-82c2-c0193a9829e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:21.209151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f777-a9b8-4468-82c2-c0193a9829e0 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:21.209272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:21.209388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f777-a9b8-4468-82c2-c0193a9829e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:21.209584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082f777-a9b8-4468-82c2-c0193a9829e0 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:21.212272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082f777-a9b8-4468-82c2-c0193a9829e0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:21.212272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082f777-a9b8-4468-82c2-c0193a9829e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:21.212272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082f777-a9b8-4468-82c2-c0193a9829e0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:21.218134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 389/774] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:21.227161 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082f777-a9b8-4468-82c2-c0193a9829e0 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:21.287815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23f5f4-493e-463f-8bc6-514fbd5b42f0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:21.349250 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8401bc-e59c-442f-b0ab-d709e115fcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:21.349879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8401bc-e59c-442f-b0ab-d709e115fcdb None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:21.350163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8401bc-e59c-442f-b0ab-d709e115fcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:21.350439 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8401bc-e59c-442f-b0ab-d709e115fcdb None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:21.351078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8401bc-e59c-442f-b0ab-d709e115fcdb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:21.351392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8401bc-e59c-442f-b0ab-d709e115fcdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:21.352819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8401bc-e59c-442f-b0ab-d709e115fcdb None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:21.363754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 386/775] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Aug 24 16:57:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:21.363754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4d11-352c-4c23-99ca-5591edd5d188 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:21.363754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4d11-352c-4c23-99ca-5591edd5d188 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:21.363754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4d11-352c-4c23-99ca-5591edd5d188 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:21.370482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 387/776] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:21.371275 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4d11-352c-4c23-99ca-5591edd5d188 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:21.389312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082f777-a9b8-4468-82c2-c0193a9829e0 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:21.426365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af1b2e-c941-49f8-b9f7-14516af26368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:21.427354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af1b2e-c941-49f8-b9f7-14516af26368 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:21.427823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af1b2e-c941-49f8-b9f7-14516af26368 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:21.428288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af1b2e-c941-49f8-b9f7-14516af26368 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:21.429088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af1b2e-c941-49f8-b9f7-14516af26368 None admin] RBAC: Adding query filter params (type=network) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:21.429659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af1b2e-c941-49f8-b9f7-14516af26368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:21.431288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af1b2e-c941-49f8-b9f7-14516af26368 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:21.437850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 390/777] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:21.444177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee815d10-e3c8-4b7e-8058-ac739b10b211 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:21.444705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee815d10-e3c8-4b7e-8058-ac739b10b211 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:21.445153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee815d10-e3c8-4b7e-8058-ac739b10b211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:21.464835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ee815d10-e3c8-4b7e-8058-ac739b10b211 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:21.466398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ee815d10-e3c8-4b7e-8058-ac739b10b211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:21.492189 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4d11-352c-4c23-99ca-5591edd5d188 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:21.523479 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:21.528603 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:21.533329 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2fd31-d430-48ca-9c6e-7a673a6bef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:21.534082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2fd31-d430-48ca-9c6e-7a673a6bef03 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:21.540349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2fd31-d430-48ca-9c6e-7a673a6bef03 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:21.540349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2fd31-d430-48ca-9c6e-7a673a6bef03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:21.540349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2fd31-d430-48ca-9c6e-7a673a6bef03 None admin] RBAC: Adding query filter params (interface=public, service_id=0be61a570f754b3eb21f3f11da833c99, region_id=RegionOne) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:21.540349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2fd31-d430-48ca-9c6e-7a673a6bef03 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:21.540349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a2fd31-d430-48ca-9c6e-7a673a6bef03 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:21.549681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 388/778] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Aug 24 16:57:21 2022] GET /identity/v3/endpoints?service_id=0be61a570f754b3eb21f3f11da833c99&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:21.549681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2fd31-d430-48ca-9c6e-7a673a6bef03 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:21.556339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 391/779] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:21.560538 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee815d10-e3c8-4b7e-8058-ac739b10b211 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:21.679689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2fd31-d430-48ca-9c6e-7a673a6bef03 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:21.696209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee815d10-e3c8-4b7e-8058-ac739b10b211 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:21.727226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da1fd4-5282-412e-b31b-65be7de806a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:21.728105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da1fd4-5282-412e-b31b-65be7de806a6 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:21.728450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da1fd4-5282-412e-b31b-65be7de806a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:21.728726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da1fd4-5282-412e-b31b-65be7de806a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:21.730818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da1fd4-5282-412e-b31b-65be7de806a6 None admin] RBAC: Adding query filter params (interface=public, service_id=559ca839e97049e49b7f8ad691ef1008, region_id=RegionOne) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:21.731302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da1fd4-5282-412e-b31b-65be7de806a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:21.732873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da1fd4-5282-412e-b31b-65be7de806a6 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:21.735483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f8af-c0c7-46b7-9386-4634ebfe1902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:21.736408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f8af-c0c7-46b7-9386-4634ebfe1902 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:21.736898 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f8af-c0c7-46b7-9386-4634ebfe1902 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:21.737361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968f8af-c0c7-46b7-9386-4634ebfe1902 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:21.738153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968f8af-c0c7-46b7-9386-4634ebfe1902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:21.738533 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 389/780] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Aug 24 16:57:21 2022] GET /identity/v3/endpoints?service_id=559ca839e97049e49b7f8ad691ef1008&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:21.739905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968f8af-c0c7-46b7-9386-4634ebfe1902 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:21.744366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da1fd4-5282-412e-b31b-65be7de806a6 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:21.749068 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 392/781] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Aug 24 16:57:21 2022] GET /identity/v3/services => generated 772 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:21.815899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:21.866465 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da1fd4-5282-412e-b31b-65be7de806a6 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:21.905279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a5e74-c373-4fa0-af5b-161f4fe5ebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:21.905913 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a5e74-c373-4fa0-af5b-161f4fe5ebb3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:21.906190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a5e74-c373-4fa0-af5b-161f4fe5ebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:21.906462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a5e74-c373-4fa0-af5b-161f4fe5ebb3 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:21.907078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a5e74-c373-4fa0-af5b-161f4fe5ebb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:21.908564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a5e74-c373-4fa0-af5b-161f4fe5ebb3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:21.914752 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 390/782] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Aug 24 16:57:21 2022] GET /identity/v3/services => generated 772 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:22.050666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f8af-c0c7-46b7-9386-4634ebfe1902 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:22.109409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:22.181168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968f8af-c0c7-46b7-9386-4634ebfe1902 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:22.231944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e3ff9-b401-4f4c-bbd2-7e8b46e8d1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:22.232607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3ff9-b401-4f4c-bbd2-7e8b46e8d1be None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:22.232886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3ff9-b401-4f4c-bbd2-7e8b46e8d1be None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:22.233158 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e3ff9-b401-4f4c-bbd2-7e8b46e8d1be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:22.251289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e3ff9-b401-4f4c-bbd2-7e8b46e8d1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-7f1e3ff9-b401-4f4c-bbd2-7e8b46e8d1be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:22.256564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:22.257464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:22.258313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 393/783] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:57:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:22.265334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a5e74-c373-4fa0-af5b-161f4fe5ebb3 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:22.374512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a5e74-c373-4fa0-af5b-161f4fe5ebb3 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:22.401955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:22.411272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471ba19-c454-4cd8-8f9e-fffdd24cbfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:22.412820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ba19-c454-4cd8-8f9e-fffdd24cbfb3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:22.412820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ba19-c454-4cd8-8f9e-fffdd24cbfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:22.412820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ba19-c454-4cd8-8f9e-fffdd24cbfb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:22.413389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471ba19-c454-4cd8-8f9e-fffdd24cbfb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:22.413774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471ba19-c454-4cd8-8f9e-fffdd24cbfb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:22.415417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471ba19-c454-4cd8-8f9e-fffdd24cbfb3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:22.426314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 391/784] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:57:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:22.433981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e3ff9-b401-4f4c-bbd2-7e8b46e8d1be None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:22.581871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e3ff9-b401-4f4c-bbd2-7e8b46e8d1be None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:22.585320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c655b17-2fcf-42a1-a5e8-de6315a86443 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:22.585870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c655b17-2fcf-42a1-a5e8-de6315a86443 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:22.586351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c655b17-2fcf-42a1-a5e8-de6315a86443 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:22.588296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 392/785] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:22.594598 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498084a-b175-4999-b6ba-bb25e20b9d6d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:22.595171 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498084a-b175-4999-b6ba-bb25e20b9d6d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:22.595694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498084a-b175-4999-b6ba-bb25e20b9d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:22.598607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:22.615921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c498084a-b175-4999-b6ba-bb25e20b9d6d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:22.617499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c498084a-b175-4999-b6ba-bb25e20b9d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:22.639969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a4cfd-9c9b-49fc-bebb-45e97854d4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:22.640578 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a4cfd-9c9b-49fc-bebb-45e97854d4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:22.640857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a4cfd-9c9b-49fc-bebb-45e97854d4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:22.641129 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a4cfd-9c9b-49fc-bebb-45e97854d4c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:22.658610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a4cfd-9c9b-49fc-bebb-45e97854d4c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:22.658610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a4cfd-9c9b-49fc-bebb-45e97854d4c8 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-4d7a4cfd-9c9b-49fc-bebb-45e97854d4c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:22.685801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:22.686781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:22.687672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:22.687672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:22.687672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:22.691939 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 394/786] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:22.699444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a4cfd-9c9b-49fc-bebb-45e97854d4c8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:22.737483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 393/787] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:22.848286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a4cfd-9c9b-49fc-bebb-45e97854d4c8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:22.896222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f55300-b4f5-4266-a8c3-2320fc7f7faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:22.897076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f55300-b4f5-4266-a8c3-2320fc7f7faa None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:22.897495 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f55300-b4f5-4266-a8c3-2320fc7f7faa None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:22.897934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f55300-b4f5-4266-a8c3-2320fc7f7faa None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:22.898710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f55300-b4f5-4266-a8c3-2320fc7f7faa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:22.899149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f55300-b4f5-4266-a8c3-2320fc7f7faa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:22.900665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f55300-b4f5-4266-a8c3-2320fc7f7faa None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:22.917855 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 395/788] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:22.923694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498084a-b175-4999-b6ba-bb25e20b9d6d None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:23.046067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f55300-b4f5-4266-a8c3-2320fc7f7faa None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:23.051273 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498084a-b175-4999-b6ba-bb25e20b9d6d None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:23.068528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:23.069364 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:23.090732 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a28836-7f50-43c8-a4d8-01d7d76ff8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:23.091372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28836-7f50-43c8-a4d8-01d7d76ff8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:23.091646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28836-7f50-43c8-a4d8-01d7d76ff8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:23.091917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28836-7f50-43c8-a4d8-01d7d76ff8b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:23.099473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a28836-7f50-43c8-a4d8-01d7d76ff8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:23.101048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a28836-7f50-43c8-a4d8-01d7d76ff8b4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-a5a28836-7f50-43c8-a4d8-01d7d76ff8b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:23.114006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:23.116038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:23.117014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:23.117014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:23.117014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:23.117014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:23.117014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:23.117014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:23.117014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:23.117014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:23.117014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:23.117014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:23.117014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 394/789] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Aug 24 16:57:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:23.120764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a33ad-9c20-455e-ab79-1a3719037275 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:23.121202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a33ad-9c20-455e-ab79-1a3719037275 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:23.121411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a33ad-9c20-455e-ab79-1a3719037275 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:23.122851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 395/790] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:23.124495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a33ad-9c20-455e-ab79-1a3719037275 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:23.153893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f55300-b4f5-4266-a8c3-2320fc7f7faa None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:23.192418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9205ee-2e52-4ab1-9258-cc2609ceb69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:23.193078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9205ee-2e52-4ab1-9258-cc2609ceb69e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:23.193542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9205ee-2e52-4ab1-9258-cc2609ceb69e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:23.193837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9205ee-2e52-4ab1-9258-cc2609ceb69e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:23.207651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9205ee-2e52-4ab1-9258-cc2609ceb69e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-3a9205ee-2e52-4ab1-9258-cc2609ceb69e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:23.212609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:23.214134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:23.215443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 396/791] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:23.217236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed49d71-27f4-4893-b36a-2d48bc197320 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:23.217236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed49d71-27f4-4893-b36a-2d48bc197320 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:23.217236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed49d71-27f4-4893-b36a-2d48bc197320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:23.234675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6ed49d71-27f4-4893-b36a-2d48bc197320 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:23.235865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6ed49d71-27f4-4893-b36a-2d48bc197320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:23.244278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a33ad-9c20-455e-ab79-1a3719037275 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:23.299568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c5133-c71f-4e84-834e-9e16710d8db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:23.300187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5133-c71f-4e84-834e-9e16710d8db5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:23.300486 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5133-c71f-4e84-834e-9e16710d8db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:23.300755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c5133-c71f-4e84-834e-9e16710d8db5 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:23.301487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c5133-c71f-4e84-834e-9e16710d8db5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:23.301787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c5133-c71f-4e84-834e-9e16710d8db5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:23.303226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c5133-c71f-4e84-834e-9e16710d8db5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:23.326825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 397/793] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:23.328035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed49d71-27f4-4893-b36a-2d48bc197320 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:23.328163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 396/793] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Aug 24 16:57:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:23.329196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c5133-c71f-4e84-834e-9e16710d8db5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:23.346912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:23.363346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:23.438701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c5133-c71f-4e84-834e-9e16710d8db5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:23.470600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed49d71-27f4-4893-b36a-2d48bc197320 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:23.491388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95754149-1dc8-49ca-bd5d-c01f10ef5a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:23.492527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95754149-1dc8-49ca-bd5d-c01f10ef5a0e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:23.493037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95754149-1dc8-49ca-bd5d-c01f10ef5a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:23.493511 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95754149-1dc8-49ca-bd5d-c01f10ef5a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:23.506516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95754149-1dc8-49ca-bd5d-c01f10ef5a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:23.508578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95754149-1dc8-49ca-bd5d-c01f10ef5a0e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:23.523101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44d397-b1dc-4d74-9fb2-758cc1e8d20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:23.523717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44d397-b1dc-4d74-9fb2-758cc1e8d20e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:23.524153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44d397-b1dc-4d74-9fb2-758cc1e8d20e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:23.524453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44d397-b1dc-4d74-9fb2-758cc1e8d20e None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:23.525153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44d397-b1dc-4d74-9fb2-758cc1e8d20e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:23.525454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44d397-b1dc-4d74-9fb2-758cc1e8d20e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:23.526898 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44d397-b1dc-4d74-9fb2-758cc1e8d20e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-95754149-1dc8-49ca-bd5d-c01f10ef5a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:23.529840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:23.530840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:23.531705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:23.531705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:23.531705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:23.533990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 397/794] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:23.539981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95754149-1dc8-49ca-bd5d-c01f10ef5a0e None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:23.545415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 398/795] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:57:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:23.565856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44d397-b1dc-4d74-9fb2-758cc1e8d20e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:23.642409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:23.655868 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95754149-1dc8-49ca-bd5d-c01f10ef5a0e None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:23.692532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:23.695556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976123e2-392f-4521-8436-69b4c1d01caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:23.696434 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976123e2-392f-4521-8436-69b4c1d01caa None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:23.696863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976123e2-392f-4521-8436-69b4c1d01caa None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:23.697284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976123e2-392f-4521-8436-69b4c1d01caa None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:23.698666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976123e2-392f-4521-8436-69b4c1d01caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:23.699441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976123e2-392f-4521-8436-69b4c1d01caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:23.700776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976123e2-392f-4521-8436-69b4c1d01caa None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:23.715328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 398/796] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:23.716177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976123e2-392f-4521-8436-69b4c1d01caa None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:23.733963 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44d397-b1dc-4d74-9fb2-758cc1e8d20e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:23.772797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166a5bd-4db3-417a-8229-47c0d5c3b2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:23.773799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166a5bd-4db3-417a-8229-47c0d5c3b2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:23.774296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166a5bd-4db3-417a-8229-47c0d5c3b2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:23.774764 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166a5bd-4db3-417a-8229-47c0d5c3b2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:23.787123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166a5bd-4db3-417a-8229-47c0d5c3b2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:23.788972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166a5bd-4db3-417a-8229-47c0d5c3b2b5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-2166a5bd-4db3-417a-8229-47c0d5c3b2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:23.804458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:23.805428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:23.806308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:23.806308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:23.806308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:23.809658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 399/797] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:23.810887 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166a5bd-4db3-417a-8229-47c0d5c3b2b5 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:23.852814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976123e2-392f-4521-8436-69b4c1d01caa None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:23.894077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18495d-859a-40e1-bfd5-2f34f4876060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:23.895151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18495d-859a-40e1-bfd5-2f34f4876060 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:23.895673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18495d-859a-40e1-bfd5-2f34f4876060 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:23.896169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18495d-859a-40e1-bfd5-2f34f4876060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:23.908969 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18495d-859a-40e1-bfd5-2f34f4876060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-6f18495d-859a-40e1-bfd5-2f34f4876060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:23.914299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:23.915239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:23.916067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:23.919942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 399/798] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:23.921235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18495d-859a-40e1-bfd5-2f34f4876060 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:23.936593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:23.943976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166a5bd-4db3-417a-8229-47c0d5c3b2b5 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:23.970553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:23.985508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64761fc-fa75-4722-97ca-44c694d85f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:23.986674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64761fc-fa75-4722-97ca-44c694d85f94 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:23.987220 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64761fc-fa75-4722-97ca-44c694d85f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:23.987664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64761fc-fa75-4722-97ca-44c694d85f94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:23.996740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64761fc-fa75-4722-97ca-44c694d85f94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:23.998649 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64761fc-fa75-4722-97ca-44c694d85f94 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-b64761fc-fa75-4722-97ca-44c694d85f94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:24.013666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:24.014617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:24.015515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:24.015515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:24.015515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:24.015515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:24.015515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:24.015515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:24.015515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:24.015515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:24.022729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 400/799] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:24.024080 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64761fc-fa75-4722-97ca-44c694d85f94 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:24.050009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18495d-859a-40e1-bfd5-2f34f4876060 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:24.099028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebef2d2-7f5a-4284-8190-11ebbc0fb8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:24.099782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef2d2-7f5a-4284-8190-11ebbc0fb8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.100067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef2d2-7f5a-4284-8190-11ebbc0fb8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.100373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef2d2-7f5a-4284-8190-11ebbc0fb8c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.101434 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebef2d2-7f5a-4284-8190-11ebbc0fb8c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:24.101747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebef2d2-7f5a-4284-8190-11ebbc0fb8c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:24.103433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebef2d2-7f5a-4284-8190-11ebbc0fb8c3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:24.124390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 400/800] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:24.126277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebef2d2-7f5a-4284-8190-11ebbc0fb8c3 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:24.149181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64761fc-fa75-4722-97ca-44c694d85f94 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:24.195609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f83d3-f1b6-4ab9-8397-621e5fdf1491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:24.196939 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f83d3-f1b6-4ab9-8397-621e5fdf1491 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.197223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f83d3-f1b6-4ab9-8397-621e5fdf1491 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.197499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f83d3-f1b6-4ab9-8397-621e5fdf1491 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.198215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f83d3-f1b6-4ab9-8397-621e5fdf1491 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:24.198525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f83d3-f1b6-4ab9-8397-621e5fdf1491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:24.199908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f83d3-f1b6-4ab9-8397-621e5fdf1491 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:24.209854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 401/801] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:57:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:24.210756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f83d3-f1b6-4ab9-8397-621e5fdf1491 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:24.218203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:24.265687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:24.335071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f83d3-f1b6-4ab9-8397-621e5fdf1491 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:24.374572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab0e3d-b158-4284-a930-3854682ac1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:24.375201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab0e3d-b158-4284-a930-3854682ac1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.375478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab0e3d-b158-4284-a930-3854682ac1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.375745 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab0e3d-b158-4284-a930-3854682ac1b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.381538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebef2d2-7f5a-4284-8190-11ebbc0fb8c3 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:24.383038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab0e3d-b158-4284-a930-3854682ac1b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:24.384507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab0e3d-b158-4284-a930-3854682ac1b5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-43ab0e3d-b158-4284-a930-3854682ac1b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:24.396517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:24.397464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 402/802] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Aug 24 16:57:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:24.398451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab0e3d-b158-4284-a930-3854682ac1b5 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:24.425175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da604666-23b7-48ff-aeb9-fcdfa593a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:24.425793 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604666-23b7-48ff-aeb9-fcdfa593a481 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.426072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604666-23b7-48ff-aeb9-fcdfa593a481 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.426347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da604666-23b7-48ff-aeb9-fcdfa593a481 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.427046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da604666-23b7-48ff-aeb9-fcdfa593a481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:24.427351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da604666-23b7-48ff-aeb9-fcdfa593a481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:24.428976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da604666-23b7-48ff-aeb9-fcdfa593a481 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:24.445854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 401/803] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:24.445854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c391e-346c-4794-94a3-8a3e096535c0 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.445854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c391e-346c-4794-94a3-8a3e096535c0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.445854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c391e-346c-4794-94a3-8a3e096535c0 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.445854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 402/804] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:24.447612 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c391e-346c-4794-94a3-8a3e096535c0 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:24.518444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab0e3d-b158-4284-a930-3854682ac1b5 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:24.526255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:24.552880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c391e-346c-4794-94a3-8a3e096535c0 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:24.554155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da6d5a-d47e-4f3b-8265-fb5540317756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:24.554776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da6d5a-d47e-4f3b-8265-fb5540317756 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.555736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da6d5a-d47e-4f3b-8265-fb5540317756 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.555736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da6d5a-d47e-4f3b-8265-fb5540317756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.565506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da6d5a-d47e-4f3b-8265-fb5540317756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:24.566937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da6d5a-d47e-4f3b-8265-fb5540317756 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:24.575220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-87da6d5a-d47e-4f3b-8265-fb5540317756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:24.581860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:24.582996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:24.584470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:24.584470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:24.584470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:24.584470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 403/805] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:24.584470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da6d5a-d47e-4f3b-8265-fb5540317756 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:24.591653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a9fc3-4fc1-455c-8293-1e30d26fc86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:24.592309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9fc3-4fc1-455c-8293-1e30d26fc86a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.592592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9fc3-4fc1-455c-8293-1e30d26fc86a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.592860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a9fc3-4fc1-455c-8293-1e30d26fc86a None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.593591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a9fc3-4fc1-455c-8293-1e30d26fc86a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:24.593895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a9fc3-4fc1-455c-8293-1e30d26fc86a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:24.595328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a9fc3-4fc1-455c-8293-1e30d26fc86a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:24.613672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 403/806] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Aug 24 16:57:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:24.614868 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864717cd-f778-4270-92a6-6dc419fd1a94 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.615150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864717cd-f778-4270-92a6-6dc419fd1a94 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.615419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864717cd-f778-4270-92a6-6dc419fd1a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.633221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-864717cd-f778-4270-92a6-6dc419fd1a94 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:24.634471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-864717cd-f778-4270-92a6-6dc419fd1a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:24.689004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da6d5a-d47e-4f3b-8265-fb5540317756 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:24.702088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 404/807] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:24.703085 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967303d3-11aa-470e-bdb2-11c3f860ab59 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.703383 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967303d3-11aa-470e-bdb2-11c3f860ab59 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.703656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967303d3-11aa-470e-bdb2-11c3f860ab59 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.705062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 405/808] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:24.709103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967303d3-11aa-470e-bdb2-11c3f860ab59 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:24.727329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c6be8-b636-4250-815d-0ffd1d7d69cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:24.728147 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c6be8-b636-4250-815d-0ffd1d7d69cb None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.728463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c6be8-b636-4250-815d-0ffd1d7d69cb None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.729160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c6be8-b636-4250-815d-0ffd1d7d69cb None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/aa7e5d51065e4d7dba5b1a433998142e/roles/fd16473b81a24082b019c8d3effe2e66` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.747188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c6be8-b636-4250-815d-0ffd1d7d69cb None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=aa7e5d51065e4d7dba5b1a433998142e, role_id=fd16473b81a24082b019c8d3effe2e66)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:24.748631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c6be8-b636-4250-815d-0ffd1d7d69cb None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:24.813818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967303d3-11aa-470e-bdb2-11c3f860ab59 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:24.825772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:24.828761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 404/809] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:57:24 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/aa7e5d51065e4d7dba5b1a433998142e/roles/fd16473b81a24082b019c8d3effe2e66 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:57:24.829840 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c6be8-b636-4250-815d-0ffd1d7d69cb None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:24.843413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:24.875584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be881952-f321-423a-9cc3-2838adcbffd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:24.876215 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be881952-f321-423a-9cc3-2838adcbffd5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.876518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be881952-f321-423a-9cc3-2838adcbffd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.876791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be881952-f321-423a-9cc3-2838adcbffd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.877456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be881952-f321-423a-9cc3-2838adcbffd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:24.880418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be881952-f321-423a-9cc3-2838adcbffd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:24.881883 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be881952-f321-423a-9cc3-2838adcbffd5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:24.902024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 406/810] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:24.903669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7133cf-2088-45f4-8186-18f42757227a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:24.903966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7133cf-2088-45f4-8186-18f42757227a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:24.904258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7133cf-2088-45f4-8186-18f42757227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:24.925020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-9d7133cf-2088-45f4-8186-18f42757227a None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:24.926323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-9d7133cf-2088-45f4-8186-18f42757227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:24.965296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c6be8-b636-4250-815d-0ffd1d7d69cb None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:25.006510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 407/811] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:25.006705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e1c9-9de7-42b6-a9ce-f345b034c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:25.007357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7133cf-2088-45f4-8186-18f42757227a None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:25.007483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e1c9-9de7-42b6-a9ce-f345b034c785 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:25.007641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e1c9-9de7-42b6-a9ce-f345b034c785 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:25.007915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c0e1c9-9de7-42b6-a9ce-f345b034c785 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:25.098259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0e1c9-9de7-42b6-a9ce-f345b034c785 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:25.100051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c0e1c9-9de7-42b6-a9ce-f345b034c785 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:25.117449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:25.122254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7133cf-2088-45f4-8186-18f42757227a None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:25.132610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:25.169651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3385b-ef31-4c20-91c3-11c07badd14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:25.170519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3385b-ef31-4c20-91c3-11c07badd14b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:25.170799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3385b-ef31-4c20-91c3-11c07badd14b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:25.171122 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3385b-ef31-4c20-91c3-11c07badd14b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:25.181114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3385b-ef31-4c20-91c3-11c07badd14b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:25.183278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3385b-ef31-4c20-91c3-11c07badd14b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-bab3385b-ef31-4c20-91c3-11c07badd14b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:25.198903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:25.199946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 408/812] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:25.201271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3385b-ef31-4c20-91c3-11c07badd14b None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:25.216959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 405/813] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:57:25.217849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e1c9-9de7-42b6-a9ce-f345b034c785 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:25.332987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c0e1c9-9de7-42b6-a9ce-f345b034c785 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:25.343707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3385b-ef31-4c20-91c3-11c07badd14b None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:25.345877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:25.375637 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84339d-4cca-4423-913a-2e26a9b39ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:25.376252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84339d-4cca-4423-913a-2e26a9b39ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:25.376569 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84339d-4cca-4423-913a-2e26a9b39ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:25.376823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84339d-4cca-4423-913a-2e26a9b39ff8 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:25.377566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84339d-4cca-4423-913a-2e26a9b39ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:25.377857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84339d-4cca-4423-913a-2e26a9b39ff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:25.379300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84339d-4cca-4423-913a-2e26a9b39ff8 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:25.381413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bca141-db17-4c03-a07c-eb39759890e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:25.382326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bca141-db17-4c03-a07c-eb39759890e4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:25.382630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bca141-db17-4c03-a07c-eb39759890e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:25.382927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bca141-db17-4c03-a07c-eb39759890e4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:25.383521 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bca141-db17-4c03-a07c-eb39759890e4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:25.384899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bca141-db17-4c03-a07c-eb39759890e4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-b2bca141-db17-4c03-a07c-eb39759890e4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:25.396214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:25.397209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:57:25.403515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:25.404266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 406/814] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Aug 24 16:57:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:25.404266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84339d-4cca-4423-913a-2e26a9b39ff8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:25.404421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 409/815] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:25 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:25.404421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bca141-db17-4c03-a07c-eb39759890e4 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:25.433218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:25.514824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bca141-db17-4c03-a07c-eb39759890e4 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:25.516613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84339d-4cca-4423-913a-2e26a9b39ff8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:25.553295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5a43-4f76-4617-9e88-18b76148d3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:25.553933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5a43-4f76-4617-9e88-18b76148d3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:25.554211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5a43-4f76-4617-9e88-18b76148d3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:25.554484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5a43-4f76-4617-9e88-18b76148d3a7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:25.555071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e5a43-4f76-4617-9e88-18b76148d3a7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:25.556454 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e5a43-4f76-4617-9e88-18b76148d3a7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:25.563628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86990ca-ae3c-4737-bd5c-3487f9832cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:25.564398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86990ca-ae3c-4737-bd5c-3487f9832cbc None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:25.564572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86990ca-ae3c-4737-bd5c-3487f9832cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:25.564818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86990ca-ae3c-4737-bd5c-3487f9832cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-e79e5a43-4f76-4617-9e88-18b76148d3a7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:25.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:25.566502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:25.567349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 410/816] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Aug 24 16:57:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:25.568139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5a43-4f76-4617-9e88-18b76148d3a7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:25.581466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86990ca-ae3c-4737-bd5c-3487f9832cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:25.582906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86990ca-ae3c-4737-bd5c-3487f9832cbc None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-b86990ca-ae3c-4737-bd5c-3487f9832cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:25.598513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:25.599476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:25.600673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:25.600673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:25.600673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:25.600673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 407/817] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:25.600673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86990ca-ae3c-4737-bd5c-3487f9832cbc None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:25.622528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:25.675860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:25.690778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5a43-4f76-4617-9e88-18b76148d3a7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:25.707421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86990ca-ae3c-4737-bd5c-3487f9832cbc None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:25.732024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad07ecb-c01a-453b-829a-e53277945b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:25.732700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07ecb-c01a-453b-829a-e53277945b1f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:25.732977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07ecb-c01a-453b-829a-e53277945b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:25.733244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07ecb-c01a-453b-829a-e53277945b1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:25.744946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad07ecb-c01a-453b-829a-e53277945b1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:25.745926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158875c-a655-40d7-b431-9e77d77a647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:25.746531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158875c-a655-40d7-b431-9e77d77a647d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:25.746797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad07ecb-c01a-453b-829a-e53277945b1f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:25.746994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158875c-a655-40d7-b431-9e77d77a647d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:25.747072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158875c-a655-40d7-b431-9e77d77a647d None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:25.747687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158875c-a655-40d7-b431-9e77d77a647d None admin] RBAC: Adding query filter params (name=network) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:25.747991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158875c-a655-40d7-b431-9e77d77a647d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:25.749376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158875c-a655-40d7-b431-9e77d77a647d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:25.754320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 408/818] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:25.755122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158875c-a655-40d7-b431-9e77d77a647d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-4ad07ecb-c01a-453b-829a-e53277945b1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:25.766104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:25.767065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:25.767935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:25.767935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:25.767935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:25.771907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 411/819] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:25.772769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad07ecb-c01a-453b-829a-e53277945b1f None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:25.851284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:25.875500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158875c-a655-40d7-b431-9e77d77a647d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:25.881208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad07ecb-c01a-453b-829a-e53277945b1f None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:25.912713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d94e4f-6a7c-46c8-bca5-5071f7e61f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:25.913311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94e4f-6a7c-46c8-bca5-5071f7e61f51 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:25.913593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94e4f-6a7c-46c8-bca5-5071f7e61f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:25.913867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94e4f-6a7c-46c8-bca5-5071f7e61f51 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:25.914489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d94e4f-6a7c-46c8-bca5-5071f7e61f51 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:25.914836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d94e4f-6a7c-46c8-bca5-5071f7e61f51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:25.916204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d94e4f-6a7c-46c8-bca5-5071f7e61f51 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:25.919544 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37cf6f-f0e2-4d45-b08a-5175465cb475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:25.920455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37cf6f-f0e2-4d45-b08a-5175465cb475 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:25.920986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37cf6f-f0e2-4d45-b08a-5175465cb475 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:25.921109 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 409/820] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Aug 24 16:57:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:25.921563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37cf6f-f0e2-4d45-b08a-5175465cb475 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:25.921797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d94e4f-6a7c-46c8-bca5-5071f7e61f51 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:25.922612 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37cf6f-f0e2-4d45-b08a-5175465cb475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:25.923011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37cf6f-f0e2-4d45-b08a-5175465cb475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:25.924536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37cf6f-f0e2-4d45-b08a-5175465cb475 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:25.935811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:25.939824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 412/821] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:25.940842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37cf6f-f0e2-4d45-b08a-5175465cb475 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:26.044358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d94e4f-6a7c-46c8-bca5-5071f7e61f51 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:26.047766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37cf6f-f0e2-4d45-b08a-5175465cb475 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:26.082148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872a01f-461c-4afd-9d74-dc953eb9119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:26.082759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872a01f-461c-4afd-9d74-dc953eb9119b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:26.083039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872a01f-461c-4afd-9d74-dc953eb9119b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:26.083316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4872a01f-461c-4afd-9d74-dc953eb9119b None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:26.083947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872a01f-461c-4afd-9d74-dc953eb9119b None admin] RBAC: Adding query filter params (type=network) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:26.084268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872a01f-461c-4afd-9d74-dc953eb9119b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:26.085729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4872a01f-461c-4afd-9d74-dc953eb9119b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:26.086328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adb49d-e1ca-47e4-8d8e-7d7c8eb57297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:26.087110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb49d-e1ca-47e4-8d8e-7d7c8eb57297 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:26.087480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb49d-e1ca-47e4-8d8e-7d7c8eb57297 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:26.087892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb49d-e1ca-47e4-8d8e-7d7c8eb57297 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:26.088658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adb49d-e1ca-47e4-8d8e-7d7c8eb57297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:26.089030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adb49d-e1ca-47e4-8d8e-7d7c8eb57297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:26.090573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3adb49d-e1ca-47e4-8d8e-7d7c8eb57297 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:26.095842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 410/822] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:26.095842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872a01f-461c-4afd-9d74-dc953eb9119b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:26.112395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 413/823] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:26.112571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:26.112664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adb49d-e1ca-47e4-8d8e-7d7c8eb57297 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:26.175522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:26.206647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4872a01f-461c-4afd-9d74-dc953eb9119b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:26.219542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adb49d-e1ca-47e4-8d8e-7d7c8eb57297 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:26.243693 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2edc7-d57f-4d71-acf8-4c4fdfff6187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:26.245025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2edc7-d57f-4d71-acf8-4c4fdfff6187 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:26.245454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2edc7-d57f-4d71-acf8-4c4fdfff6187 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:26.245917 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2edc7-d57f-4d71-acf8-4c4fdfff6187 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:26.246548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2edc7-d57f-4d71-acf8-4c4fdfff6187 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:26.246851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2edc7-d57f-4d71-acf8-4c4fdfff6187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:26.248213 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2edc7-d57f-4d71-acf8-4c4fdfff6187 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:26.253235 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 411/824] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Aug 24 16:57:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:26.256848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc237895-c869-4a40-89d2-89fb7b4d71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:26.257678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc237895-c869-4a40-89d2-89fb7b4d71c6 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:26.258059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc237895-c869-4a40-89d2-89fb7b4d71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:26.258283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2edc7-d57f-4d71-acf8-4c4fdfff6187 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:26.258521 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc237895-c869-4a40-89d2-89fb7b4d71c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:26.266880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc237895-c869-4a40-89d2-89fb7b4d71c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:26.268609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc237895-c869-4a40-89d2-89fb7b4d71c6 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-dc237895-c869-4a40-89d2-89fb7b4d71c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:26.280728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:26.281645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:26.282516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:26.282516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:26.282516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:26.282516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:26.282516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:26.282516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:26.282516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:26.282516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:26.286625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 414/825] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:26.287498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc237895-c869-4a40-89d2-89fb7b4d71c6 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:26.346591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:26.373476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2edc7-d57f-4d71-acf8-4c4fdfff6187 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:26.396464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc237895-c869-4a40-89d2-89fb7b4d71c6 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:26.414835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545be540-2a95-4e8c-a49c-fee87f7628ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:26.415483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545be540-2a95-4e8c-a49c-fee87f7628ac None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:26.415861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545be540-2a95-4e8c-a49c-fee87f7628ac None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:26.416110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545be540-2a95-4e8c-a49c-fee87f7628ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:26.417879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:26.418169 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545be540-2a95-4e8c-a49c-fee87f7628ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:26.420218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545be540-2a95-4e8c-a49c-fee87f7628ac None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:26.434296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e772354-9c4b-4ff5-ba4f-f4a837d5853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:26.438922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e772354-9c4b-4ff5-ba4f-f4a837d5853a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:26.438922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e772354-9c4b-4ff5-ba4f-f4a837d5853a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:26.438922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e772354-9c4b-4ff5-ba4f-f4a837d5853a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:26.442326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e772354-9c4b-4ff5-ba4f-f4a837d5853a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:26.443768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e772354-9c4b-4ff5-ba4f-f4a837d5853a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-1e772354-9c4b-4ff5-ba4f-f4a837d5853a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:26.455385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:26.456337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:26.457310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:26.457310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:26.457310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:26.457310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:26.457310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:26.457310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:26.457310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:26.457310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:26.457310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 415/826] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:26.457310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e772354-9c4b-4ff5-ba4f-f4a837d5853a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:26.562177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e772354-9c4b-4ff5-ba4f-f4a837d5853a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:26.599384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d17b65-d014-459a-a87d-cd4ec8fb5bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:26.599959 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d17b65-d014-459a-a87d-cd4ec8fb5bfe None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:26.600293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d17b65-d014-459a-a87d-cd4ec8fb5bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:26.600619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d17b65-d014-459a-a87d-cd4ec8fb5bfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:26.601262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d17b65-d014-459a-a87d-cd4ec8fb5bfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:26.602679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d17b65-d014-459a-a87d-cd4ec8fb5bfe None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:26.604854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 412/827] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 16:57:26 2022] POST /identity/v3/endpoints => generated 337 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:26.605668 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545be540-2a95-4e8c-a49c-fee87f7628ac None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:26.708615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 416/828] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 16:57:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:26.712063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d17b65-d014-459a-a87d-cd4ec8fb5bfe None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:26.768139 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545be540-2a95-4e8c-a49c-fee87f7628ac None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:26.776212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:26.803576 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:26.827574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee9eb8-9fa7-4797-91d1-f8b5e93a9919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:26.828208 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9eb8-9fa7-4797-91d1-f8b5e93a9919 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:26.828517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9eb8-9fa7-4797-91d1-f8b5e93a9919 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:26.828793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee9eb8-9fa7-4797-91d1-f8b5e93a9919 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:26.829502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee9eb8-9fa7-4797-91d1-f8b5e93a9919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:26.832632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee9eb8-9fa7-4797-91d1-f8b5e93a9919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:26.832632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee9eb8-9fa7-4797-91d1-f8b5e93a9919 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:26.848870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 413/829] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:26.861400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97665cc-4660-4c59-8652-1e32e6c0ea20 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:26.861400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97665cc-4660-4c59-8652-1e32e6c0ea20 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:26.861400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97665cc-4660-4c59-8652-1e32e6c0ea20 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:26.861400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 414/830] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:26.861400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97665cc-4660-4c59-8652-1e32e6c0ea20 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:26.881572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d17b65-d014-459a-a87d-cd4ec8fb5bfe None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:26.927401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f445ca-89dc-4ffb-8d78-9e405a9f38f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:26.928023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f445ca-89dc-4ffb-8d78-9e405a9f38f2 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:26.928340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f445ca-89dc-4ffb-8d78-9e405a9f38f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:26.928619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f445ca-89dc-4ffb-8d78-9e405a9f38f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:26.929317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f445ca-89dc-4ffb-8d78-9e405a9f38f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:26.929695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f445ca-89dc-4ffb-8d78-9e405a9f38f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:26.931167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f445ca-89dc-4ffb-8d78-9e405a9f38f2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:26.952396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 417/831] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:26.953777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233ef68-4fc7-4657-adce-56a4ac1765c9 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:26.954055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233ef68-4fc7-4657-adce-56a4ac1765c9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:26.954318 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233ef68-4fc7-4657-adce-56a4ac1765c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:26.973111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-1233ef68-4fc7-4657-adce-56a4ac1765c9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:26.974286 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1233ef68-4fc7-4657-adce-56a4ac1765c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:26.981144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97665cc-4660-4c59-8652-1e32e6c0ea20 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:27.018565 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9528d-8ad4-45ff-8f0a-0c124eb1d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:27.019172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9528d-8ad4-45ff-8f0a-0c124eb1d0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:27.019455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9528d-8ad4-45ff-8f0a-0c124eb1d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:27.019833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9528d-8ad4-45ff-8f0a-0c124eb1d0a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:27.020475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9528d-8ad4-45ff-8f0a-0c124eb1d0a4 None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=8af51476b48e45efbc3b626f9780e0be) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:27.020841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9528d-8ad4-45ff-8f0a-0c124eb1d0a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:27.022398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9528d-8ad4-45ff-8f0a-0c124eb1d0a4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:27.030613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 415/832] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:26 2022] GET /identity/v3/role_assignments?user.id=8af51476b48e45efbc3b626f9780e0be&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:27.031275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9528d-8ad4-45ff-8f0a-0c124eb1d0a4 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:27.056282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 418/833] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:27.093359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:27.156408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9528d-8ad4-45ff-8f0a-0c124eb1d0a4 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:27.193223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0957a6-7a77-481d-a64a-0d8b06754e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:27.193887 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0957a6-7a77-481d-a64a-0d8b06754e58 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:27.194169 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0957a6-7a77-481d-a64a-0d8b06754e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:27.194443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0957a6-7a77-481d-a64a-0d8b06754e58 None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/84368e89b0b34a54996def03671a1454/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:27.196543 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0957a6-7a77-481d-a64a-0d8b06754e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=84368e89b0b34a54996def03671a1454, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:27.198545 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0957a6-7a77-481d-a64a-0d8b06754e58 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:27.285991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 416/834] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:57:27 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/84368e89b0b34a54996def03671a1454/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:57:27.333076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233ef68-4fc7-4657-adce-56a4ac1765c9 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:27.364910 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:27.445890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233ef68-4fc7-4657-adce-56a4ac1765c9 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:27.484168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba221d7-f6fe-4c7c-a206-b628938c3f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:27.484829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba221d7-f6fe-4c7c-a206-b628938c3f4c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:27.485104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba221d7-f6fe-4c7c-a206-b628938c3f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:27.485371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba221d7-f6fe-4c7c-a206-b628938c3f4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:27.499006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba221d7-f6fe-4c7c-a206-b628938c3f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-1ba221d7-f6fe-4c7c-a206-b628938c3f4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:27.504080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:27.505094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:27.506326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 419/835] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 16:57:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:27.513350 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0957a6-7a77-481d-a64a-0d8b06754e58 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:27.624782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0957a6-7a77-481d-a64a-0d8b06754e58 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:27.633008 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:27.662974 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c62c9a-39e0-4cc6-a176-25db0661da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:27.663578 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62c9a-39e0-4cc6-a176-25db0661da58 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:27.663856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62c9a-39e0-4cc6-a176-25db0661da58 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:27.664172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62c9a-39e0-4cc6-a176-25db0661da58 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:27.664957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c62c9a-39e0-4cc6-a176-25db0661da58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:27.665162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c62c9a-39e0-4cc6-a176-25db0661da58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:27.667072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c62c9a-39e0-4cc6-a176-25db0661da58 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:27.675771 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 417/836] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 16:57:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:27.681366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba221d7-f6fe-4c7c-a206-b628938c3f4c None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:27.778084 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:27.794284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba221d7-f6fe-4c7c-a206-b628938c3f4c None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:27.831967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29556189-a0b1-475d-a9b5-c9dc56a59fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:27.832672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29556189-a0b1-475d-a9b5-c9dc56a59fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:27.832912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29556189-a0b1-475d-a9b5-c9dc56a59fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:27.833181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29556189-a0b1-475d-a9b5-c9dc56a59fd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:27.845579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29556189-a0b1-475d-a9b5-c9dc56a59fd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:27.847040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29556189-a0b1-475d-a9b5-c9dc56a59fd0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-29556189-a0b1-475d-a9b5-c9dc56a59fd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:27.863251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:27.864331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:27.865211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:27.865211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:27.865211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:27.865211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 420/837] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:27.873388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c62c9a-39e0-4cc6-a176-25db0661da58 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:27.983883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c62c9a-39e0-4cc6-a176-25db0661da58 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:28.018901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712dfa3-8f3c-4f42-b0fa-5253568326bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:28.019510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712dfa3-8f3c-4f42-b0fa-5253568326bf None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:28.019787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712dfa3-8f3c-4f42-b0fa-5253568326bf None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:28.020059 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712dfa3-8f3c-4f42-b0fa-5253568326bf None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:28.020734 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712dfa3-8f3c-4f42-b0fa-5253568326bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:28.021030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712dfa3-8f3c-4f42-b0fa-5253568326bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:28.022388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712dfa3-8f3c-4f42-b0fa-5253568326bf None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:28.035604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 418/838] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:28.045339 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29556189-a0b1-475d-a9b5-c9dc56a59fd0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:28.150456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29556189-a0b1-475d-a9b5-c9dc56a59fd0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:28.186738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331a9a3-6494-4070-a428-d49c23ede74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:28.187371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331a9a3-6494-4070-a428-d49c23ede74b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:28.187650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331a9a3-6494-4070-a428-d49c23ede74b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:28.187920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331a9a3-6494-4070-a428-d49c23ede74b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:28.195802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331a9a3-6494-4070-a428-d49c23ede74b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:28.197259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331a9a3-6494-4070-a428-d49c23ede74b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:28.199885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-e331a9a3-6494-4070-a428-d49c23ede74b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:28.209905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:28.214935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:28.216178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:28.216178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:28.216178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:28.216178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:28.216178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:28.216178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:28.216178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:28.216178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:28.216178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:28.216178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:28.216178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 421/839] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Aug 24 16:57:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:28.220144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712dfa3-8f3c-4f42-b0fa-5253568326bf None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:28.251581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:28.330355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712dfa3-8f3c-4f42-b0fa-5253568326bf None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:28.367274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d0033-961e-42d8-87fb-14acd5bd32b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:28.367889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d0033-961e-42d8-87fb-14acd5bd32b4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:28.368167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d0033-961e-42d8-87fb-14acd5bd32b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:28.368466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d0033-961e-42d8-87fb-14acd5bd32b4 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:28.369203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d0033-961e-42d8-87fb-14acd5bd32b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:28.370234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d0033-961e-42d8-87fb-14acd5bd32b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:28.372131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d0033-961e-42d8-87fb-14acd5bd32b4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:28.392170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 419/840] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Aug 24 16:57:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:28.398446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331a9a3-6494-4070-a428-d49c23ede74b None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:28.513572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331a9a3-6494-4070-a428-d49c23ede74b None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:28.550349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de0c93-0340-4e89-a697-0792c04a62ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:28.551272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0c93-0340-4e89-a697-0792c04a62ae None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:28.551766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0c93-0340-4e89-a697-0792c04a62ae None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:28.552285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de0c93-0340-4e89-a697-0792c04a62ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:28.625761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:28.629496 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de0c93-0340-4e89-a697-0792c04a62ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:28.630924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de0c93-0340-4e89-a697-0792c04a62ae None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:28.735597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 422/841] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:57:28.742214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d0033-961e-42d8-87fb-14acd5bd32b4 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:28.834887 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce21ff-8f49-44a1-85fa-cc2cbd306c40 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:28.835185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce21ff-8f49-44a1-85fa-cc2cbd306c40 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:28.835355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce21ff-8f49-44a1-85fa-cc2cbd306c40 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:28.836853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 423/842] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:28.842679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba11d-90b5-42e6-8a24-9d79282be0b3 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:28.842987 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba11d-90b5-42e6-8a24-9d79282be0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:28.843230 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba11d-90b5-42e6-8a24-9d79282be0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:28.844421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:28.862611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-bbbba11d-90b5-42e6-8a24-9d79282be0b3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:28.863562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d0033-961e-42d8-87fb-14acd5bd32b4 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:28.863811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bbbba11d-90b5-42e6-8a24-9d79282be0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:28.908968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6580e3-2193-41c1-833a-f6072149909f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:28.909973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6580e3-2193-41c1-833a-f6072149909f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:28.910453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6580e3-2193-41c1-833a-f6072149909f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:28.910923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6580e3-2193-41c1-833a-f6072149909f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:28.925388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6580e3-2193-41c1-833a-f6072149909f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:28.927899 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6580e3-2193-41c1-833a-f6072149909f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-4a6580e3-2193-41c1-833a-f6072149909f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:28.949464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:28.950463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:28.951465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:28.951465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:28.951465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:28.953409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 420/844] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:28.956299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 424/844] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:28.958386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6580e3-2193-41c1-833a-f6072149909f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:29.066531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6580e3-2193-41c1-833a-f6072149909f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:29.104848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4acea0-c0cc-4f94-9c86-a0f7b4ef7397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:29.105825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4acea0-c0cc-4f94-9c86-a0f7b4ef7397 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.106295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4acea0-c0cc-4f94-9c86-a0f7b4ef7397 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.106743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4acea0-c0cc-4f94-9c86-a0f7b4ef7397 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.107561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4acea0-c0cc-4f94-9c86-a0f7b4ef7397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:29.108040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4acea0-c0cc-4f94-9c86-a0f7b4ef7397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:29.109596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4acea0-c0cc-4f94-9c86-a0f7b4ef7397 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:29.117017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:29.124077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 421/845] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:29.129309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba11d-90b5-42e6-8a24-9d79282be0b3 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:29.158513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:29.226277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435d8a-013a-4c8b-ae94-1d7f05cc3dfc None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.226277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435d8a-013a-4c8b-ae94-1d7f05cc3dfc None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.226568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435d8a-013a-4c8b-ae94-1d7f05cc3dfc None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.228122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 422/846] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:29.233541 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6bd1a-a1c3-4593-aa9d-e844d64689bc None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.233826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6bd1a-a1c3-4593-aa9d-e844d64689bc None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.234099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6bd1a-a1c3-4593-aa9d-e844d64689bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.242317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba11d-90b5-42e6-8a24-9d79282be0b3 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:29.253786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-3ff6bd1a-a1c3-4593-aa9d-e844d64689bc None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:29.254988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3ff6bd1a-a1c3-4593-aa9d-e844d64689bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:29.279229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06c06-d7cd-4f53-85d4-d73c6c50807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:29.279860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06c06-d7cd-4f53-85d4-d73c6c50807d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.280136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06c06-d7cd-4f53-85d4-d73c6c50807d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.280501 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df06c06-d7cd-4f53-85d4-d73c6c50807d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.288819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df06c06-d7cd-4f53-85d4-d73c6c50807d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:29.290298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df06c06-d7cd-4f53-85d4-d73c6c50807d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-9df06c06-d7cd-4f53-85d4-d73c6c50807d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:29.304327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:29.305248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:29.306119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:29.306119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:29.306119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:29.306119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:29.306119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:29.306119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:29.306119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:29.306119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:29.306119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 425/847] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:29.306590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06c06-d7cd-4f53-85d4-d73c6c50807d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:29.338795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 423/848] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:29.339940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6bd1a-a1c3-4593-aa9d-e844d64689bc None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:29.406300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:29.419945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df06c06-d7cd-4f53-85d4-d73c6c50807d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:29.439919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6bd1a-a1c3-4593-aa9d-e844d64689bc None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:29.461865 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc498c-3e0e-4d57-b1e9-6885d63a19b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:29.462498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc498c-3e0e-4d57-b1e9-6885d63a19b4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.462776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc498c-3e0e-4d57-b1e9-6885d63a19b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.463185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc498c-3e0e-4d57-b1e9-6885d63a19b4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.463846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc498c-3e0e-4d57-b1e9-6885d63a19b4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:29.465329 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc498c-3e0e-4d57-b1e9-6885d63a19b4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:29.470784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-5ecc498c-3e0e-4d57-b1e9-6885d63a19b4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:29.475785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:29.476886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:29.477721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 426/849] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:57:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:29.478500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0383b4a-2923-4183-aec9-2cdadca026e6 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.478500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0383b4a-2923-4183-aec9-2cdadca026e6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.478690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0383b4a-2923-4183-aec9-2cdadca026e6 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.483964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 427/850] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:29.483964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0383b4a-2923-4183-aec9-2cdadca026e6 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:29.486194 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3c894-485f-4d82-9678-40bd7c888ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:29.486815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c894-485f-4d82-9678-40bd7c888ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.487095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c894-485f-4d82-9678-40bd7c888ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.487409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3c894-485f-4d82-9678-40bd7c888ed3 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.488111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3c894-485f-4d82-9678-40bd7c888ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:29.488461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3c894-485f-4d82-9678-40bd7c888ed3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:29.489884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3c894-485f-4d82-9678-40bd7c888ed3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:29.507791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 424/851] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:29.507791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b978e-317b-4902-9c94-f99e6a34f9ce None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.507791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b978e-317b-4902-9c94-f99e6a34f9ce None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.507791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b978e-317b-4902-9c94-f99e6a34f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.524562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8b8b978e-317b-4902-9c94-f99e6a34f9ce None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:29.525823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8b8b978e-317b-4902-9c94-f99e6a34f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:29.593417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0383b4a-2923-4183-aec9-2cdadca026e6 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:29.600280 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 425/852] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:29.601338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b978e-317b-4902-9c94-f99e6a34f9ce None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:29.637126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0869307-21f9-4a9a-84cc-b36359d9cf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:29.638008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869307-21f9-4a9a-84cc-b36359d9cf4a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.638436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869307-21f9-4a9a-84cc-b36359d9cf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.638704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0869307-21f9-4a9a-84cc-b36359d9cf4a None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.639328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0869307-21f9-4a9a-84cc-b36359d9cf4a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:29.639624 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0869307-21f9-4a9a-84cc-b36359d9cf4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:29.641013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0869307-21f9-4a9a-84cc-b36359d9cf4a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:29.645362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 428/853] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:57:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:29.650590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0869307-21f9-4a9a-84cc-b36359d9cf4a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:29.669694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:29.723564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b978e-317b-4902-9c94-f99e6a34f9ce None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:29.741208 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:29.754726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0869307-21f9-4a9a-84cc-b36359d9cf4a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:29.759408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb4da-83a8-45fb-9b4f-4caab69e5611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:29.761177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb4da-83a8-45fb-9b4f-4caab69e5611 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.761641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb4da-83a8-45fb-9b4f-4caab69e5611 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.762092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cb4da-83a8-45fb-9b4f-4caab69e5611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.763022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb4da-83a8-45fb-9b4f-4caab69e5611 None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=aa7e5d51065e4d7dba5b1a433998142e) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:29.763524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb4da-83a8-45fb-9b4f-4caab69e5611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:29.765147 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cb4da-83a8-45fb-9b4f-4caab69e5611 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:29.771141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 426/854] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:29 2022] GET /identity/v3/role_assignments?user.id=aa7e5d51065e4d7dba5b1a433998142e&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:29.772315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb4da-83a8-45fb-9b4f-4caab69e5611 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:29.806152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbd64c-aa8e-4661-9121-e17e02779924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:29.808003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbd64c-aa8e-4661-9121-e17e02779924 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.809262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbd64c-aa8e-4661-9121-e17e02779924 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.810028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbd64c-aa8e-4661-9121-e17e02779924 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.810836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbd64c-aa8e-4661-9121-e17e02779924 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:29.813884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbd64c-aa8e-4661-9121-e17e02779924 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-c1fbd64c-aa8e-4661-9121-e17e02779924 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:29.829482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:29.830532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:57:29.831422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:29.833819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 429/855] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Aug 24 16:57:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:29.839915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbd64c-aa8e-4661-9121-e17e02779924 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:29.902791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cb4da-83a8-45fb-9b4f-4caab69e5611 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:29.938486 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:29.944927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7be4e-d933-4276-a11b-3ebba7c50c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:29.944927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7be4e-d933-4276-a11b-3ebba7c50c63 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:29.944927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7be4e-d933-4276-a11b-3ebba7c50c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:29.945214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7be4e-d933-4276-a11b-3ebba7c50c63 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:29.945715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7be4e-d933-4276-a11b-3ebba7c50c63 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:29.946021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7be4e-d933-4276-a11b-3ebba7c50c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:29.947423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7be4e-d933-4276-a11b-3ebba7c50c63 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:29.953083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 427/856] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:57:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:29.954206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7be4e-d933-4276-a11b-3ebba7c50c63 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:29.974534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbd64c-aa8e-4661-9121-e17e02779924 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:30.017563 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:30.027547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db600ab8-58f4-4481-ab3c-0c1cb6e1fdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:30.028280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db600ab8-58f4-4481-ab3c-0c1cb6e1fdec None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:30.028561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db600ab8-58f4-4481-ab3c-0c1cb6e1fdec None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:30.028830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db600ab8-58f4-4481-ab3c-0c1cb6e1fdec None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:30.029557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db600ab8-58f4-4481-ab3c-0c1cb6e1fdec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:30.029820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db600ab8-58f4-4481-ab3c-0c1cb6e1fdec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:30.031234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db600ab8-58f4-4481-ab3c-0c1cb6e1fdec None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:30.037789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 430/857] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Aug 24 16:57:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:30.044821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db600ab8-58f4-4481-ab3c-0c1cb6e1fdec None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:30.091531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7be4e-d933-4276-a11b-3ebba7c50c63 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:30.139345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f808ef-f491-4d78-8f14-22ad8addfef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:30.139854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f808ef-f491-4d78-8f14-22ad8addfef8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:30.140136 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f808ef-f491-4d78-8f14-22ad8addfef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:30.140492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f808ef-f491-4d78-8f14-22ad8addfef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:30.153481 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f808ef-f491-4d78-8f14-22ad8addfef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-89f808ef-f491-4d78-8f14-22ad8addfef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:30.159237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:30.160440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:30.161401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 428/858] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:30.169381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f808ef-f491-4d78-8f14-22ad8addfef8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:30.171666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db600ab8-58f4-4481-ab3c-0c1cb6e1fdec None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:30.217214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc281f-7142-4ed6-878a-8b30bd14df40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:30.218150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc281f-7142-4ed6-878a-8b30bd14df40 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:30.218615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc281f-7142-4ed6-878a-8b30bd14df40 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:30.219064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc281f-7142-4ed6-878a-8b30bd14df40 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:30.220462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc281f-7142-4ed6-878a-8b30bd14df40 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:30.220955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc281f-7142-4ed6-878a-8b30bd14df40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:30.223210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc281f-7142-4ed6-878a-8b30bd14df40 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:30.232155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 431/859] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Aug 24 16:57:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:30.305025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f808ef-f491-4d78-8f14-22ad8addfef8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:30.315339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:30.349869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf014bc-d922-4b80-8e90-5a6e4d4a033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:30.350942 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf014bc-d922-4b80-8e90-5a6e4d4a033e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:30.351430 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf014bc-d922-4b80-8e90-5a6e4d4a033e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:30.352073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf014bc-d922-4b80-8e90-5a6e4d4a033e None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:30.353155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf014bc-d922-4b80-8e90-5a6e4d4a033e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:30.353729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf014bc-d922-4b80-8e90-5a6e4d4a033e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:30.355372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf014bc-d922-4b80-8e90-5a6e4d4a033e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:30.365935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 429/860] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:57:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:30.372846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc281f-7142-4ed6-878a-8b30bd14df40 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:30.387604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:30.486176 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc281f-7142-4ed6-878a-8b30bd14df40 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:30.521717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e41fab-b42b-4889-9ceb-e25e1c241e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:30.522357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41fab-b42b-4889-9ceb-e25e1c241e9f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:30.522636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41fab-b42b-4889-9ceb-e25e1c241e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:30.522908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e41fab-b42b-4889-9ceb-e25e1c241e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:30.534042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e41fab-b42b-4889-9ceb-e25e1c241e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:30.535508 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e41fab-b42b-4889-9ceb-e25e1c241e9f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-e0e41fab-b42b-4889-9ceb-e25e1c241e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:30.553277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:30.554232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:30.555108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:30.555108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:30.555108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:30.555108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 432/861] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:30.563773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf014bc-d922-4b80-8e90-5a6e4d4a033e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:30.679696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf014bc-d922-4b80-8e90-5a6e4d4a033e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:30.717228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b912ec8-76ac-4f14-8185-b74a514ae1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:30.718238 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b912ec8-76ac-4f14-8185-b74a514ae1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:30.718742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b912ec8-76ac-4f14-8185-b74a514ae1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:30.719240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b912ec8-76ac-4f14-8185-b74a514ae1e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:30.720093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b912ec8-76ac-4f14-8185-b74a514ae1e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:30.720632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b912ec8-76ac-4f14-8185-b74a514ae1e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:30.722221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b912ec8-76ac-4f14-8185-b74a514ae1e3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:30.735649 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 430/862] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:30.741607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e41fab-b42b-4889-9ceb-e25e1c241e9f None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:30.805455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:30.853129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e41fab-b42b-4889-9ceb-e25e1c241e9f None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:30.889139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788a2df-166b-45ed-8cc3-ee5d6218618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:30.889817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788a2df-166b-45ed-8cc3-ee5d6218618b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:30.890092 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788a2df-166b-45ed-8cc3-ee5d6218618b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:30.890354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788a2df-166b-45ed-8cc3-ee5d6218618b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:30.898565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788a2df-166b-45ed-8cc3-ee5d6218618b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:30.900017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788a2df-166b-45ed-8cc3-ee5d6218618b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-3788a2df-166b-45ed-8cc3-ee5d6218618b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:30.913811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:30.914884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:30.915889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:30.915889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:30.915889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:30.915889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:30.915889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:30.915889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:30.915889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:30.915889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:30.915889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:57:30.915889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:30.915889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 433/863] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:30.923121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b912ec8-76ac-4f14-8185-b74a514ae1e3 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:30.953873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:31.031163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b912ec8-76ac-4f14-8185-b74a514ae1e3 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:31.068053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b728b39-d1b9-41b8-bda8-f448a0a6dd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:31.069093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b728b39-d1b9-41b8-bda8-f448a0a6dd7a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:31.069574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b728b39-d1b9-41b8-bda8-f448a0a6dd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:31.070056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b728b39-d1b9-41b8-bda8-f448a0a6dd7a None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:31.070999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b728b39-d1b9-41b8-bda8-f448a0a6dd7a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:31.071553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b728b39-d1b9-41b8-bda8-f448a0a6dd7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:31.073757 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b728b39-d1b9-41b8-bda8-f448a0a6dd7a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:31.095504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 431/864] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Aug 24 16:57:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:31.101379 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788a2df-166b-45ed-8cc3-ee5d6218618b None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:31.213028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788a2df-166b-45ed-8cc3-ee5d6218618b None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:31.235794 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:31.250389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502632-6e34-4eaa-a09b-f7a022ee7198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:31.251011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502632-6e34-4eaa-a09b-f7a022ee7198 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:31.251285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502632-6e34-4eaa-a09b-f7a022ee7198 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:31.251550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de502632-6e34-4eaa-a09b-f7a022ee7198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:31.332903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de502632-6e34-4eaa-a09b-f7a022ee7198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:31.334356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de502632-6e34-4eaa-a09b-f7a022ee7198 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:31.441212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 434/865] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:57:31.446646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b728b39-d1b9-41b8-bda8-f448a0a6dd7a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:31.536061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:31.556325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b728b39-d1b9-41b8-bda8-f448a0a6dd7a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:31.588525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c295f1-164a-4077-82f7-cad952d9b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:31.589422 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c295f1-164a-4077-82f7-cad952d9b0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:31.589706 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c295f1-164a-4077-82f7-cad952d9b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:31.590023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c295f1-164a-4077-82f7-cad952d9b0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:31.600877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c295f1-164a-4077-82f7-cad952d9b0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:31.602326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c295f1-164a-4077-82f7-cad952d9b0a8 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-05c295f1-164a-4077-82f7-cad952d9b0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:31.618455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:31.619494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:31.620410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:31.620410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:31.620410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:31.620410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 432/866] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:31.629529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502632-6e34-4eaa-a09b-f7a022ee7198 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:31.667044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:31.736465 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de502632-6e34-4eaa-a09b-f7a022ee7198 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:31.771903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6814b6a-fe3f-4313-9638-142cb3fb8222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:31.772688 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6814b6a-fe3f-4313-9638-142cb3fb8222 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:31.772961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6814b6a-fe3f-4313-9638-142cb3fb8222 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:31.773229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6814b6a-fe3f-4313-9638-142cb3fb8222 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:31.773867 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6814b6a-fe3f-4313-9638-142cb3fb8222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:31.774168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6814b6a-fe3f-4313-9638-142cb3fb8222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:31.776177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6814b6a-fe3f-4313-9638-142cb3fb8222 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:31.789293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 435/867] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:31.796544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c295f1-164a-4077-82f7-cad952d9b0a8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:31.905557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c295f1-164a-4077-82f7-cad952d9b0a8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:31.942796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451ac71-13bb-4a04-abfd-66d207ca949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:31.944258 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451ac71-13bb-4a04-abfd-66d207ca949e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:31.944771 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451ac71-13bb-4a04-abfd-66d207ca949e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:31.945271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451ac71-13bb-4a04-abfd-66d207ca949e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:31.953117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451ac71-13bb-4a04-abfd-66d207ca949e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:31.954913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451ac71-13bb-4a04-abfd-66d207ca949e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:31.957018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-0451ac71-13bb-4a04-abfd-66d207ca949e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:31.967622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:31.974823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:31.975723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:31.975723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:31.975723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:31.975723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:31.975723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:31.975723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:31.975723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:31.975723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:31.975723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 433/868] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:31.976219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6814b6a-fe3f-4313-9638-142cb3fb8222 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:31.987012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bfc77-41e6-4962-8c5e-6fb7e8c906e8 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:31.987298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bfc77-41e6-4962-8c5e-6fb7e8c906e8 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:31.987575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5bfc77-41e6-4962-8c5e-6fb7e8c906e8 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:31.989246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 434/869] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:31.994410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f058d-355b-4730-aeee-6b6ada0c82ed None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:31.994950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f058d-355b-4730-aeee-6b6ada0c82ed None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:31.995365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f058d-355b-4730-aeee-6b6ada0c82ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:32.016474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-896f058d-355b-4730-aeee-6b6ada0c82ed None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:32.018101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-896f058d-355b-4730-aeee-6b6ada0c82ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:32.069976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:32.090550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6814b6a-fe3f-4313-9638-142cb3fb8222 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:32.102229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 435/870] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:32.104477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e037121-aacb-465d-adcd-38966fa90236 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:32.104780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e037121-aacb-465d-adcd-38966fa90236 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:32.105017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e037121-aacb-465d-adcd-38966fa90236 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:32.106473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 436/871] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:32.111678 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c53a5d-034f-4819-b0ba-8bd3816841bd None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:32.111961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c53a5d-034f-4819-b0ba-8bd3816841bd None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:32.112261 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c53a5d-034f-4819-b0ba-8bd3816841bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:32.130675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-22c53a5d-034f-4819-b0ba-8bd3816841bd None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:32.131877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-22c53a5d-034f-4819-b0ba-8bd3816841bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:32.136361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1f6c4-500b-43e3-9205-f245be3563b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:32.137266 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1f6c4-500b-43e3-9205-f245be3563b7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:32.137764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1f6c4-500b-43e3-9205-f245be3563b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:32.138261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1f6c4-500b-43e3-9205-f245be3563b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:32.139191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1f6c4-500b-43e3-9205-f245be3563b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:32.139701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1f6c4-500b-43e3-9205-f245be3563b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:32.141400 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1f6c4-500b-43e3-9205-f245be3563b7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:32.156980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 436/872] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:32.163629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1f6c4-500b-43e3-9205-f245be3563b7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:32.220621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 437/873] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:32.254236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889a0a2-8bba-43a3-938d-c9d9adcd5298 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:32.254553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889a0a2-8bba-43a3-938d-c9d9adcd5298 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:32.254783 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889a0a2-8bba-43a3-938d-c9d9adcd5298 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:32.256589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 438/874] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:32.262120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65250cd5-047e-447d-aac5-b97b34cbeb11 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:32.262396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65250cd5-047e-447d-aac5-b97b34cbeb11 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:32.262665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65250cd5-047e-447d-aac5-b97b34cbeb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:32.270526 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1f6c4-500b-43e3-9205-f245be3563b7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:32.291612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-65250cd5-047e-447d-aac5-b97b34cbeb11 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:32.292852 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-65250cd5-047e-447d-aac5-b97b34cbeb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:32.305298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb462c-061b-4fc3-848d-57e5bcbefdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:32.305915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb462c-061b-4fc3-848d-57e5bcbefdef None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:32.306194 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb462c-061b-4fc3-848d-57e5bcbefdef None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:32.306452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb462c-061b-4fc3-848d-57e5bcbefdef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:32.307312 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb462c-061b-4fc3-848d-57e5bcbefdef None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=84368e89b0b34a54996def03671a1454) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:32.307624 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb462c-061b-4fc3-848d-57e5bcbefdef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:32.309540 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb462c-061b-4fc3-848d-57e5bcbefdef None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:32.321618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 437/875] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:32 2022] GET /identity/v3/role_assignments?user.id=84368e89b0b34a54996def03671a1454&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:32.364674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:32.376655 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 439/876] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:32.386519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb462c-061b-4fc3-848d-57e5bcbefdef None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:32.390529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:32.504734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb462c-061b-4fc3-848d-57e5bcbefdef None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:32.522671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65250cd5-047e-447d-aac5-b97b34cbeb11 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:32.545269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a577877-8b39-4945-952c-6312f23f830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:32.546162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a577877-8b39-4945-952c-6312f23f830d None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:32.546591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a577877-8b39-4945-952c-6312f23f830d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:32.547022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a577877-8b39-4945-952c-6312f23f830d None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:32.547829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a577877-8b39-4945-952c-6312f23f830d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:32.550131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a577877-8b39-4945-952c-6312f23f830d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:32.632184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65250cd5-047e-447d-aac5-b97b34cbeb11 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:32.667911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd381d9-aa66-475b-b12b-9238ea5afd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:32.668619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd381d9-aa66-475b-b12b-9238ea5afd9a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:32.668893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd381d9-aa66-475b-b12b-9238ea5afd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:32.669163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd381d9-aa66-475b-b12b-9238ea5afd9a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:32.674847 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 438/877] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:57:32 2022] POST /identity/v3/services => generated 251 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:32.675473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a577877-8b39-4945-952c-6312f23f830d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:32.689247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd381d9-aa66-475b-b12b-9238ea5afd9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-edd381d9-aa66-475b-b12b-9238ea5afd9a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:32.698004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:32.699037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:57:32.699900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:32.703355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 440/878] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Aug 24 16:57:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:32.707784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd381d9-aa66-475b-b12b-9238ea5afd9a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:32.772419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:32.775540 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:32.833916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a577877-8b39-4945-952c-6312f23f830d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:32.845964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd381d9-aa66-475b-b12b-9238ea5afd9a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:32.886685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0193837-ec52-4992-a6bb-615609ac56fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:32.887310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0193837-ec52-4992-a6bb-615609ac56fa None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:32.887592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0193837-ec52-4992-a6bb-615609ac56fa None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:32.887867 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0193837-ec52-4992-a6bb-615609ac56fa None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:32.888604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0193837-ec52-4992-a6bb-615609ac56fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:32.891081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c40a3-7cdd-44d9-8c92-17f709279572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:32.891230 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0193837-ec52-4992-a6bb-615609ac56fa None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:32.891315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c40a3-7cdd-44d9-8c92-17f709279572 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:32.891315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c40a3-7cdd-44d9-8c92-17f709279572 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:32.891315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c40a3-7cdd-44d9-8c92-17f709279572 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:32.891648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c40a3-7cdd-44d9-8c92-17f709279572 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:32.891912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c40a3-7cdd-44d9-8c92-17f709279572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:32.893403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c40a3-7cdd-44d9-8c92-17f709279572 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:32.904472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 441/879] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Aug 24 16:57:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:32.909779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c40a3-7cdd-44d9-8c92-17f709279572 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:33.012753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 439/880] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:57:32 2022] POST /identity/v3/services => generated 269 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:33.039920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c40a3-7cdd-44d9-8c92-17f709279572 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:33.053845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:33.091805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e33308-0725-44b7-b3cf-eb36a1a13a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:33.092496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e33308-0725-44b7-b3cf-eb36a1a13a90 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:33.092776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e33308-0725-44b7-b3cf-eb36a1a13a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:33.093133 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e33308-0725-44b7-b3cf-eb36a1a13a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:33.106697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e33308-0725-44b7-b3cf-eb36a1a13a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:33.108291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e33308-0725-44b7-b3cf-eb36a1a13a90 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-51e33308-0725-44b7-b3cf-eb36a1a13a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:33.126250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:33.127263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:33.128172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:33.128172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:33.128172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:33.128172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 442/881] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:33.135338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0193837-ec52-4992-a6bb-615609ac56fa None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:33.265768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0193837-ec52-4992-a6bb-615609ac56fa None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:33.296691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:33.302206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d99671-a8c8-4844-9492-95a4ad9b61a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:33.302943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99671-a8c8-4844-9492-95a4ad9b61a9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:33.303226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99671-a8c8-4844-9492-95a4ad9b61a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:33.303500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d99671-a8c8-4844-9492-95a4ad9b61a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:33.304297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d99671-a8c8-4844-9492-95a4ad9b61a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:33.304607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d99671-a8c8-4844-9492-95a4ad9b61a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:33.305972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d99671-a8c8-4844-9492-95a4ad9b61a9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:33.318951 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 440/882] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:33.324823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e33308-0725-44b7-b3cf-eb36a1a13a90 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:33.435140 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e33308-0725-44b7-b3cf-eb36a1a13a90 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:33.470568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6f118-7a03-46d4-91fc-58896d32f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:33.471216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6f118-7a03-46d4-91fc-58896d32f34e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:33.471491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6f118-7a03-46d4-91fc-58896d32f34e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:33.471760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6f118-7a03-46d4-91fc-58896d32f34e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:33.481014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6f118-7a03-46d4-91fc-58896d32f34e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:33.482457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6f118-7a03-46d4-91fc-58896d32f34e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-a7a6f118-7a03-46d4-91fc-58896d32f34e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:33.494050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:33.495408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:33.496822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:33.496822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:33.496822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:33.496822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:33.496822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:33.496822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:33.496822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:33.496822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:33.496822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:33.496822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:33.496822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 443/883] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Aug 24 16:57:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:33.503395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d99671-a8c8-4844-9492-95a4ad9b61a9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:33.613666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d99671-a8c8-4844-9492-95a4ad9b61a9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:33.649363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4590-4f42-4cc4-9a9e-10f6f8872acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:33.649983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4590-4f42-4cc4-9a9e-10f6f8872acb None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:33.650862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4590-4f42-4cc4-9a9e-10f6f8872acb None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:33.651144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4590-4f42-4cc4-9a9e-10f6f8872acb None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:33.651878 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d4590-4f42-4cc4-9a9e-10f6f8872acb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:33.652185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d4590-4f42-4cc4-9a9e-10f6f8872acb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:33.653714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d4590-4f42-4cc4-9a9e-10f6f8872acb None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:33.672481 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 441/884] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Aug 24 16:57:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:33.678097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6f118-7a03-46d4-91fc-58896d32f34e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:33.703736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:33.789065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6f118-7a03-46d4-91fc-58896d32f34e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:33.824382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d7d79-97c5-4c9a-8fe5-131252b26f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:33.824987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d7d79-97c5-4c9a-8fe5-131252b26f99 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:33.825261 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d7d79-97c5-4c9a-8fe5-131252b26f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:33.825526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d7d79-97c5-4c9a-8fe5-131252b26f99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:33.901531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d7d79-97c5-4c9a-8fe5-131252b26f99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:33.902897 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d7d79-97c5-4c9a-8fe5-131252b26f99 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:33.920972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:34.004636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 444/885] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:33 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:57:34.011129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4590-4f42-4cc4-9a9e-10f6f8872acb None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:34.055526 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:34.125436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4590-4f42-4cc4-9a9e-10f6f8872acb None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:34.165845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c3fc6-d362-4dcc-aad8-f2903844d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:34.166853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c3fc6-d362-4dcc-aad8-f2903844d4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:34.167332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c3fc6-d362-4dcc-aad8-f2903844d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:34.167797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c3fc6-d362-4dcc-aad8-f2903844d4f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:34.178893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c3fc6-d362-4dcc-aad8-f2903844d4f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:34.180734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c3fc6-d362-4dcc-aad8-f2903844d4f5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-8e1c3fc6-d362-4dcc-aad8-f2903844d4f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:34.198984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:34.199976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:34.200936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:34.200936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:34.200936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:34.203234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 442/886] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:34.208888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d7d79-97c5-4c9a-8fe5-131252b26f99 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:34.317193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d7d79-97c5-4c9a-8fe5-131252b26f99 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:34.336896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:34.355793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faec65-88d2-4fac-bb26-05ec2b1ee6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:34.356434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faec65-88d2-4fac-bb26-05ec2b1ee6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:34.356716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faec65-88d2-4fac-bb26-05ec2b1ee6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:34.356987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faec65-88d2-4fac-bb26-05ec2b1ee6f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:34.357638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faec65-88d2-4fac-bb26-05ec2b1ee6f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:34.357938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faec65-88d2-4fac-bb26-05ec2b1ee6f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:34.359385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faec65-88d2-4fac-bb26-05ec2b1ee6f7 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:34.372893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 445/887] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:34.378438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c3fc6-d362-4dcc-aad8-f2903844d4f5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:34.391841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac488d-6b46-420a-b482-2e8a5cb89533 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:34.392131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac488d-6b46-420a-b482-2e8a5cb89533 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:34.392434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac488d-6b46-420a-b482-2e8a5cb89533 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:34.394043 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 446/888] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:34.399740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1b7f-d0dd-4ad4-94ed-b557caf35c8f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:34.400007 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1b7f-d0dd-4ad4-94ed-b557caf35c8f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:34.400423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1b7f-d0dd-4ad4-94ed-b557caf35c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:34.419734 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-550a1b7f-d0dd-4ad4-94ed-b557caf35c8f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:34.420882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-550a1b7f-d0dd-4ad4-94ed-b557caf35c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:34.480403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:34.489920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c3fc6-d362-4dcc-aad8-f2903844d4f5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:34.500522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 447/889] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:34.526759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff5b60-d19c-44b5-bf36-2a6e5d799bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:34.527537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff5b60-d19c-44b5-bf36-2a6e5d799bef None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:34.527886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff5b60-d19c-44b5-bf36-2a6e5d799bef None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:34.528245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff5b60-d19c-44b5-bf36-2a6e5d799bef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:34.535572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff5b60-d19c-44b5-bf36-2a6e5d799bef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:34.537041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff5b60-d19c-44b5-bf36-2a6e5d799bef None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-19ff5b60-d19c-44b5-bf36-2a6e5d799bef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:34.549239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:34.550141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:34.551017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:34.551017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:34.551017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:34.551017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:34.551017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:34.551017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:34.551017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:34.551017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:34.551017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 443/890] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:34.556252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a1b7f-d0dd-4ad4-94ed-b557caf35c8f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:34.667053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a1b7f-d0dd-4ad4-94ed-b557caf35c8f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:34.684681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:34.703396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dccccf-6baf-4016-86cf-479c944391ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:34.704339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dccccf-6baf-4016-86cf-479c944391ff None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:34.706473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dccccf-6baf-4016-86cf-479c944391ff None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:34.706473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dccccf-6baf-4016-86cf-479c944391ff None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:34.706473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dccccf-6baf-4016-86cf-479c944391ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:34.706473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dccccf-6baf-4016-86cf-479c944391ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:34.707949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dccccf-6baf-4016-86cf-479c944391ff None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:34.720981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 448/891] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:34.726807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff5b60-d19c-44b5-bf36-2a6e5d799bef None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:34.753176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5cbe-b374-4748-83bd-035efd88e496 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:34.753507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5cbe-b374-4748-83bd-035efd88e496 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:34.753736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5cbe-b374-4748-83bd-035efd88e496 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:34.755826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 449/892] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:34.761587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f968055-5c29-4e07-b4f1-6b824e79a9bc None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:34.761862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f968055-5c29-4e07-b4f1-6b824e79a9bc None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:34.762139 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f968055-5c29-4e07-b4f1-6b824e79a9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:34.780812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4f968055-5c29-4e07-b4f1-6b824e79a9bc None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:34.782320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4f968055-5c29-4e07-b4f1-6b824e79a9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:34.847950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff5b60-d19c-44b5-bf36-2a6e5d799bef None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:34.860276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 450/893] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:34.861023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f968055-5c29-4e07-b4f1-6b824e79a9bc None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:34.891763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef292d63-7bbc-4bc7-b203-e2f6e55ab72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:34.892424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef292d63-7bbc-4bc7-b203-e2f6e55ab72c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:34.892706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef292d63-7bbc-4bc7-b203-e2f6e55ab72c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:34.892976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef292d63-7bbc-4bc7-b203-e2f6e55ab72c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:34.893816 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef292d63-7bbc-4bc7-b203-e2f6e55ab72c None admin] RBAC: Adding query filter params (role.id=4ff6270f4a6f4b95b4966128abe3ef9c, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=aa7e5d51065e4d7dba5b1a433998142e) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:34.894131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef292d63-7bbc-4bc7-b203-e2f6e55ab72c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:34.895626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef292d63-7bbc-4bc7-b203-e2f6e55ab72c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:34.903852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 444/894] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:34 2022] GET /identity/v3/role_assignments?user.id=aa7e5d51065e4d7dba5b1a433998142e&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=4ff6270f4a6f4b95b4966128abe3ef9c => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:34.997880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:35.002099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f968055-5c29-4e07-b4f1-6b824e79a9bc None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:35.044126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd6d39-a8d1-4487-b91d-6f5c4a940b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:35.044809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6d39-a8d1-4487-b91d-6f5c4a940b9d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:35.045584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6d39-a8d1-4487-b91d-6f5c4a940b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:35.045859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6d39-a8d1-4487-b91d-6f5c4a940b9d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:35.046449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd6d39-a8d1-4487-b91d-6f5c4a940b9d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:35.047831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd6d39-a8d1-4487-b91d-6f5c4a940b9d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:35.051963 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b331d-dde2-4426-bc49-bfc84fb31fe9 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:35.052270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b331d-dde2-4426-bc49-bfc84fb31fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:35.052554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b331d-dde2-4426-bc49-bfc84fb31fe9 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:35.055147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 445/895] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-4fdd6d39-a8d1-4487-b91d-6f5c4a940b9d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:35.058686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:35.059825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:35.060919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 451/896] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Aug 24 16:57:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:35.061884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcfd5a-3134-43ef-a0fa-fced0f7c272f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:35.061884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcfd5a-3134-43ef-a0fa-fced0f7c272f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:35.062360 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcfd5a-3134-43ef-a0fa-fced0f7c272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:35.065779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd6d39-a8d1-4487-b91d-6f5c4a940b9d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:35.089482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-14bcfd5a-3134-43ef-a0fa-fced0f7c272f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:35.090881 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-14bcfd5a-3134-43ef-a0fa-fced0f7c272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:35.101700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:35.169037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 446/897] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:35.170386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcfd5a-3134-43ef-a0fa-fced0f7c272f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:35.179137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd6d39-a8d1-4487-b91d-6f5c4a940b9d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:35.214815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511c0a2-793c-4b18-981f-50cc5b9c413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:35.215579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511c0a2-793c-4b18-981f-50cc5b9c413f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:35.215958 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511c0a2-793c-4b18-981f-50cc5b9c413f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:35.216368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511c0a2-793c-4b18-981f-50cc5b9c413f None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:35.217179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511c0a2-793c-4b18-981f-50cc5b9c413f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:35.217593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511c0a2-793c-4b18-981f-50cc5b9c413f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:35.219424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511c0a2-793c-4b18-981f-50cc5b9c413f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:35.224520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 452/898] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Aug 24 16:57:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:35.237205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511c0a2-793c-4b18-981f-50cc5b9c413f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:35.268853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:35.291452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcfd5a-3134-43ef-a0fa-fced0f7c272f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:35.332267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c993ebd-ef8a-4d60-9a7f-5371e2809ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:35.332801 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993ebd-ef8a-4d60-9a7f-5371e2809ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:35.333077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993ebd-ef8a-4d60-9a7f-5371e2809ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:35.333346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c993ebd-ef8a-4d60-9a7f-5371e2809ee7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:35.333930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c993ebd-ef8a-4d60-9a7f-5371e2809ee7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:35.335305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c993ebd-ef8a-4d60-9a7f-5371e2809ee7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-2c993ebd-ef8a-4d60-9a7f-5371e2809ee7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:35.345652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:35.346656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:35.352271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 447/899] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:57:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:35.355179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c993ebd-ef8a-4d60-9a7f-5371e2809ee7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:35.369630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:35.377722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511c0a2-793c-4b18-981f-50cc5b9c413f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:35.422923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33445dd-377a-4afb-84bb-4b3ffccb7b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:35.423534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33445dd-377a-4afb-84bb-4b3ffccb7b5d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:35.423812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33445dd-377a-4afb-84bb-4b3ffccb7b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:35.424082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33445dd-377a-4afb-84bb-4b3ffccb7b5d None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:35.425317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33445dd-377a-4afb-84bb-4b3ffccb7b5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:35.425626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33445dd-377a-4afb-84bb-4b3ffccb7b5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:35.427300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33445dd-377a-4afb-84bb-4b3ffccb7b5d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:35.436429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 453/900] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Aug 24 16:57:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:35.462465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33445dd-377a-4afb-84bb-4b3ffccb7b5d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:35.497932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c993ebd-ef8a-4d60-9a7f-5371e2809ee7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:35.547779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0977-943f-4bbb-9b9b-12ecea842e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:35.548389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0977-943f-4bbb-9b9b-12ecea842e7f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:35.548699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0977-943f-4bbb-9b9b-12ecea842e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:35.548978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be0977-943f-4bbb-9b9b-12ecea842e7f None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:35.549628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be0977-943f-4bbb-9b9b-12ecea842e7f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:35.549931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be0977-943f-4bbb-9b9b-12ecea842e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:35.552220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be0977-943f-4bbb-9b9b-12ecea842e7f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:35.562243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 448/901] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:57:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:35.565978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0977-943f-4bbb-9b9b-12ecea842e7f None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:35.586247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:35.599934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33445dd-377a-4afb-84bb-4b3ffccb7b5d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:35.650659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a3af4-cddf-4dc7-b1dc-0dc2512fe9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:35.651984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a3af4-cddf-4dc7-b1dc-0dc2512fe9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:35.652489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a3af4-cddf-4dc7-b1dc-0dc2512fe9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:35.652975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a3af4-cddf-4dc7-b1dc-0dc2512fe9f7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:35.653909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a3af4-cddf-4dc7-b1dc-0dc2512fe9f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:35.655982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a3af4-cddf-4dc7-b1dc-0dc2512fe9f7 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:35.666918 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-099a3af4-cddf-4dc7-b1dc-0dc2512fe9f7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:35.668896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:35.669817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:57:35.670720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:35.678028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 454/902] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Aug 24 16:57:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:35.679844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a3af4-cddf-4dc7-b1dc-0dc2512fe9f7 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:35.699067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be0977-943f-4bbb-9b9b-12ecea842e7f None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:35.737579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73567e8-89ce-404d-8a9b-201a7c1a220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:35.738201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73567e8-89ce-404d-8a9b-201a7c1a220d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:35.738485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73567e8-89ce-404d-8a9b-201a7c1a220d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:35.738805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73567e8-89ce-404d-8a9b-201a7c1a220d None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:35.739447 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73567e8-89ce-404d-8a9b-201a7c1a220d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:35.740007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73567e8-89ce-404d-8a9b-201a7c1a220d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:35.741254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73567e8-89ce-404d-8a9b-201a7c1a220d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:35.752133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 449/903] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:57:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:35.753338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73567e8-89ce-404d-8a9b-201a7c1a220d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:35.816112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a3af4-cddf-4dc7-b1dc-0dc2512fe9f7 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:35.863370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df352514-84af-4da6-ba05-57bf15d22958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:35.864382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df352514-84af-4da6-ba05-57bf15d22958 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:35.864506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73567e8-89ce-404d-8a9b-201a7c1a220d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:35.864964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df352514-84af-4da6-ba05-57bf15d22958 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:35.865472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df352514-84af-4da6-ba05-57bf15d22958 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:35.866602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df352514-84af-4da6-ba05-57bf15d22958 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:35.867089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df352514-84af-4da6-ba05-57bf15d22958 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:35.868761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df352514-84af-4da6-ba05-57bf15d22958 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:35.880867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 455/904] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Aug 24 16:57:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:35.882450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df352514-84af-4da6-ba05-57bf15d22958 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:35.908684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:35.912342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec75f0-8a20-4b70-b72d-70e9609f59e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:35.913176 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec75f0-8a20-4b70-b72d-70e9609f59e9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:35.913317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec75f0-8a20-4b70-b72d-70e9609f59e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:35.913502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec75f0-8a20-4b70-b72d-70e9609f59e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:35.914210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec75f0-8a20-4b70-b72d-70e9609f59e9 None admin] RBAC: Adding query filter params (interface=public, service_id=c205aa9891c54e41a3f3a63b7e583fbc, region_id=RegionOne) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:35.914514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec75f0-8a20-4b70-b72d-70e9609f59e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:35.915942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec75f0-8a20-4b70-b72d-70e9609f59e9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:35.918801 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:35.922690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 450/905] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Aug 24 16:57:35 2022] GET /identity/v3/endpoints?service_id=c205aa9891c54e41a3f3a63b7e583fbc&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:35.929456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec75f0-8a20-4b70-b72d-70e9609f59e9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:35.999623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df352514-84af-4da6-ba05-57bf15d22958 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:36.046928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b026e-989d-4463-a847-97fef3e62f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:36.047525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b026e-989d-4463-a847-97fef3e62f70 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:36.047799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b026e-989d-4463-a847-97fef3e62f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:36.048069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b026e-989d-4463-a847-97fef3e62f70 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:36.048755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b026e-989d-4463-a847-97fef3e62f70 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:36.049051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b026e-989d-4463-a847-97fef3e62f70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:36.051012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b026e-989d-4463-a847-97fef3e62f70 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:36.063329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 456/906] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Aug 24 16:57:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:36.065376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b026e-989d-4463-a847-97fef3e62f70 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:36.066017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec75f0-8a20-4b70-b72d-70e9609f59e9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:36.112591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda12c77-802b-4878-9f55-8568a0f88f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:36.113207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda12c77-802b-4878-9f55-8568a0f88f68 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:36.113484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda12c77-802b-4878-9f55-8568a0f88f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:36.113804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda12c77-802b-4878-9f55-8568a0f88f68 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:36.114407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda12c77-802b-4878-9f55-8568a0f88f68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:36.115825 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda12c77-802b-4878-9f55-8568a0f88f68 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:36.123292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 451/907] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Aug 24 16:57:35 2022] GET /identity/v3/services => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:57:36.171846 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:36.193731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b026e-989d-4463-a847-97fef3e62f70 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:36.234725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c675c-95ef-406b-9808-203bbf31bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:36.236108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c675c-95ef-406b-9808-203bbf31bd51 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:36.236675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c675c-95ef-406b-9808-203bbf31bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:36.237216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c675c-95ef-406b-9808-203bbf31bd51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:36.238097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c675c-95ef-406b-9808-203bbf31bd51 None admin] RBAC: Adding query filter params (interface=public, service_id=48694a316f034bf78a68369d1d68b2e6, region_id=RegionOne) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:36.238654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c675c-95ef-406b-9808-203bbf31bd51 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:36.240299 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c675c-95ef-406b-9808-203bbf31bd51 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:36.264257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 457/908] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Aug 24 16:57:36 2022] GET /identity/v3/endpoints?service_id=48694a316f034bf78a68369d1d68b2e6&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:36.267263 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda12c77-802b-4878-9f55-8568a0f88f68 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:36.342720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:36.382437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda12c77-802b-4878-9f55-8568a0f88f68 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:36.419544 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac61f5-bbf4-410a-a4ce-652bf475ca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:36.420164 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac61f5-bbf4-410a-a4ce-652bf475ca8f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:36.420480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac61f5-bbf4-410a-a4ce-652bf475ca8f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:36.420762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac61f5-bbf4-410a-a4ce-652bf475ca8f None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:36.421390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac61f5-bbf4-410a-a4ce-652bf475ca8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:36.422774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac61f5-bbf4-410a-a4ce-652bf475ca8f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:36.436575 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 452/909] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Aug 24 16:57:36 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:57:36.925517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ecd3d-5787-4a85-81a2-396bf00d7f81 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:36.925882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ecd3d-5787-4a85-81a2-396bf00d7f81 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:36.926110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ecd3d-5787-4a85-81a2-396bf00d7f81 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:36.927736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 458/910] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:36.933961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac45722-c1a1-4989-bdc9-2db8a56e9119 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:36.934249 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac45722-c1a1-4989-bdc9-2db8a56e9119 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:36.934525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac45722-c1a1-4989-bdc9-2db8a56e9119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:36.953381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-3ac45722-c1a1-4989-bdc9-2db8a56e9119 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:36.955195 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3ac45722-c1a1-4989-bdc9-2db8a56e9119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:37.034277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 453/911] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:37.336986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ecd3d-5787-4a85-81a2-396bf00d7f81 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:37.465653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ecd3d-5787-4a85-81a2-396bf00d7f81 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:37.477651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c58c3-cc39-4ad4-8eeb-7415591851a9 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:37.478188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c58c3-cc39-4ad4-8eeb-7415591851a9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:37.478188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c58c3-cc39-4ad4-8eeb-7415591851a9 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:37.480048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 454/912] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:37.485330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477117d-efd4-46ce-bf51-f83724e4dfa7 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:37.485608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477117d-efd4-46ce-bf51-f83724e4dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:37.485874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477117d-efd4-46ce-bf51-f83724e4dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:37.505961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73026eff-1cf7-40b6-9803-8ee78ab3aa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:37.506694 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026eff-1cf7-40b6-9803-8ee78ab3aa2b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:37.506967 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026eff-1cf7-40b6-9803-8ee78ab3aa2b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:37.507198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-f477117d-efd4-46ce-bf51-f83724e4dfa7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:37.507313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026eff-1cf7-40b6-9803-8ee78ab3aa2b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:37.510007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f477117d-efd4-46ce-bf51-f83724e4dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:37.521337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73026eff-1cf7-40b6-9803-8ee78ab3aa2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-73026eff-1cf7-40b6-9803-8ee78ab3aa2b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:37.528023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:37.529042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:57:37.529893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:37.530518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 459/913] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Aug 24 16:57:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:37.539873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73026eff-1cf7-40b6-9803-8ee78ab3aa2b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:37.560693 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:37.589563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:37.612463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 455/914] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:37.681547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73026eff-1cf7-40b6-9803-8ee78ab3aa2b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:37.722243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8757a95-0557-4843-8356-7c57bf7d4382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:37.723265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8757a95-0557-4843-8356-7c57bf7d4382 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:37.723738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8757a95-0557-4843-8356-7c57bf7d4382 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:37.724206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8757a95-0557-4843-8356-7c57bf7d4382 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:37.725599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8757a95-0557-4843-8356-7c57bf7d4382 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:37.726168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8757a95-0557-4843-8356-7c57bf7d4382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:37.728806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8757a95-0557-4843-8356-7c57bf7d4382 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:37.738969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 460/915] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Aug 24 16:57:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:37.745300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477117d-efd4-46ce-bf51-f83724e4dfa7 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:37.848843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477117d-efd4-46ce-bf51-f83724e4dfa7 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:37.886004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b7cb5-bae7-420c-9203-e63bda2ff9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:37.886642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b7cb5-bae7-420c-9203-e63bda2ff9b0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:37.886914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b7cb5-bae7-420c-9203-e63bda2ff9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:37.887182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b7cb5-bae7-420c-9203-e63bda2ff9b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:37.898084 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b7cb5-bae7-420c-9203-e63bda2ff9b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:37.899537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b7cb5-bae7-420c-9203-e63bda2ff9b0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:37.901333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8757a95-0557-4843-8356-7c57bf7d4382 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-e21b7cb5-bae7-420c-9203-e63bda2ff9b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:37.920631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:37.923038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:37.924199 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:37.924199 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:37.924199 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:37.924611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 456/916] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:37.927588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b7cb5-bae7-420c-9203-e63bda2ff9b0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:37.977297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:37.989114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:38.027546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8757a95-0557-4843-8356-7c57bf7d4382 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:38.037509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b7cb5-bae7-420c-9203-e63bda2ff9b0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:38.064599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16de6f-5ab6-4d44-8a2e-8bc09e2a27f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:38.065572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16de6f-5ab6-4d44-8a2e-8bc09e2a27f1 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:38.066058 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16de6f-5ab6-4d44-8a2e-8bc09e2a27f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:38.066622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16de6f-5ab6-4d44-8a2e-8bc09e2a27f1 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:38.067523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16de6f-5ab6-4d44-8a2e-8bc09e2a27f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:38.069294 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16de6f-5ab6-4d44-8a2e-8bc09e2a27f1 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:38.075276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abef9a-495c-4ea8-a256-68206df39481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:38.076024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abef9a-495c-4ea8-a256-68206df39481 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:38.076251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abef9a-495c-4ea8-a256-68206df39481 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:38.076541 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abef9a-495c-4ea8-a256-68206df39481 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:38.077208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abef9a-495c-4ea8-a256-68206df39481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:38.077550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abef9a-495c-4ea8-a256-68206df39481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:38.079046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abef9a-495c-4ea8-a256-68206df39481 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:38.092267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 457/917] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:38.097568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abef9a-495c-4ea8-a256-68206df39481 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:38.157043 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 461/918] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:57:37 2022] POST /identity/v3/services => generated 241 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:38.216175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:38.220517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abef9a-495c-4ea8-a256-68206df39481 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:38.267091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c571bf-2b93-4b80-9858-7686e38ada0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:38.268113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c571bf-2b93-4b80-9858-7686e38ada0c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:38.268633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c571bf-2b93-4b80-9858-7686e38ada0c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:38.269172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c571bf-2b93-4b80-9858-7686e38ada0c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:38.278045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c571bf-2b93-4b80-9858-7686e38ada0c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:38.279894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c571bf-2b93-4b80-9858-7686e38ada0c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-f1c571bf-2b93-4b80-9858-7686e38ada0c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:38.300909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:38.301785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:38.302709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:38.302709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:38.302709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:38.302709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:38.302709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:38.302709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:38.302709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:38.302709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:38.302709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:38.302709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:38.302709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 458/919] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Aug 24 16:57:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:38.303291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16de6f-5ab6-4d44-8a2e-8bc09e2a27f1 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:38.352052 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23c4c9-e624-441d-b135-8ab2fe8305aa None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:38.352411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23c4c9-e624-441d-b135-8ab2fe8305aa None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:38.352693 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23c4c9-e624-441d-b135-8ab2fe8305aa None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:38.354804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 459/920] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:38.359866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc10a68-eeea-4175-b0aa-80d6d7ebfb0f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:38.360129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc10a68-eeea-4175-b0aa-80d6d7ebfb0f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:38.360484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc10a68-eeea-4175-b0aa-80d6d7ebfb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:38.383925 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-5fc10a68-eeea-4175-b0aa-80d6d7ebfb0f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:38.387080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5fc10a68-eeea-4175-b0aa-80d6d7ebfb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:38.432795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16de6f-5ab6-4d44-8a2e-8bc09e2a27f1 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:38.466570 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:38.475654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13bb1c-619f-46f3-bd24-3ac99379de8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:38.476297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bb1c-619f-46f3-bd24-3ac99379de8d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:38.476574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bb1c-619f-46f3-bd24-3ac99379de8d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:38.478975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13bb1c-619f-46f3-bd24-3ac99379de8d None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:38.478975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13bb1c-619f-46f3-bd24-3ac99379de8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:38.478975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13bb1c-619f-46f3-bd24-3ac99379de8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:38.480320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13bb1c-619f-46f3-bd24-3ac99379de8d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:38.487592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 460/921] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:38.487592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea5cc-51b9-4210-a1d8-cf73725bc726 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:38.487592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea5cc-51b9-4210-a1d8-cf73725bc726 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:38.487592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea5cc-51b9-4210-a1d8-cf73725bc726 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:38.489754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 461/922] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:38.494365 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc59039-c8db-4813-afe2-e8d19bcc20b9 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:38.494869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc59039-c8db-4813-afe2-e8d19bcc20b9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:38.495356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc59039-c8db-4813-afe2-e8d19bcc20b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:38.501551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 462/923] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Aug 24 16:57:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:38.508188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13bb1c-619f-46f3-bd24-3ac99379de8d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:38.515799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-afc59039-c8db-4813-afe2-e8d19bcc20b9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:38.517311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-afc59039-c8db-4813-afe2-e8d19bcc20b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:38.612622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 462/924] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:38.640485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13bb1c-619f-46f3-bd24-3ac99379de8d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:38.682178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920ff21-7eb1-4a8f-a313-fba8dfc5b037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:38.682965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ff21-7eb1-4a8f-a313-fba8dfc5b037 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:38.683508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ff21-7eb1-4a8f-a313-fba8dfc5b037 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:38.683847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ff21-7eb1-4a8f-a313-fba8dfc5b037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:38.694970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920ff21-7eb1-4a8f-a313-fba8dfc5b037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:38.696595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920ff21-7eb1-4a8f-a313-fba8dfc5b037 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-4920ff21-7eb1-4a8f-a313-fba8dfc5b037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:38.711590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:38.712654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:38.713534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:38.713534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:38.713534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:38.713534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 463/925] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:38.719788 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc59039-c8db-4813-afe2-e8d19bcc20b9 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:38.738847 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:38.763220 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920ff21-7eb1-4a8f-a313-fba8dfc5b037 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:38.814248 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:38.842236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc59039-c8db-4813-afe2-e8d19bcc20b9 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:38.889981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced5906-4fb7-46f8-afa2-582bca46b629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:38.890588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced5906-4fb7-46f8-afa2-582bca46b629 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:38.890868 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced5906-4fb7-46f8-afa2-582bca46b629 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:38.891124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced5906-4fb7-46f8-afa2-582bca46b629 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:38.891764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced5906-4fb7-46f8-afa2-582bca46b629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:38.892065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced5906-4fb7-46f8-afa2-582bca46b629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:38.893458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced5906-4fb7-46f8-afa2-582bca46b629 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:38.894307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920ff21-7eb1-4a8f-a313-fba8dfc5b037 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:38.904964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 463/926] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:38.905851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced5906-4fb7-46f8-afa2-582bca46b629 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:38.937776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094987d7-d5ee-49b7-a7c8-21b44d3b8e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:38.938332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094987d7-d5ee-49b7-a7c8-21b44d3b8e9a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:38.938601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094987d7-d5ee-49b7-a7c8-21b44d3b8e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:38.938878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094987d7-d5ee-49b7-a7c8-21b44d3b8e9a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:38.939464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094987d7-d5ee-49b7-a7c8-21b44d3b8e9a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:38.940940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094987d7-d5ee-49b7-a7c8-21b44d3b8e9a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-094987d7-d5ee-49b7-a7c8-21b44d3b8e9a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:38.951132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:38.952118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:38.952971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 464/927] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:57:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:38.953844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094987d7-d5ee-49b7-a7c8-21b44d3b8e9a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:38.991925 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:39.015475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced5906-4fb7-46f8-afa2-582bca46b629 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:39.051079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff799b0-22e8-464b-a7e7-0217b3d2210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:39.051982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff799b0-22e8-464b-a7e7-0217b3d2210f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:39.052451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff799b0-22e8-464b-a7e7-0217b3d2210f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:39.052873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff799b0-22e8-464b-a7e7-0217b3d2210f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:39.053601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff799b0-22e8-464b-a7e7-0217b3d2210f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:39.055123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff799b0-22e8-464b-a7e7-0217b3d2210f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-8ff799b0-22e8-464b-a7e7-0217b3d2210f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:39.065684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:39.066799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:57:39.067922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:39.071730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 464/928] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Aug 24 16:57:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:39.072531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094987d7-d5ee-49b7-a7c8-21b44d3b8e9a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:39.072773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff799b0-22e8-464b-a7e7-0217b3d2210f None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:39.074607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:39.111596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f9e5-40e7-47d0-b96c-0e58c10dd6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:39.112502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f9e5-40e7-47d0-b96c-0e58c10dd6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:39.112954 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f9e5-40e7-47d0-b96c-0e58c10dd6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:39.113393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5f9e5-40e7-47d0-b96c-0e58c10dd6e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:39.122173 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5f9e5-40e7-47d0-b96c-0e58c10dd6e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:39.123846 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5f9e5-40e7-47d0-b96c-0e58c10dd6e2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-8ed5f9e5-40e7-47d0-b96c-0e58c10dd6e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:39.136588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:39.137674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:39.138760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:39.138760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:39.138760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:39.138760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:39.138760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:39.138760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:39.138760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:39.138760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:39.140810 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 465/929] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:39.141836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f9e5-40e7-47d0-b96c-0e58c10dd6e2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:39.187598 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff799b0-22e8-464b-a7e7-0217b3d2210f None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:39.225707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e104d-fbef-476d-b96d-a68ffe3b4ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:39.226320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e104d-fbef-476d-b96d-a68ffe3b4ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:39.226596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e104d-fbef-476d-b96d-a68ffe3b4ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:39.226863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e104d-fbef-476d-b96d-a68ffe3b4ef7 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:39.227538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e104d-fbef-476d-b96d-a68ffe3b4ef7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:39.227847 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e104d-fbef-476d-b96d-a68ffe3b4ef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:39.231631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e104d-fbef-476d-b96d-a68ffe3b4ef7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:39.237863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 465/930] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:57:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:39.238591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e104d-fbef-476d-b96d-a68ffe3b4ef7 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:39.243032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:39.264814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5f9e5-40e7-47d0-b96c-0e58c10dd6e2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:39.302643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb0848-0a12-4096-95ad-9166320d2f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:39.303247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb0848-0a12-4096-95ad-9166320d2f00 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:39.303615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb0848-0a12-4096-95ad-9166320d2f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:39.303790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb0848-0a12-4096-95ad-9166320d2f00 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:39.304424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb0848-0a12-4096-95ad-9166320d2f00 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:39.304722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb0848-0a12-4096-95ad-9166320d2f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:39.306244 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb0848-0a12-4096-95ad-9166320d2f00 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:39.311752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 466/931] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Aug 24 16:57:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:39.317300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb0848-0a12-4096-95ad-9166320d2f00 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:39.351991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:39.358906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e104d-fbef-476d-b96d-a68ffe3b4ef7 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:39.393849 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29655164-5517-4acb-a9fd-a0ba39238c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:39.394458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29655164-5517-4acb-a9fd-a0ba39238c5b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:39.394791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29655164-5517-4acb-a9fd-a0ba39238c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:39.395080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29655164-5517-4acb-a9fd-a0ba39238c5b None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:39.395674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29655164-5517-4acb-a9fd-a0ba39238c5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:39.395975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29655164-5517-4acb-a9fd-a0ba39238c5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:39.398027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29655164-5517-4acb-a9fd-a0ba39238c5b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:39.416525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 466/932] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:39.416525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29655164-5517-4acb-a9fd-a0ba39238c5b None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:39.437625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb0848-0a12-4096-95ad-9166320d2f00 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:39.474894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327ae9e-cd9d-48fe-a9eb-03a255eebf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:39.475891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ae9e-cd9d-48fe-a9eb-03a255eebf41 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:39.476304 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ae9e-cd9d-48fe-a9eb-03a255eebf41 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:39.476711 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327ae9e-cd9d-48fe-a9eb-03a255eebf41 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:39.477343 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327ae9e-cd9d-48fe-a9eb-03a255eebf41 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:39.477809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327ae9e-cd9d-48fe-a9eb-03a255eebf41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:39.480378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327ae9e-cd9d-48fe-a9eb-03a255eebf41 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:39.482020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:39.486076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 467/933] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Aug 24 16:57:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:39.487515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327ae9e-cd9d-48fe-a9eb-03a255eebf41 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:39.521199 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29655164-5517-4acb-a9fd-a0ba39238c5b None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:39.558627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10e6bc-eab4-4b4d-b213-ee3f1d12e7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:39.559228 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e6bc-eab4-4b4d-b213-ee3f1d12e7de None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:39.559509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e6bc-eab4-4b4d-b213-ee3f1d12e7de None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:39.559779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10e6bc-eab4-4b4d-b213-ee3f1d12e7de None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:39.560447 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10e6bc-eab4-4b4d-b213-ee3f1d12e7de None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:39.560746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10e6bc-eab4-4b4d-b213-ee3f1d12e7de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:39.562227 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10e6bc-eab4-4b4d-b213-ee3f1d12e7de None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:39.567656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 467/934] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Aug 24 16:57:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:39.568612 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10e6bc-eab4-4b4d-b213-ee3f1d12e7de None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:39.597370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:39.609400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327ae9e-cd9d-48fe-a9eb-03a255eebf41 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:39.647929 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f382f7-e960-4f33-b4f9-7ac23fdc5f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:39.648623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f382f7-e960-4f33-b4f9-7ac23fdc5f3f None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:39.648901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f382f7-e960-4f33-b4f9-7ac23fdc5f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:39.649172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f382f7-e960-4f33-b4f9-7ac23fdc5f3f None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/aa7e5d51065e4d7dba5b1a433998142e/roles/4ff6270f4a6f4b95b4966128abe3ef9c` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:39.652047 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f382f7-e960-4f33-b4f9-7ac23fdc5f3f None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=aa7e5d51065e4d7dba5b1a433998142e, role_id=4ff6270f4a6f4b95b4966128abe3ef9c)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:39.653537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f382f7-e960-4f33-b4f9-7ac23fdc5f3f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:39.678033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10e6bc-eab4-4b4d-b213-ee3f1d12e7de None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:39.705351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:39.714097 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46594a9f-00de-4768-a3ca-79a05361c7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:39.714703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46594a9f-00de-4768-a3ca-79a05361c7f2 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:39.714979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46594a9f-00de-4768-a3ca-79a05361c7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:39.715247 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46594a9f-00de-4768-a3ca-79a05361c7f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:39.715899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46594a9f-00de-4768-a3ca-79a05361c7f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:39.717373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46594a9f-00de-4768-a3ca-79a05361c7f2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:39.760088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 468/935] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:57:39 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/aa7e5d51065e4d7dba5b1a433998142e/roles/4ff6270f4a6f4b95b4966128abe3ef9c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:57:39.761452 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f382f7-e960-4f33-b4f9-7ac23fdc5f3f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:39.836254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 468/936] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 16:57:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:39.910662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f382f7-e960-4f33-b4f9-7ac23fdc5f3f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:39.969567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730749e-8a28-4867-90d8-37ce28ac0757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:39.970183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730749e-8a28-4867-90d8-37ce28ac0757 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:39.970455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730749e-8a28-4867-90d8-37ce28ac0757 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:39.970721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730749e-8a28-4867-90d8-37ce28ac0757 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:39.971381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730749e-8a28-4867-90d8-37ce28ac0757 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:39.972786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730749e-8a28-4867-90d8-37ce28ac0757 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:40.103308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 469/937] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 16:57:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:40.201129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2498ae2-2dd3-4f7c-aeaf-15a11552e230 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:40.201430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2498ae2-2dd3-4f7c-aeaf-15a11552e230 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:40.201681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2498ae2-2dd3-4f7c-aeaf-15a11552e230 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:40.203340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 469/938] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:40.209124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360fe9b-3e41-4885-8f51-e18e09b6e1f3 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:40.209406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360fe9b-3e41-4885-8f51-e18e09b6e1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:40.209680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360fe9b-3e41-4885-8f51-e18e09b6e1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:40.216252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:40.229280 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1360fe9b-3e41-4885-8f51-e18e09b6e1f3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:40.230507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1360fe9b-3e41-4885-8f51-e18e09b6e1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:40.316002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 470/939] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:40.732758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2498ae2-2dd3-4f7c-aeaf-15a11552e230 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:40.914480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2498ae2-2dd3-4f7c-aeaf-15a11552e230 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:40.975248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029f7a4-8ab2-4d33-8bbc-f20fe117a842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:40.976319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f7a4-8ab2-4d33-8bbc-f20fe117a842 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:40.976814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f7a4-8ab2-4d33-8bbc-f20fe117a842 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:40.977297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029f7a4-8ab2-4d33-8bbc-f20fe117a842 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:40.978397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029f7a4-8ab2-4d33-8bbc-f20fe117a842 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:40.980962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029f7a4-8ab2-4d33-8bbc-f20fe117a842 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-b029f7a4-8ab2-4d33-8bbc-f20fe117a842 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:40.998063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:40.999961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:41.001633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:41.006569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 470/940] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Aug 24 16:57:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:41.010281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360fe9b-3e41-4885-8f51-e18e09b6e1f3 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:41.139046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360fe9b-3e41-4885-8f51-e18e09b6e1f3 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:41.166628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:41.174328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42a89c-8124-43a7-8f71-2d7f89958c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:41.174947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42a89c-8124-43a7-8f71-2d7f89958c31 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:41.175228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42a89c-8124-43a7-8f71-2d7f89958c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:41.175499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42a89c-8124-43a7-8f71-2d7f89958c31 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:41.176132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42a89c-8124-43a7-8f71-2d7f89958c31 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:41.176462 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42a89c-8124-43a7-8f71-2d7f89958c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:41.177821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42a89c-8124-43a7-8f71-2d7f89958c31 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:41.183641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 471/941] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Aug 24 16:57:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:41.189502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029f7a4-8ab2-4d33-8bbc-f20fe117a842 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:41.248844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:41.298766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029f7a4-8ab2-4d33-8bbc-f20fe117a842 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:41.336474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ad2cb-b939-430c-b93b-83a4df88f4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:41.341307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ad2cb-b939-430c-b93b-83a4df88f4bf None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:41.341307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ad2cb-b939-430c-b93b-83a4df88f4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:41.341307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ad2cb-b939-430c-b93b-83a4df88f4bf None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:41.341307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ad2cb-b939-430c-b93b-83a4df88f4bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:41.341307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ad2cb-b939-430c-b93b-83a4df88f4bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:41.341307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ad2cb-b939-430c-b93b-83a4df88f4bf None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:41.349640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 471/942] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Aug 24 16:57:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:41.352098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42a89c-8124-43a7-8f71-2d7f89958c31 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:41.459690 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42a89c-8124-43a7-8f71-2d7f89958c31 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:41.496448 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeefd44-9ef7-4a0c-9178-5079de4df8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:41.497067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeefd44-9ef7-4a0c-9178-5079de4df8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:41.497354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeefd44-9ef7-4a0c-9178-5079de4df8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:41.497634 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeefd44-9ef7-4a0c-9178-5079de4df8d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:41.498349 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeefd44-9ef7-4a0c-9178-5079de4df8d5 None admin] RBAC: Adding query filter params (interface=public, service_id=65b7386d35754837a5cda4e1827fac38, region_id=RegionOne) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:41.498663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeefd44-9ef7-4a0c-9178-5079de4df8d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:41.500196 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeefd44-9ef7-4a0c-9178-5079de4df8d5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:41.510351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 472/943] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Aug 24 16:57:41 2022] GET /identity/v3/endpoints?service_id=65b7386d35754837a5cda4e1827fac38&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:41.511774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ad2cb-b939-430c-b93b-83a4df88f4bf None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:41.619577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ad2cb-b939-430c-b93b-83a4df88f4bf None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:41.633814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:41.656438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a64d3-030f-4383-9bfa-927458a323ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:41.661450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a64d3-030f-4383-9bfa-927458a323ae None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:41.661450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a64d3-030f-4383-9bfa-927458a323ae None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:41.661450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a64d3-030f-4383-9bfa-927458a323ae None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:41.661450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a64d3-030f-4383-9bfa-927458a323ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:41.661450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a64d3-030f-4383-9bfa-927458a323ae None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:41.669429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 472/944] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Aug 24 16:57:41 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:57:41.783795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6afb3-f0e5-4188-90bb-569266a0e108 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:41.784098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6afb3-f0e5-4188-90bb-569266a0e108 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:41.784303 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6afb3-f0e5-4188-90bb-569266a0e108 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:41.785970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 473/945] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:41.792056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91acdb-c406-44e9-8b8f-5bfe64e84909 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:41.792609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91acdb-c406-44e9-8b8f-5bfe64e84909 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:41.792609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91acdb-c406-44e9-8b8f-5bfe64e84909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:41.812962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ed91acdb-c406-44e9-8b8f-5bfe64e84909 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:41.814168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ed91acdb-c406-44e9-8b8f-5bfe64e84909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:41.891800 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 473/946] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:41.897190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6892e-d821-480d-bcdb-49f82df253f5 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:41.897478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6892e-d821-480d-bcdb-49f82df253f5 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:41.897750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6892e-d821-480d-bcdb-49f82df253f5 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:41.899073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 474/947] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:41.904816 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbe3bf-9e29-4078-85b3-79025cf4897d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:41.905121 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbe3bf-9e29-4078-85b3-79025cf4897d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:41.905446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bbe3bf-9e29-4078-85b3-79025cf4897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:41.925036 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b4bbe3bf-9e29-4078-85b3-79025cf4897d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:41.926245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b4bbe3bf-9e29-4078-85b3-79025cf4897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:42.002725 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 474/948] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:42.287373 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6892e-d821-480d-bcdb-49f82df253f5 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:42.344310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbe3bf-9e29-4078-85b3-79025cf4897d None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:42.382745 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:42.415297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:42.438039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6892e-d821-480d-bcdb-49f82df253f5 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:42.476329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f61c7-c480-4afb-9684-1bd16ae51753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:42.476969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f61c7-c480-4afb-9684-1bd16ae51753 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:42.477248 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f61c7-c480-4afb-9684-1bd16ae51753 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:42.477520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f61c7-c480-4afb-9684-1bd16ae51753 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:42.478930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f61c7-c480-4afb-9684-1bd16ae51753 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:42.480433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f61c7-c480-4afb-9684-1bd16ae51753 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:42.483073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: WARNING keystone.server.flask.common [None req-7c6f61c7-c480-4afb-9684-1bd16ae51753 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 16:57:42.515572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bbe3bf-9e29-4078-85b3-79025cf4897d None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:42.542702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.sql.core [None req-7c6f61c7-c480-4afb-9684-1bd16ae51753 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 16:57:42.542702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 16:57:42.542702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [parameters: {'id': '8681f73abd2f4b388bbf2fd2abd4a53a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 16:57:42.542702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81946) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-7c6f61c7-c480-4afb-9684-1bd16ae51753 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8681f73abd2f4b388bbf2fd2abd4a53a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8681f73abd2f4b388bbf2fd2abd4a53a. Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:57:42.549642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result.read() Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 16:57:42.550493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application yield resource Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise self.value Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application session.commit() Aug 24 16:57:42.551494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.session.flush() Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application compat.raise_( Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 16:57:42.552427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 16:57:42.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result.read() Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:57:42.556075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [parameters: {'id': '8681f73abd2f4b388bbf2fd2abd4a53a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:42.558781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:42.560871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8681f73abd2f4b388bbf2fd2abd4a53a. Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 475/949] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Aug 24 16:57:42 2022] POST /identity/v3/projects => generated 262 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4024ee4-d6dd-45f2-98e5-7512ff2db942 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:42.564435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4024ee4-d6dd-45f2-98e5-7512ff2db942 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:42.566614 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4024ee4-d6dd-45f2-98e5-7512ff2db942 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:42.566759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1f40e-76bd-4499-84d5-26b89ff57273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:42.566759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1f40e-76bd-4499-84d5-26b89ff57273 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:42.567079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 476/950] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:42.567231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1f40e-76bd-4499-84d5-26b89ff57273 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:42.567231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1f40e-76bd-4499-84d5-26b89ff57273 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:42.567543 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4024ee4-d6dd-45f2-98e5-7512ff2db942 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:42.574172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1f40e-76bd-4499-84d5-26b89ff57273 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-16b1f40e-76bd-4499-84d5-26b89ff57273 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:42.579008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:42.581370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 475/951] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Aug 24 16:57:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:42.583875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecd084-5280-4ef3-ad3d-3896a45a46d4 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:42.588536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecd084-5280-4ef3-ad3d-3896a45a46d4 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:42.588536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecd084-5280-4ef3-ad3d-3896a45a46d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:42.601274 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-72ecd084-5280-4ef3-ad3d-3896a45a46d4 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:42.602469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-72ecd084-5280-4ef3-ad3d-3896a45a46d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:42.675284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 476/952] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:42.676759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecd084-5280-4ef3-ad3d-3896a45a46d4 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:42.677837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4024ee4-d6dd-45f2-98e5-7512ff2db942 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:42.706881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:42.708181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:42.732868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66422861-7d43-428b-8319-555df9861de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:42.733640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66422861-7d43-428b-8319-555df9861de6 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:42.734026 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66422861-7d43-428b-8319-555df9861de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:42.734408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66422861-7d43-428b-8319-555df9861de6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:42.741804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66422861-7d43-428b-8319-555df9861de6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:42.743706 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66422861-7d43-428b-8319-555df9861de6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-66422861-7d43-428b-8319-555df9861de6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:42.755825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:42.757003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:42.758191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:42.758191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:42.758191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:42.758191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:42.758191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:42.758191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:42.758191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:42.758191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:42.761138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 477/953] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:42.766628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66422861-7d43-428b-8319-555df9861de6 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:42.816407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecd084-5280-4ef3-ad3d-3896a45a46d4 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:42.853224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b0249-7f88-40a8-943d-3681e37326f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:42.856571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0249-7f88-40a8-943d-3681e37326f4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:42.856571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0249-7f88-40a8-943d-3681e37326f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:42.856571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b0249-7f88-40a8-943d-3681e37326f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:42.856571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b0249-7f88-40a8-943d-3681e37326f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:42.856571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b0249-7f88-40a8-943d-3681e37326f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:42.857306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b0249-7f88-40a8-943d-3681e37326f4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:42.871393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 477/954] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Aug 24 16:57:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:42.872701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b0249-7f88-40a8-943d-3681e37326f4 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:42.892401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66422861-7d43-428b-8319-555df9861de6 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:42.937581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caf4b8-7850-4a3f-9619-7213fe14681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:42.938697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caf4b8-7850-4a3f-9619-7213fe14681f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:42.939479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caf4b8-7850-4a3f-9619-7213fe14681f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:42.940203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caf4b8-7850-4a3f-9619-7213fe14681f None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:42.941110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caf4b8-7850-4a3f-9619-7213fe14681f None admin] RBAC: Adding query filter params (name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:42.941720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caf4b8-7850-4a3f-9619-7213fe14681f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:42.943877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caf4b8-7850-4a3f-9619-7213fe14681f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:42.973578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:42.974728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 478/955] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:42.978881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caf4b8-7850-4a3f-9619-7213fe14681f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:42.988924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b0249-7f88-40a8-943d-3681e37326f4 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:43.024322 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:43.040895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503c52c-00db-4928-b381-5a2b46d36332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:43.041888 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c52c-00db-4928-b381-5a2b46d36332 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:43.042668 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c52c-00db-4928-b381-5a2b46d36332 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:43.044037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503c52c-00db-4928-b381-5a2b46d36332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:43.060491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503c52c-00db-4928-b381-5a2b46d36332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:43.062853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503c52c-00db-4928-b381-5a2b46d36332 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-3503c52c-00db-4928-b381-5a2b46d36332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:43.083174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:43.084380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:43.085506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:43.085506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:43.085506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:43.087198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 478/956] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:43.096060 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503c52c-00db-4928-b381-5a2b46d36332 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:43.124978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caf4b8-7850-4a3f-9619-7213fe14681f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:43.169744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611ff3c-6680-4d69-916b-fe82f5b6713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:43.170650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611ff3c-6680-4d69-916b-fe82f5b6713b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:43.171204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611ff3c-6680-4d69-916b-fe82f5b6713b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:43.171315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611ff3c-6680-4d69-916b-fe82f5b6713b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:43.173437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611ff3c-6680-4d69-916b-fe82f5b6713b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:43.173437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611ff3c-6680-4d69-916b-fe82f5b6713b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-1611ff3c-6680-4d69-916b-fe82f5b6713b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:43.185505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:43.186729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:43.187593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 479/957] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:43.192413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611ff3c-6680-4d69-916b-fe82f5b6713b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:43.236087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503c52c-00db-4928-b381-5a2b46d36332 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:43.290197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b003be6-48b9-4cfa-a563-2ae458bc656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:43.291965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b003be6-48b9-4cfa-a563-2ae458bc656e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:43.292572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b003be6-48b9-4cfa-a563-2ae458bc656e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:43.293678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b003be6-48b9-4cfa-a563-2ae458bc656e None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:43.294485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b003be6-48b9-4cfa-a563-2ae458bc656e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:43.295614 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b003be6-48b9-4cfa-a563-2ae458bc656e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:43.296554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b003be6-48b9-4cfa-a563-2ae458bc656e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:43.306321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:43.311338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 479/958] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:43.317650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b003be6-48b9-4cfa-a563-2ae458bc656e None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:43.325947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:43.332377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611ff3c-6680-4d69-916b-fe82f5b6713b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:43.372025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a347d-b9b6-4d09-943a-246bed4ba976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:43.372597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a347d-b9b6-4d09-943a-246bed4ba976 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:43.372876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a347d-b9b6-4d09-943a-246bed4ba976 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:43.373150 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a347d-b9b6-4d09-943a-246bed4ba976 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:43.373787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a347d-b9b6-4d09-943a-246bed4ba976 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:43.374090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a347d-b9b6-4d09-943a-246bed4ba976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:43.375529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a347d-b9b6-4d09-943a-246bed4ba976 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:43.381152 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 480/959] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:43.387480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a347d-b9b6-4d09-943a-246bed4ba976 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:43.428328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b003be6-48b9-4cfa-a563-2ae458bc656e None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:43.467229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cc62b-04b2-4179-ba1d-a2ab73ff2984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:43.468024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc62b-04b2-4179-ba1d-a2ab73ff2984 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:43.468471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc62b-04b2-4179-ba1d-a2ab73ff2984 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:43.468817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cc62b-04b2-4179-ba1d-a2ab73ff2984 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:43.477511 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cc62b-04b2-4179-ba1d-a2ab73ff2984 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:43.479129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cc62b-04b2-4179-ba1d-a2ab73ff2984 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-746cc62b-04b2-4179-ba1d-a2ab73ff2984 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:43.491992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:43.492988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:43.494772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:43.494772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:43.494772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:43.494772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:43.494772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:43.494772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:43.494772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:43.494772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:43.494772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:57:43.494772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:43.498558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 480/960] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Aug 24 16:57:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:43.499545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cc62b-04b2-4179-ba1d-a2ab73ff2984 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:43.500274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a347d-b9b6-4d09-943a-246bed4ba976 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:43.538912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc2fbb-abee-4be3-afe5-85fae896a8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:43.539555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc2fbb-abee-4be3-afe5-85fae896a8bd None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:43.539835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc2fbb-abee-4be3-afe5-85fae896a8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:43.540108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc2fbb-abee-4be3-afe5-85fae896a8bd None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:43.540833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc2fbb-abee-4be3-afe5-85fae896a8bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:43.541140 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc2fbb-abee-4be3-afe5-85fae896a8bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:43.542508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc2fbb-abee-4be3-afe5-85fae896a8bd None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:43.552363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 481/961] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:43.567608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:43.617399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cc62b-04b2-4179-ba1d-a2ab73ff2984 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:43.658416 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb63a6b-e553-485d-a798-62725fd3f6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:43.659317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb63a6b-e553-485d-a798-62725fd3f6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:43.659747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb63a6b-e553-485d-a798-62725fd3f6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:43.660302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb63a6b-e553-485d-a798-62725fd3f6d9 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:43.661246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb63a6b-e553-485d-a798-62725fd3f6d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:43.661727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb63a6b-e553-485d-a798-62725fd3f6d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:43.663392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb63a6b-e553-485d-a798-62725fd3f6d9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:43.686622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 481/962] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Aug 24 16:57:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:43.692826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc2fbb-abee-4be3-afe5-85fae896a8bd None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:43.724918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:43.805002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc2fbb-abee-4be3-afe5-85fae896a8bd None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:43.843754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e9467-7b1f-411a-bff1-f2335ddf4157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:43.844847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e9467-7b1f-411a-bff1-f2335ddf4157 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:43.845269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e9467-7b1f-411a-bff1-f2335ddf4157 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:43.845682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e9467-7b1f-411a-bff1-f2335ddf4157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:43.887310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77184ad1-94a2-4c94-99bf-73782529e117 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:43.887835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77184ad1-94a2-4c94-99bf-73782529e117 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:43.887835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77184ad1-94a2-4c94-99bf-73782529e117 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:43.889444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 482/963] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:43.894691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2e157-1499-4406-b654-0aed874bdfe9 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:43.894967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2e157-1499-4406-b654-0aed874bdfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:43.895244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2e157-1499-4406-b654-0aed874bdfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:43.921922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-a9b2e157-1499-4406-b654-0aed874bdfe9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:43.923382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a9b2e157-1499-4406-b654-0aed874bdfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:43.925990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e9467-7b1f-411a-bff1-f2335ddf4157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:43.928620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e9467-7b1f-411a-bff1-f2335ddf4157 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:43.963535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:44.025832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 483/964] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:44.066418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 482/965] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:43 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:57:44.072655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2e157-1499-4406-b654-0aed874bdfe9 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:44.125630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:44.178746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2e157-1499-4406-b654-0aed874bdfe9 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:44.216161 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16727-24de-4dcb-a526-147516cfa933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:44.217002 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16727-24de-4dcb-a526-147516cfa933 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:44.217447 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16727-24de-4dcb-a526-147516cfa933 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:44.217820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd16727-24de-4dcb-a526-147516cfa933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:44.229455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd16727-24de-4dcb-a526-147516cfa933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:44.231060 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd16727-24de-4dcb-a526-147516cfa933 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-4dd16727-24de-4dcb-a526-147516cfa933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:44.246906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:44.248078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:44.249231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:44.249231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:44.249231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:44.250673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 484/966] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:44.256257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e9467-7b1f-411a-bff1-f2335ddf4157 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:44.309623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16727-24de-4dcb-a526-147516cfa933 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:44.375600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e9467-7b1f-411a-bff1-f2335ddf4157 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:44.405863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:44.417867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ce388-e63d-4c78-959b-8130953d6182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:44.418440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ce388-e63d-4c78-959b-8130953d6182 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:44.418726 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ce388-e63d-4c78-959b-8130953d6182 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:44.419000 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ce388-e63d-4c78-959b-8130953d6182 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:44.419757 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ce388-e63d-4c78-959b-8130953d6182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:44.425306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ce388-e63d-4c78-959b-8130953d6182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:44.425306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ce388-e63d-4c78-959b-8130953d6182 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:44.425498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:44.426183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd16727-24de-4dcb-a526-147516cfa933 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:44.439909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 483/967] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:44.441216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ce388-e63d-4c78-959b-8130953d6182 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:44.472260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fece1-a27d-4abf-86e8-19b115949c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:44.472958 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fece1-a27d-4abf-86e8-19b115949c5a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:44.473243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fece1-a27d-4abf-86e8-19b115949c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:44.473520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fece1-a27d-4abf-86e8-19b115949c5a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:44.474439 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fece1-a27d-4abf-86e8-19b115949c5a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:44.476044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2fece1-a27d-4abf-86e8-19b115949c5a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-0a2fece1-a27d-4abf-86e8-19b115949c5a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:44.487894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:44.489127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:44.490063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:44.500889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 485/968] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Aug 24 16:57:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:44.504338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fece1-a27d-4abf-86e8-19b115949c5a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:44.567111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ce388-e63d-4c78-959b-8130953d6182 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:44.604980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c7895-7beb-4e31-a93c-3936e6ccc61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:44.605781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7895-7beb-4e31-a93c-3936e6ccc61a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:44.606160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7895-7beb-4e31-a93c-3936e6ccc61a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:44.606530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c7895-7beb-4e31-a93c-3936e6ccc61a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:44.614078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c7895-7beb-4e31-a93c-3936e6ccc61a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:44.615697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c7895-7beb-4e31-a93c-3936e6ccc61a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:44.616953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fece1-a27d-4abf-86e8-19b115949c5a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-ef1c7895-7beb-4e31-a93c-3936e6ccc61a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:44.628868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:44.629984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:44.630874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:44.630874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:44.630874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:44.630874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:44.630874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:44.630874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:44.630874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:44.630874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:44.631317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 484/969] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:44.638126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c7895-7beb-4e31-a93c-3936e6ccc61a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:44.663287 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e37bf8-9b23-475d-89a3-b4f50fe972dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:44.664263 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37bf8-9b23-475d-89a3-b4f50fe972dc None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:44.664856 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37bf8-9b23-475d-89a3-b4f50fe972dc None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:44.665529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e37bf8-9b23-475d-89a3-b4f50fe972dc None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:44.666559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e37bf8-9b23-475d-89a3-b4f50fe972dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:44.667091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e37bf8-9b23-475d-89a3-b4f50fe972dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:44.668823 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e37bf8-9b23-475d-89a3-b4f50fe972dc None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:44.679179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 486/970] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Aug 24 16:57:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:44.682539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e37bf8-9b23-475d-89a3-b4f50fe972dc None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:44.696378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:44.726104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:44.773279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c7895-7beb-4e31-a93c-3936e6ccc61a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:44.822204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2241547-5741-4aa1-a217-34cfbd0525f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:44.823325 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e37bf8-9b23-475d-89a3-b4f50fe972dc None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:44.823583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2241547-5741-4aa1-a217-34cfbd0525f3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:44.824093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2241547-5741-4aa1-a217-34cfbd0525f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:44.824639 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2241547-5741-4aa1-a217-34cfbd0525f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:44.826486 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2241547-5741-4aa1-a217-34cfbd0525f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:44.827066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2241547-5741-4aa1-a217-34cfbd0525f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:44.828766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2241547-5741-4aa1-a217-34cfbd0525f3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:44.850716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 485/971] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:44.851818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2241547-5741-4aa1-a217-34cfbd0525f3 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:44.871746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bb8f4-2462-401b-8fe7-fe15ff6d2be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:44.872513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bb8f4-2462-401b-8fe7-fe15ff6d2be1 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:44.872856 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bb8f4-2462-401b-8fe7-fe15ff6d2be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:44.873197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bb8f4-2462-401b-8fe7-fe15ff6d2be1 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:44.873952 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bb8f4-2462-401b-8fe7-fe15ff6d2be1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:44.874361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bb8f4-2462-401b-8fe7-fe15ff6d2be1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:44.875798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5bb8f4-2462-401b-8fe7-fe15ff6d2be1 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:44.886289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 487/972] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Aug 24 16:57:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:44.888530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bb8f4-2462-401b-8fe7-fe15ff6d2be1 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:44.988484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2241547-5741-4aa1-a217-34cfbd0525f3 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:44.992019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:45.012186 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:45.023939 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bb8f4-2462-401b-8fe7-fe15ff6d2be1 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:45.025892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe781e8-c279-419c-b37c-3ecab1065f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:45.027007 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe781e8-c279-419c-b37c-3ecab1065f4a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:45.028624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe781e8-c279-419c-b37c-3ecab1065f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:45.028624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe781e8-c279-419c-b37c-3ecab1065f4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:45.029061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe781e8-c279-419c-b37c-3ecab1065f4a None admin] RBAC: Adding query filter params (role.id=4ff6270f4a6f4b95b4966128abe3ef9c, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=aa7e5d51065e4d7dba5b1a433998142e) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:45.029836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe781e8-c279-419c-b37c-3ecab1065f4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:45.031728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe781e8-c279-419c-b37c-3ecab1065f4a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:45.044256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 486/973] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:44 2022] GET /identity/v3/role_assignments?user.id=aa7e5d51065e4d7dba5b1a433998142e&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=4ff6270f4a6f4b95b4966128abe3ef9c => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:45.072184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d223e8-814b-44c6-82ab-7afdab987bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:45.073048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d223e8-814b-44c6-82ab-7afdab987bd2 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:45.073557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d223e8-814b-44c6-82ab-7afdab987bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:45.073930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d223e8-814b-44c6-82ab-7afdab987bd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:45.074775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d223e8-814b-44c6-82ab-7afdab987bd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:45.076375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d223e8-814b-44c6-82ab-7afdab987bd2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:45.166901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 488/974] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 16:57:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:45.187082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ebb8-4939-48cf-9001-d8c8de41f290 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:45.187367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ebb8-4939-48cf-9001-d8c8de41f290 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:45.187645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ebb8-4939-48cf-9001-d8c8de41f290 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:45.189483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 487/975] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:45.195609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad084-8c90-476e-b49c-61f76f1a5ffe None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:45.195898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad084-8c90-476e-b49c-61f76f1a5ffe None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:45.196179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad084-8c90-476e-b49c-61f76f1a5ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:45.218276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-a89ad084-8c90-476e-b49c-61f76f1a5ffe None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:45.219519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a89ad084-8c90-476e-b49c-61f76f1a5ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:45.316312 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 489/976] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:45.592683 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ebb8-4939-48cf-9001-d8c8de41f290 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:45.597302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631736a9-95b1-4549-a1a8-bb1997effae0 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:45.597588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631736a9-95b1-4549-a1a8-bb1997effae0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:45.597862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631736a9-95b1-4549-a1a8-bb1997effae0 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:45.599505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 490/977] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:45.606238 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf3b0-86cc-466b-83af-c0e13fd25cfb None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:45.606610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf3b0-86cc-466b-83af-c0e13fd25cfb None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:45.606957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cf3b0-86cc-466b-83af-c0e13fd25cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:45.626422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-901cf3b0-86cc-466b-83af-c0e13fd25cfb None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:45.627777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-901cf3b0-86cc-466b-83af-c0e13fd25cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:45.706632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 491/978] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:45.717218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ebb8-4939-48cf-9001-d8c8de41f290 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:45.753903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db160e-3d60-42c3-861c-44c9b6824081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:45.754498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db160e-3d60-42c3-861c-44c9b6824081 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:45.754780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db160e-3d60-42c3-861c-44c9b6824081 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:45.755055 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db160e-3d60-42c3-861c-44c9b6824081 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:45.755705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db160e-3d60-42c3-861c-44c9b6824081 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:45.757201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db160e-3d60-42c3-861c-44c9b6824081 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:45.804723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.sql.core [None req-02db160e-3d60-42c3-861c-44c9b6824081 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 16:57:45.804723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 16:57:45.804723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [parameters: {'user_id': 'eafe6bc0646141efa3d5d859d2dcb715', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 16:57:45.804723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81946) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-02db160e-3d60-42c3-861c-44c9b6824081 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result.read() Aug 24 16:57:45.811885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:57:45.812786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application yield resource Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise self.value Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application session.commit() Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 16:57:45.813725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.session.flush() Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application compat.raise_( Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 16:57:45.814627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:57:45.815514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application result.read() Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:57:45.816374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [parameters: {'user_id': 'eafe6bc0646141efa3d5d859d2dcb715', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:45.817207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 16:57:45.818849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 16:57:45.821157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 16:57:45.821157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 16:57:45.821157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 16:57:45.821157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 16:57:45.821157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 16:57:45.821157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:45.821157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 488/979] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Aug 24 16:57:45 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:45.824178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cf3b0-86cc-466b-83af-c0e13fd25cfb None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:45.827604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:45.929185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cf3b0-86cc-466b-83af-c0e13fd25cfb None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:45.965229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649f083-661b-4a3a-9fe7-a4504aabe838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:45.966235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649f083-661b-4a3a-9fe7-a4504aabe838 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:45.966724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649f083-661b-4a3a-9fe7-a4504aabe838 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:45.967210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649f083-661b-4a3a-9fe7-a4504aabe838 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:45.974938 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649f083-661b-4a3a-9fe7-a4504aabe838 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:45.976656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649f083-661b-4a3a-9fe7-a4504aabe838 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-d649f083-661b-4a3a-9fe7-a4504aabe838 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:45.988352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:45.989285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:45.990229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:45.990229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:45.990229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:45.990229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:45.990229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:45.990229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:45.990229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:45.990229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:45.990229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:57:45.990229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:45.992874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 492/980] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:57:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:45.998665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db160e-3d60-42c3-861c-44c9b6824081 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:46.002610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649f083-661b-4a3a-9fe7-a4504aabe838 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:46.036779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:46.084563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:46.121626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db160e-3d60-42c3-861c-44c9b6824081 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:46.138661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649f083-661b-4a3a-9fe7-a4504aabe838 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:46.166329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a3824-ba37-4390-8be6-93b9c969fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:46.166999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a3824-ba37-4390-8be6-93b9c969fca2 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:46.167443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a3824-ba37-4390-8be6-93b9c969fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:46.167718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a3824-ba37-4390-8be6-93b9c969fca2 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:46.168767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a3824-ba37-4390-8be6-93b9c969fca2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:46.170830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a3824-ba37-4390-8be6-93b9c969fca2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:46.180069 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34360e-1f4f-4612-af48-2722a003d476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:46.181233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34360e-1f4f-4612-af48-2722a003d476 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:46.181652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34360e-1f4f-4612-af48-2722a003d476 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:46.182221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34360e-1f4f-4612-af48-2722a003d476 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:46.183343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34360e-1f4f-4612-af48-2722a003d476 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:46.183714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34360e-1f4f-4612-af48-2722a003d476 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:46.185287 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34360e-1f4f-4612-af48-2722a003d476 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:46.224438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 493/981] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Aug 24 16:57:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:46.279981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 489/982] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:57:45 2022] POST /identity/v3/services => generated 242 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:47.101525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70d274-4ca5-4324-ad25-31d9b915b094 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:47.102121 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70d274-4ca5-4324-ad25-31d9b915b094 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:47.102121 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70d274-4ca5-4324-ad25-31d9b915b094 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:47.104248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 494/983] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:47.109744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95e842-505c-4ded-abd3-0b257a6759c2 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:47.110195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95e842-505c-4ded-abd3-0b257a6759c2 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:47.110480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95e842-505c-4ded-abd3-0b257a6759c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:47.129070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1f95e842-505c-4ded-abd3-0b257a6759c2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:47.130585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1f95e842-505c-4ded-abd3-0b257a6759c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:47.208916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 490/984] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:47.235912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14891d37-8c67-4da3-8f74-225fb76d2988 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:47.236250 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14891d37-8c67-4da3-8f74-225fb76d2988 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:47.236503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14891d37-8c67-4da3-8f74-225fb76d2988 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:47.237957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 495/985] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:47.243093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addf55b-b3e0-449a-85dd-d5d75be33d90 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:47.243417 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addf55b-b3e0-449a-85dd-d5d75be33d90 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:47.243923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addf55b-b3e0-449a-85dd-d5d75be33d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:47.262482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1addf55b-b3e0-449a-85dd-d5d75be33d90 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:47.263670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1addf55b-b3e0-449a-85dd-d5d75be33d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:47.274427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:47.335945 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 491/986] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:47.497369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14891d37-8c67-4da3-8f74-225fb76d2988 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:47.600219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14891d37-8c67-4da3-8f74-225fb76d2988 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:47.612691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addf55b-b3e0-449a-85dd-d5d75be33d90 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:47.628416 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:47.639738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388598d6-c62d-4905-824f-666648f91195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:47.640413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388598d6-c62d-4905-824f-666648f91195 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:47.640694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388598d6-c62d-4905-824f-666648f91195 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:47.640967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388598d6-c62d-4905-824f-666648f91195 None admin] PATH_INFO: `/v3/services/image` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:47.641554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388598d6-c62d-4905-824f-666648f91195 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:47.642932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388598d6-c62d-4905-824f-666648f91195 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-388598d6-c62d-4905-824f-666648f91195 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:47.651708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:47.657292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:47.658136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 496/987] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Aug 24 16:57:47 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:47.658928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388598d6-c62d-4905-824f-666648f91195 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:47.727910 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addf55b-b3e0-449a-85dd-d5d75be33d90 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:47.764210 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65050e16-f217-4800-a2d6-3b93e3bdfb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:47.764773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65050e16-f217-4800-a2d6-3b93e3bdfb38 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:47.765057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65050e16-f217-4800-a2d6-3b93e3bdfb38 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:47.765330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65050e16-f217-4800-a2d6-3b93e3bdfb38 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:47.765921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65050e16-f217-4800-a2d6-3b93e3bdfb38 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:47.767291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65050e16-f217-4800-a2d6-3b93e3bdfb38 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:47.769541 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388598d6-c62d-4905-824f-666648f91195 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-65050e16-f217-4800-a2d6-3b93e3bdfb38 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:47.777626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:47.778635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:47.779480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 492/988] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Aug 24 16:57:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:47.784580 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65050e16-f217-4800-a2d6-3b93e3bdfb38 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:47.797936 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:47.811408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819886-b42d-4a8d-9837-2786f374be74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:47.812032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819886-b42d-4a8d-9837-2786f374be74 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:47.812335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819886-b42d-4a8d-9837-2786f374be74 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:47.812608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1819886-b42d-4a8d-9837-2786f374be74 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:47.813236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1819886-b42d-4a8d-9837-2786f374be74 None admin] RBAC: Adding query filter params (name=image) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:47.813536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1819886-b42d-4a8d-9837-2786f374be74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:47.814941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1819886-b42d-4a8d-9837-2786f374be74 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:47.819964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 497/989] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:47.825435 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819886-b42d-4a8d-9837-2786f374be74 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:47.882464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:47.895567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65050e16-f217-4800-a2d6-3b93e3bdfb38 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:47.933297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b4fe0-2ced-4269-ad50-5d4e6894ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:47.933909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b4fe0-2ced-4269-ad50-5d4e6894ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:47.934177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b4fe0-2ced-4269-ad50-5d4e6894ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:47.934493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b4fe0-2ced-4269-ad50-5d4e6894ebe9 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:47.935125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b4fe0-2ced-4269-ad50-5d4e6894ebe9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:47.935441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b4fe0-2ced-4269-ad50-5d4e6894ebe9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:47.936817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b4fe0-2ced-4269-ad50-5d4e6894ebe9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:47.937754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1819886-b42d-4a8d-9837-2786f374be74 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:47.941961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 493/990] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Aug 24 16:57:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:47.948085 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b4fe0-2ced-4269-ad50-5d4e6894ebe9 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:47.984017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcd1ab-b255-45de-914d-2f94dfeeaf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:47.984660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd1ab-b255-45de-914d-2f94dfeeaf17 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:47.985173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd1ab-b255-45de-914d-2f94dfeeaf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:47.985442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd1ab-b255-45de-914d-2f94dfeeaf17 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:47.987043 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcd1ab-b255-45de-914d-2f94dfeeaf17 None admin] RBAC: Adding query filter params (type=image) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:47.987404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcd1ab-b255-45de-914d-2f94dfeeaf17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:47.988811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcd1ab-b255-45de-914d-2f94dfeeaf17 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:47.996382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 498/991] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:48.041779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:48.071620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b4fe0-2ced-4269-ad50-5d4e6894ebe9 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:48.110146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a9287-6b62-4c5f-8e6b-13dc35dfa085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:48.110822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9287-6b62-4c5f-8e6b-13dc35dfa085 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:48.111138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9287-6b62-4c5f-8e6b-13dc35dfa085 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:48.111418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9287-6b62-4c5f-8e6b-13dc35dfa085 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:48.114023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a9287-6b62-4c5f-8e6b-13dc35dfa085 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:48.114023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a9287-6b62-4c5f-8e6b-13dc35dfa085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:48.114023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a9287-6b62-4c5f-8e6b-13dc35dfa085 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:48.126425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 494/992] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Aug 24 16:57:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:48.128131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcd1ab-b255-45de-914d-2f94dfeeaf17 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:48.239220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcd1ab-b255-45de-914d-2f94dfeeaf17 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:48.254143 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:48.275694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6bc64-a1ea-4fae-8bb1-c0f99e2b1bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:48.276334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6bc64-a1ea-4fae-8bb1-c0f99e2b1bbd None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:48.276618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6bc64-a1ea-4fae-8bb1-c0f99e2b1bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:48.276890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6bc64-a1ea-4fae-8bb1-c0f99e2b1bbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:48.277711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6bc64-a1ea-4fae-8bb1-c0f99e2b1bbd None admin] RBAC: Adding query filter params (interface=admin, service_id=65b7386d35754837a5cda4e1827fac38, region_id=RegionOne) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:48.278023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6bc64-a1ea-4fae-8bb1-c0f99e2b1bbd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:48.279508 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6bc64-a1ea-4fae-8bb1-c0f99e2b1bbd None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:48.288601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 499/993] 10.222.0.20 () {56 vars in 1249 bytes} [Wed Aug 24 16:57:48 2022] GET /identity/v3/endpoints?service_id=65b7386d35754837a5cda4e1827fac38&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:48.295443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a9287-6b62-4c5f-8e6b-13dc35dfa085 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:48.299165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a680-8d38-4001-b6c6-ffc81f6f5a1e None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:48.299708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a680-8d38-4001-b6c6-ffc81f6f5a1e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:48.299987 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a680-8d38-4001-b6c6-ffc81f6f5a1e None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:48.301492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 500/994] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:48.307049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8bbf-90da-4924-a93d-9cb779a2b543 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:48.307331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8bbf-90da-4924-a93d-9cb779a2b543 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:48.307862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8bbf-90da-4924-a93d-9cb779a2b543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:48.326564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-41fe8bbf-90da-4924-a93d-9cb779a2b543 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:48.328048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-41fe8bbf-90da-4924-a93d-9cb779a2b543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:48.401422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 501/995] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:48.408268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a9287-6b62-4c5f-8e6b-13dc35dfa085 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:48.443891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded9280-189d-43c7-843b-0d87180c911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:48.444535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9280-189d-43c7-843b-0d87180c911c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:48.444816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9280-189d-43c7-843b-0d87180c911c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:48.445089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded9280-189d-43c7-843b-0d87180c911c None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:48.445695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded9280-189d-43c7-843b-0d87180c911c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:48.447090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded9280-189d-43c7-843b-0d87180c911c None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:48.454017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 495/996] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Aug 24 16:57:48 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:57:48.673408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe8bbf-90da-4924-a93d-9cb779a2b543 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:48.778923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe8bbf-90da-4924-a93d-9cb779a2b543 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:48.788585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:48.813994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ea0c0-4336-47e4-bf8a-3badd0cff4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:48.814635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ea0c0-4336-47e4-bf8a-3badd0cff4ee None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:48.814913 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ea0c0-4336-47e4-bf8a-3badd0cff4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:48.815185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ea0c0-4336-47e4-bf8a-3badd0cff4ee None admin] PATH_INFO: `/v3/services/compute` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:48.815771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ea0c0-4336-47e4-bf8a-3badd0cff4ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:48.817162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8ea0c0-4336-47e4-bf8a-3badd0cff4ee None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-af8ea0c0-4336-47e4-bf8a-3badd0cff4ee None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:48.826561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:48.827572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:57:48.828929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:48.832318 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 502/997] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:48.833634 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded9280-189d-43c7-843b-0d87180c911c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:48.836607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:48.943605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded9280-189d-43c7-843b-0d87180c911c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:48.983445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a0a3d-9f35-4cf4-b019-66a8b6c85de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:48.984056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a0a3d-9f35-4cf4-b019-66a8b6c85de8 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:48.984365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a0a3d-9f35-4cf4-b019-66a8b6c85de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:48.984636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a0a3d-9f35-4cf4-b019-66a8b6c85de8 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:48.985290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a0a3d-9f35-4cf4-b019-66a8b6c85de8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:48.985592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a0a3d-9f35-4cf4-b019-66a8b6c85de8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:48.986953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a0a3d-9f35-4cf4-b019-66a8b6c85de8 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:48.991837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 496/998] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:48.998478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ea0c0-4336-47e4-bf8a-3badd0cff4ee None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:49.108615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8ea0c0-4336-47e4-bf8a-3badd0cff4ee None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:49.143626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053a5b-49fd-43f5-a49f-71da8c5b8da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:49.144445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053a5b-49fd-43f5-a49f-71da8c5b8da8 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:49.144551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053a5b-49fd-43f5-a49f-71da8c5b8da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:49.144796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76053a5b-49fd-43f5-a49f-71da8c5b8da8 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:49.145421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76053a5b-49fd-43f5-a49f-71da8c5b8da8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:49.145725 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76053a5b-49fd-43f5-a49f-71da8c5b8da8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:49.147097 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76053a5b-49fd-43f5-a49f-71da8c5b8da8 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:49.156955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 503/999] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:49.157833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a0a3d-9f35-4cf4-b019-66a8b6c85de8 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:49.224832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:49.260662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a0a3d-9f35-4cf4-b019-66a8b6c85de8 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:49.301090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bd650-abb8-49b8-828b-ef307c698a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:49.301703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd650-abb8-49b8-828b-ef307c698a46 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:49.301983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd650-abb8-49b8-828b-ef307c698a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:49.302256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd650-abb8-49b8-828b-ef307c698a46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:49.302959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bd650-abb8-49b8-828b-ef307c698a46 None admin] RBAC: Adding query filter params (interface=public, service_id=da7c91bba34a43d492e3d4bf8e4c02c3, region_id=RegionOne) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:49.303272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bd650-abb8-49b8-828b-ef307c698a46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:49.304672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bd650-abb8-49b8-828b-ef307c698a46 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:49.315143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 497/1000] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Aug 24 16:57:49 2022] GET /identity/v3/endpoints?service_id=da7c91bba34a43d492e3d4bf8e4c02c3&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:49.316399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053a5b-49fd-43f5-a49f-71da8c5b8da8 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:49.354967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:49.421364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76053a5b-49fd-43f5-a49f-71da8c5b8da8 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:49.456812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6426fd-9d06-4bca-b06b-c5f18c450212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:49.457439 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6426fd-9d06-4bca-b06b-c5f18c450212 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:49.457717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6426fd-9d06-4bca-b06b-c5f18c450212 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:49.457988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6426fd-9d06-4bca-b06b-c5f18c450212 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:49.458601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6426fd-9d06-4bca-b06b-c5f18c450212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:49.459960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6426fd-9d06-4bca-b06b-c5f18c450212 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:49.472258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 504/1001] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Aug 24 16:57:49 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:57:49.957810 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c90d9-5f97-4a4e-8c7a-249f2a9aab62 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:49.958049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c90d9-5f97-4a4e-8c7a-249f2a9aab62 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:49.958283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c90d9-5f97-4a4e-8c7a-249f2a9aab62 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:49.959663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 498/1002] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:49.965642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaab786-a2ae-40a3-90a3-9bc8b87fcdfe None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:49.965934 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaab786-a2ae-40a3-90a3-9bc8b87fcdfe None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:49.966211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaab786-a2ae-40a3-90a3-9bc8b87fcdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:49.985577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-3aaab786-a2ae-40a3-90a3-9bc8b87fcdfe None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:49.986774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3aaab786-a2ae-40a3-90a3-9bc8b87fcdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:50.059188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 505/1003] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:49 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:50.324391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c90d9-5f97-4a4e-8c7a-249f2a9aab62 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:50.427106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e47437-b96b-4207-a11d-2735d9aab483 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:50.427666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e47437-b96b-4207-a11d-2735d9aab483 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:50.427666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e47437-b96b-4207-a11d-2735d9aab483 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:50.429170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 506/1004] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:50.431113 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c90d9-5f97-4a4e-8c7a-249f2a9aab62 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:50.434681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b52b69-f367-4651-86bf-4856a6b0efae None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:50.434970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b52b69-f367-4651-86bf-4856a6b0efae None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:50.435247 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b52b69-f367-4651-86bf-4856a6b0efae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:50.453448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-06b52b69-f367-4651-86bf-4856a6b0efae None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:50.454626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-06b52b69-f367-4651-86bf-4856a6b0efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:50.467488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:50.473502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef69ac0-4b9c-44c3-aea5-219a592532b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:50.474122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69ac0-4b9c-44c3-aea5-219a592532b6 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:50.474400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69ac0-4b9c-44c3-aea5-219a592532b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:50.474670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69ac0-4b9c-44c3-aea5-219a592532b6 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:50.475334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef69ac0-4b9c-44c3-aea5-219a592532b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:50.476722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef69ac0-4b9c-44c3-aea5-219a592532b6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:50.482076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:50.525950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 507/1005] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:50.606040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 499/1006] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:57:50 2022] POST /identity/v3/services => generated 242 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:50.802048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b52b69-f367-4651-86bf-4856a6b0efae None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:50.906461 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b52b69-f367-4651-86bf-4856a6b0efae None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:50.947750 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53575d63-5f7b-4fdf-948d-ae3261b09937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:50.948418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53575d63-5f7b-4fdf-948d-ae3261b09937 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:50.948700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53575d63-5f7b-4fdf-948d-ae3261b09937 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:50.948970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53575d63-5f7b-4fdf-948d-ae3261b09937 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:50.949552 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53575d63-5f7b-4fdf-948d-ae3261b09937 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:50.950997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53575d63-5f7b-4fdf-948d-ae3261b09937 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-53575d63-5f7b-4fdf-948d-ae3261b09937 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:50.959870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:50.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:50.962058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 508/1007] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Aug 24 16:57:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:50.968983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef69ac0-4b9c-44c3-aea5-219a592532b6 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:51.079117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef69ac0-4b9c-44c3-aea5-219a592532b6 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:51.115520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc75091-2109-44bb-9cdd-dbeee5c0c786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:51.116534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75091-2109-44bb-9cdd-dbeee5c0c786 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:51.117051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75091-2109-44bb-9cdd-dbeee5c0c786 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:51.117520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc75091-2109-44bb-9cdd-dbeee5c0c786 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:51.119237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc75091-2109-44bb-9cdd-dbeee5c0c786 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:51.119746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc75091-2109-44bb-9cdd-dbeee5c0c786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:51.121351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc75091-2109-44bb-9cdd-dbeee5c0c786 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:51.131327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 500/1008] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Aug 24 16:57:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:51.132721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53575d63-5f7b-4fdf-948d-ae3261b09937 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:51.155633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:51.235758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53575d63-5f7b-4fdf-948d-ae3261b09937 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:51.270511 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a1098-ad80-422e-9bb4-6bbd1d144657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:51.271123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a1098-ad80-422e-9bb4-6bbd1d144657 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:51.271399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a1098-ad80-422e-9bb4-6bbd1d144657 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:51.271671 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a1098-ad80-422e-9bb4-6bbd1d144657 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:51.272323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a1098-ad80-422e-9bb4-6bbd1d144657 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:51.272628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a1098-ad80-422e-9bb4-6bbd1d144657 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:51.274077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a1098-ad80-422e-9bb4-6bbd1d144657 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:51.280376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 509/1009] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Aug 24 16:57:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:51.285958 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc75091-2109-44bb-9cdd-dbeee5c0c786 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:51.342937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:51.392106 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc75091-2109-44bb-9cdd-dbeee5c0c786 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:51.420347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fd730-c9c5-4116-8e53-cf1d616849bc None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:51.420689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fd730-c9c5-4116-8e53-cf1d616849bc None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:51.421054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00fd730-c9c5-4116-8e53-cf1d616849bc None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:51.422527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 510/1010] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:51.427935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109093-0aa9-440b-965f-e9d291055fb5 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:51.428727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109093-0aa9-440b-965f-e9d291055fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:51.428727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43109093-0aa9-440b-965f-e9d291055fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:51.428902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197d177-836f-4e9f-b6c0-74ba1e42e6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:51.429220 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d177-836f-4e9f-b6c0-74ba1e42e6a2 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:51.429491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d177-836f-4e9f-b6c0-74ba1e42e6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:51.429767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197d177-836f-4e9f-b6c0-74ba1e42e6a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:51.430428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197d177-836f-4e9f-b6c0-74ba1e42e6a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:51.432659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197d177-836f-4e9f-b6c0-74ba1e42e6a2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:51.448484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-43109093-0aa9-440b-965f-e9d291055fb5 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:51.449851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-43109093-0aa9-440b-965f-e9d291055fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:51.524357 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 501/1011] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 16:57:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:51.535522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 511/1012] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:51 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:51.804969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197d177-836f-4e9f-b6c0-74ba1e42e6a2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:51.911306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197d177-836f-4e9f-b6c0-74ba1e42e6a2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:51.932205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:51.952739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc2b7e-24fe-494c-be74-28cf1f8de713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:51.953372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc2b7e-24fe-494c-be74-28cf1f8de713 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:51.953645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc2b7e-24fe-494c-be74-28cf1f8de713 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:51.953916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc2b7e-24fe-494c-be74-28cf1f8de713 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:51.954494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc2b7e-24fe-494c-be74-28cf1f8de713 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:51.955855 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc2b7e-24fe-494c-be74-28cf1f8de713 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-bffc2b7e-24fe-494c-be74-28cf1f8de713 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:51.965856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:51.966862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:51.967717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 502/1013] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:51.975092 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43109093-0aa9-440b-965f-e9d291055fb5 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:51.987908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:52.079140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43109093-0aa9-440b-965f-e9d291055fb5 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:52.116673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba633c6-6df6-4858-b708-105613f73287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:52.117277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba633c6-6df6-4858-b708-105613f73287 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:52.117552 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba633c6-6df6-4858-b708-105613f73287 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:52.117819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba633c6-6df6-4858-b708-105613f73287 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:52.118437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba633c6-6df6-4858-b708-105613f73287 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:52.118903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba633c6-6df6-4858-b708-105613f73287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:52.120411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba633c6-6df6-4858-b708-105613f73287 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:52.129989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 512/1014] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:52.131551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc2b7e-24fe-494c-be74-28cf1f8de713 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:52.239684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc2b7e-24fe-494c-be74-28cf1f8de713 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:52.285566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44102654-b4bc-4cce-90d2-1678ae81f4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:52.286557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44102654-b4bc-4cce-90d2-1678ae81f4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:52.287034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44102654-b4bc-4cce-90d2-1678ae81f4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:52.287516 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44102654-b4bc-4cce-90d2-1678ae81f4f1 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:52.288369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44102654-b4bc-4cce-90d2-1678ae81f4f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:52.288864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44102654-b4bc-4cce-90d2-1678ae81f4f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:52.290555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44102654-b4bc-4cce-90d2-1678ae81f4f1 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:52.300600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 503/1015] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Aug 24 16:57:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:52.302122 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba633c6-6df6-4858-b708-105613f73287 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:52.383156 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:52.408253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba633c6-6df6-4858-b708-105613f73287 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:52.446672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27256e19-a3ca-42cb-baa5-7b6bbe01df41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:52.447371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27256e19-a3ca-42cb-baa5-7b6bbe01df41 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:52.447606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27256e19-a3ca-42cb-baa5-7b6bbe01df41 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:52.447807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27256e19-a3ca-42cb-baa5-7b6bbe01df41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:52.448507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27256e19-a3ca-42cb-baa5-7b6bbe01df41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:52.449879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27256e19-a3ca-42cb-baa5-7b6bbe01df41 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:52.530695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 513/1016] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 16:57:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:52.555171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2d9a-c0f4-4d87-835b-d7d6a33d041e None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:52.556293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2d9a-c0f4-4d87-835b-d7d6a33d041e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:52.556465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2d9a-c0f4-4d87-835b-d7d6a33d041e None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:52.558610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 504/1017] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:52.564346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d8ad9-1450-436a-834f-6f6a79551e39 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:52.564683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d8ad9-1450-436a-834f-6f6a79551e39 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:52.564907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d8ad9-1450-436a-834f-6f6a79551e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:52.584478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-801d8ad9-1450-436a-834f-6f6a79551e39 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:52.585736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-801d8ad9-1450-436a-834f-6f6a79551e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:52.673359 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 514/1018] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:52.945155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2d9a-c0f4-4d87-835b-d7d6a33d041e None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:52.991970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:53.057282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2d9a-c0f4-4d87-835b-d7d6a33d041e None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:53.094090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626db0a0-ed88-4147-b431-0bd13ccd2f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:53.094715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626db0a0-ed88-4147-b431-0bd13ccd2f0d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:53.094991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626db0a0-ed88-4147-b431-0bd13ccd2f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:53.095253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626db0a0-ed88-4147-b431-0bd13ccd2f0d None admin] PATH_INFO: `/v3/services/image` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:53.095826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626db0a0-ed88-4147-b431-0bd13ccd2f0d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:53.097206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626db0a0-ed88-4147-b431-0bd13ccd2f0d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-626db0a0-ed88-4147-b431-0bd13ccd2f0d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:53.106646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:53.107659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:53.108557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 505/1019] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Aug 24 16:57:52 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:53.113930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d8ad9-1450-436a-834f-6f6a79551e39 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:53.171323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:53.217670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d8ad9-1450-436a-834f-6f6a79551e39 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:53.262745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041af046-cebf-432d-aee2-dcffba6423bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:53.263366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041af046-cebf-432d-aee2-dcffba6423bf None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:53.263647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041af046-cebf-432d-aee2-dcffba6423bf None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:53.263919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041af046-cebf-432d-aee2-dcffba6423bf None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:53.264589 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041af046-cebf-432d-aee2-dcffba6423bf None admin] RBAC: Adding query filter params (name=image) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:53.264893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041af046-cebf-432d-aee2-dcffba6423bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:53.266289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041af046-cebf-432d-aee2-dcffba6423bf None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:53.271507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 515/1020] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:53.278258 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626db0a0-ed88-4147-b431-0bd13ccd2f0d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:53.383197 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626db0a0-ed88-4147-b431-0bd13ccd2f0d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:53.391264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:53.420131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955e933-32b7-4e14-99f8-f76a5b46660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:53.420825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e933-32b7-4e14-99f8-f76a5b46660b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:53.421113 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e933-32b7-4e14-99f8-f76a5b46660b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:53.421386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e933-32b7-4e14-99f8-f76a5b46660b None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:53.422049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955e933-32b7-4e14-99f8-f76a5b46660b None admin] RBAC: Adding query filter params (type=image) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:53.422356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955e933-32b7-4e14-99f8-f76a5b46660b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:53.423807 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955e933-32b7-4e14-99f8-f76a5b46660b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:53.428989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 506/1021] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:53.435354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041af046-cebf-432d-aee2-dcffba6423bf None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:53.452746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f1d86-3a84-46d4-95c9-058f59b3de25 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:53.453053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f1d86-3a84-46d4-95c9-058f59b3de25 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:53.453294 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f1d86-3a84-46d4-95c9-058f59b3de25 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:53.454759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 507/1022] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:53.459458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505441-2311-49bc-af4a-7ea440137140 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:53.459741 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505441-2311-49bc-af4a-7ea440137140 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:53.460110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25505441-2311-49bc-af4a-7ea440137140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:53.479350 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-25505441-2311-49bc-af4a-7ea440137140 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:53.480568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-25505441-2311-49bc-af4a-7ea440137140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:53.542439 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041af046-cebf-432d-aee2-dcffba6423bf None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:53.550658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 508/1023] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:53.564347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:53.579352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428f58-edff-4950-ab91-efff51914403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:53.585784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428f58-edff-4950-ab91-efff51914403 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:53.585784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428f58-edff-4950-ab91-efff51914403 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:53.585784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8428f58-edff-4950-ab91-efff51914403 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:53.585784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8428f58-edff-4950-ab91-efff51914403 None admin] RBAC: Adding query filter params (interface=public, service_id=fa154fa28e7f4d7fbcacdc6382732ba4, region_id=RegionOne) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:53.585784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8428f58-edff-4950-ab91-efff51914403 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:53.585784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8428f58-edff-4950-ab91-efff51914403 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:53.588831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 516/1024] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Aug 24 16:57:53 2022] GET /identity/v3/endpoints?service_id=fa154fa28e7f4d7fbcacdc6382732ba4&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:53.594455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25505441-2311-49bc-af4a-7ea440137140 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:53.701088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:53.704603 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25505441-2311-49bc-af4a-7ea440137140 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:53.740769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8053060-9942-41c0-bd2d-6e300f021069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:53.741300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8053060-9942-41c0-bd2d-6e300f021069 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:53.741584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8053060-9942-41c0-bd2d-6e300f021069 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:53.741858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8053060-9942-41c0-bd2d-6e300f021069 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:53.742467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8053060-9942-41c0-bd2d-6e300f021069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:53.744429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8053060-9942-41c0-bd2d-6e300f021069 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:53.756475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 509/1025] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Aug 24 16:57:53 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:57:53.818238 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428f58-edff-4950-ab91-efff51914403 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:53.935485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8428f58-edff-4950-ab91-efff51914403 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:53.970195 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a3c81-4017-46d4-9f63-b82a1b704c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:53.970832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3c81-4017-46d4-9f63-b82a1b704c09 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:53.971113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3c81-4017-46d4-9f63-b82a1b704c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:53.971386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a3c81-4017-46d4-9f63-b82a1b704c09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:53.972524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a3c81-4017-46d4-9f63-b82a1b704c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:53.973968 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a3c81-4017-46d4-9f63-b82a1b704c09 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:53.975687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 517/1026] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:53.982138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8053060-9942-41c0-bd2d-6e300f021069 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:54.089756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8053060-9942-41c0-bd2d-6e300f021069 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:54.126028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41897f-d16d-4e95-bcc7-86774f2930bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:54.126638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41897f-d16d-4e95-bcc7-86774f2930bc None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:54.126917 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41897f-d16d-4e95-bcc7-86774f2930bc None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:54.127190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41897f-d16d-4e95-bcc7-86774f2930bc None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:54.127846 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41897f-d16d-4e95-bcc7-86774f2930bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:54.129297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41897f-d16d-4e95-bcc7-86774f2930bc None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:54.248270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 510/1027] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:57:53 2022] POST /identity/v3/projects => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:57:54.559874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468eb96-f574-4721-a97c-acbaab3104cf None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:54.560459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468eb96-f574-4721-a97c-acbaab3104cf None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:54.560459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468eb96-f574-4721-a97c-acbaab3104cf None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:54.561810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 518/1028] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:54.567076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20c33c-27ba-4c6b-82fc-729820c00021 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:54.567362 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20c33c-27ba-4c6b-82fc-729820c00021 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:54.567632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20c33c-27ba-4c6b-82fc-729820c00021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:54.587687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-bb20c33c-27ba-4c6b-82fc-729820c00021 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:54.589091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-bb20c33c-27ba-4c6b-82fc-729820c00021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:54.600789 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:54.657965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 511/1029] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:54.924949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468eb96-f574-4721-a97c-acbaab3104cf None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:54.981468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:55.029538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468eb96-f574-4721-a97c-acbaab3104cf None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:55.063372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44537b26-4c72-4c53-9eed-c4de4a64048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:55.064008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537b26-4c72-4c53-9eed-c4de4a64048d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:55.064305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537b26-4c72-4c53-9eed-c4de4a64048d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:55.064576 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44537b26-4c72-4c53-9eed-c4de4a64048d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:55.075148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44537b26-4c72-4c53-9eed-c4de4a64048d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-44537b26-4c72-4c53-9eed-c4de4a64048d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:55.079836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:55.080803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:55.081660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 519/1030] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Aug 24 16:57:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:55.089199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20c33c-27ba-4c6b-82fc-729820c00021 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:55.190790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20c33c-27ba-4c6b-82fc-729820c00021 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:55.228888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3d414-b6c2-48fa-8a6b-4d7a9b20a8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:55.229498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3d414-b6c2-48fa-8a6b-4d7a9b20a8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:55.229773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3d414-b6c2-48fa-8a6b-4d7a9b20a8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:55.230039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3d414-b6c2-48fa-8a6b-4d7a9b20a8b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:55.230707 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3d414-b6c2-48fa-8a6b-4d7a9b20a8b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:55.231005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3d414-b6c2-48fa-8a6b-4d7a9b20a8b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:55.232398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3d414-b6c2-48fa-8a6b-4d7a9b20a8b3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:55.241142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 512/1031] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Aug 24 16:57:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:55.246863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44537b26-4c72-4c53-9eed-c4de4a64048d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:55.365391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44537b26-4c72-4c53-9eed-c4de4a64048d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:55.382170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:55.407809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29afdbe-6535-4b98-8b0e-7161e4f9b045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:55.408457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29afdbe-6535-4b98-8b0e-7161e4f9b045 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:55.418269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29afdbe-6535-4b98-8b0e-7161e4f9b045 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:55.418269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29afdbe-6535-4b98-8b0e-7161e4f9b045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:55.420529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29afdbe-6535-4b98-8b0e-7161e4f9b045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:55.421963 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29afdbe-6535-4b98-8b0e-7161e4f9b045 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-a29afdbe-6535-4b98-8b0e-7161e4f9b045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:55.436351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:55.437300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:55.438368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:55.438368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:55.438368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:55.440295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 520/1032] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:55.443619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3d414-b6c2-48fa-8a6b-4d7a9b20a8b3 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:55.455972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:55.550920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3d414-b6c2-48fa-8a6b-4d7a9b20a8b3 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:55.591408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c082a-b0ca-4188-be3a-7244e74eb617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:55.592591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c082a-b0ca-4188-be3a-7244e74eb617 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:55.593115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c082a-b0ca-4188-be3a-7244e74eb617 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:55.593624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c082a-b0ca-4188-be3a-7244e74eb617 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:55.594813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c082a-b0ca-4188-be3a-7244e74eb617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:55.595419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c082a-b0ca-4188-be3a-7244e74eb617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:55.597992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c082a-b0ca-4188-be3a-7244e74eb617 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:55.614969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 513/1033] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:55.620620 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29afdbe-6535-4b98-8b0e-7161e4f9b045 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:55.697012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba946108-2491-45d5-8aa0-c75636b43067 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:55.697200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba946108-2491-45d5-8aa0-c75636b43067 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:55.697473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba946108-2491-45d5-8aa0-c75636b43067 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:55.698970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 514/1034] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:55.703770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db132bf-8fe7-4f33-8137-ff22861b5438 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:55.704051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db132bf-8fe7-4f33-8137-ff22861b5438 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:55.704351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db132bf-8fe7-4f33-8137-ff22861b5438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:55.723726 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5db132bf-8fe7-4f33-8137-ff22861b5438 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:55.724942 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5db132bf-8fe7-4f33-8137-ff22861b5438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:55.726852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29afdbe-6535-4b98-8b0e-7161e4f9b045 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:55.765084 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585664f-7727-4ff0-addc-5492471b9ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:55.765992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585664f-7727-4ff0-addc-5492471b9ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:55.766412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585664f-7727-4ff0-addc-5492471b9ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:55.766824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585664f-7727-4ff0-addc-5492471b9ab2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:55.778216 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585664f-7727-4ff0-addc-5492471b9ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:55.780281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585664f-7727-4ff0-addc-5492471b9ab2 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:55.791002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-2585664f-7727-4ff0-addc-5492471b9ab2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:57:55.792975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:55.793907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:55.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:55.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:55.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:57:55.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:57:55.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:57:55.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:57:55.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:57:55.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:57:55.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:57:55.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:55.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 521/1035] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Aug 24 16:57:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:55.800341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 515/1036] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:55.804143 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585664f-7727-4ff0-addc-5492471b9ab2 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:55.831122 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:55.910381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585664f-7727-4ff0-addc-5492471b9ab2 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:55.945765 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f058e21-c855-4b83-a981-43e407846b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:55.946927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f058e21-c855-4b83-a981-43e407846b68 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:55.947257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f058e21-c855-4b83-a981-43e407846b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:55.947480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f058e21-c855-4b83-a981-43e407846b68 None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:55.948213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f058e21-c855-4b83-a981-43e407846b68 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:55.948545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f058e21-c855-4b83-a981-43e407846b68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:55.949979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f058e21-c855-4b83-a981-43e407846b68 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:55.967884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 522/1037] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Aug 24 16:57:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:55.973492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db132bf-8fe7-4f33-8137-ff22861b5438 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:56.074691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db132bf-8fe7-4f33-8137-ff22861b5438 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:56.088942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f058e21-c855-4b83-a981-43e407846b68 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:56.112787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd82f00-8f39-4d7a-a42f-4ad2993133f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:56.113395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd82f00-8f39-4d7a-a42f-4ad2993133f3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:56.113671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd82f00-8f39-4d7a-a42f-4ad2993133f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:56.113939 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd82f00-8f39-4d7a-a42f-4ad2993133f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:56.180028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:56.184006 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:56.187951 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd82f00-8f39-4d7a-a42f-4ad2993133f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:56.189440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd82f00-8f39-4d7a-a42f-4ad2993133f3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:56.206536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f058e21-c855-4b83-a981-43e407846b68 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:56.237478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f2da0-b7e9-42df-beaa-c6a324fd138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:56.238111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f2da0-b7e9-42df-beaa-c6a324fd138d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:56.238384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f2da0-b7e9-42df-beaa-c6a324fd138d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:56.238655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f2da0-b7e9-42df-beaa-c6a324fd138d None admin] PATH_INFO: `/v3/services/image` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:56.239232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f2da0-b7e9-42df-beaa-c6a324fd138d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:56.240620 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f2da0-b7e9-42df-beaa-c6a324fd138d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-c00f2da0-b7e9-42df-beaa-c6a324fd138d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:56.249516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:56.250713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:56.251920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 523/1038] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Aug 24 16:57:56 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:56.252810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a193c-ab94-4fb9-a04d-e929d39b5045 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:56.252810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a193c-ab94-4fb9-a04d-e929d39b5045 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:56.252810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a193c-ab94-4fb9-a04d-e929d39b5045 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:56.253986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 524/1039] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:56.256340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a193c-ab94-4fb9-a04d-e929d39b5045 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:56.297429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 516/1040] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:55 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:57:56.301326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a165d5a-76c6-4227-a62b-11ef025d9966 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:56.301607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a165d5a-76c6-4227-a62b-11ef025d9966 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:56.301876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a165d5a-76c6-4227-a62b-11ef025d9966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:56.318976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4a165d5a-76c6-4227-a62b-11ef025d9966 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:56.320145 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4a165d5a-76c6-4227-a62b-11ef025d9966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:56.361171 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a193c-ab94-4fb9-a04d-e929d39b5045 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:56.389356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 517/1041] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:56.389984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a165d5a-76c6-4227-a62b-11ef025d9966 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:56.406784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae2b97-6527-4c80-bc43-771252b967d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:56.407509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae2b97-6527-4c80-bc43-771252b967d0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:56.407792 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae2b97-6527-4c80-bc43-771252b967d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:56.408180 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae2b97-6527-4c80-bc43-771252b967d0 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:56.409043 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae2b97-6527-4c80-bc43-771252b967d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:56.409350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae2b97-6527-4c80-bc43-771252b967d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:56.410717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae2b97-6527-4c80-bc43-771252b967d0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:56.420271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 525/1042] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:56.422146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae2b97-6527-4c80-bc43-771252b967d0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:56.422287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:56.438147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:56.497781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a165d5a-76c6-4227-a62b-11ef025d9966 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:56.532947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae2b97-6527-4c80-bc43-771252b967d0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:56.533145 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052da711-f441-489d-8e82-6c53a37f4a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:56.533599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052da711-f441-489d-8e82-6c53a37f4a09 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:56.533876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052da711-f441-489d-8e82-6c53a37f4a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:56.534148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052da711-f441-489d-8e82-6c53a37f4a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:56.544941 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052da711-f441-489d-8e82-6c53a37f4a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:56.546372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052da711-f441-489d-8e82-6c53a37f4a09 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-052da711-f441-489d-8e82-6c53a37f4a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:56.562467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:56.563444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:56.564360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:56.564360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:56.564360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:56.568389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 518/1043] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:56.569224 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052da711-f441-489d-8e82-6c53a37f4a09 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:56.573436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f66fa-33e3-40b6-88ca-8dd7568ecf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:56.574047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f66fa-33e3-40b6-88ca-8dd7568ecf63 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:56.574322 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f66fa-33e3-40b6-88ca-8dd7568ecf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:56.575058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f66fa-33e3-40b6-88ca-8dd7568ecf63 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:56.575218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f66fa-33e3-40b6-88ca-8dd7568ecf63 None admin] RBAC: Adding query filter params (type=image) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:56.575519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f66fa-33e3-40b6-88ca-8dd7568ecf63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:56.577989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f66fa-33e3-40b6-88ca-8dd7568ecf63 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:56.586861 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 526/1044] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:56.588430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f66fa-33e3-40b6-88ca-8dd7568ecf63 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:56.660572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:56.673652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:56.679940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052da711-f441-489d-8e82-6c53a37f4a09 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:56.699549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f66fa-33e3-40b6-88ca-8dd7568ecf63 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:56.717841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c0193-518b-4ef4-b274-832853cab197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:56.718448 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c0193-518b-4ef4-b274-832853cab197 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:56.718726 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c0193-518b-4ef4-b274-832853cab197 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:56.718998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c0193-518b-4ef4-b274-832853cab197 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:56.719637 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c0193-518b-4ef4-b274-832853cab197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:56.719940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c0193-518b-4ef4-b274-832853cab197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:56.721355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c0193-518b-4ef4-b274-832853cab197 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:56.733020 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 519/1045] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:56.734735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b1ab8-89b7-414e-aca6-93cc17c36ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:56.735546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1ab8-89b7-414e-aca6-93cc17c36ac5 None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:56.735997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1ab8-89b7-414e-aca6-93cc17c36ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:56.736769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1ab8-89b7-414e-aca6-93cc17c36ac5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:56.737080 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c0193-518b-4ef4-b274-832853cab197 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:56.737901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b1ab8-89b7-414e-aca6-93cc17c36ac5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:56.739279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b1ab8-89b7-414e-aca6-93cc17c36ac5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:56.823070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 527/1046] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 16:57:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:56.823827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b1ab8-89b7-414e-aca6-93cc17c36ac5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:56.840055 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c0193-518b-4ef4-b274-832853cab197 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:56.889572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129796-6142-4d6d-8b03-47b9bf8f9d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:56.890226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129796-6142-4d6d-8b03-47b9bf8f9d81 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:56.890503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129796-6142-4d6d-8b03-47b9bf8f9d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:56.890774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63129796-6142-4d6d-8b03-47b9bf8f9d81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:56.892112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63129796-6142-4d6d-8b03-47b9bf8f9d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:56.893624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63129796-6142-4d6d-8b03-47b9bf8f9d81 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:56.895421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 520/1047] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:56.904286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129796-6142-4d6d-8b03-47b9bf8f9d81 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:56.909691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:56.952694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b1ab8-89b7-414e-aca6-93cc17c36ac5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:56.985010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:56.991044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682f653-add2-4ecd-850d-8f8fb039f8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:56.991689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682f653-add2-4ecd-850d-8f8fb039f8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:56.991966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682f653-add2-4ecd-850d-8f8fb039f8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:56.992292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682f653-add2-4ecd-850d-8f8fb039f8a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:57.000088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682f653-add2-4ecd-850d-8f8fb039f8a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:57.001603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682f653-add2-4ecd-850d-8f8fb039f8a3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-9682f653-add2-4ecd-850d-8f8fb039f8a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:57:57.013722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:57.014658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:57.015873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:57:57.015873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:57:57.015873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:57:57.015873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:57:57.015873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:57:57.015873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:57:57.015873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:57:57.015873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:57.015873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 528/1048] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:57:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:57.020956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682f653-add2-4ecd-850d-8f8fb039f8a3 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:57.022478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63129796-6142-4d6d-8b03-47b9bf8f9d81 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:57.060682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79230745-c456-42b4-bdf6-44c71ec72394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:57.061299 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79230745-c456-42b4-bdf6-44c71ec72394 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:57.061581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79230745-c456-42b4-bdf6-44c71ec72394 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:57.061854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79230745-c456-42b4-bdf6-44c71ec72394 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:57.062503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79230745-c456-42b4-bdf6-44c71ec72394 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:57.063930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79230745-c456-42b4-bdf6-44c71ec72394 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:57.124165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682f653-add2-4ecd-850d-8f8fb039f8a3 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:57.146428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 521/1049] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:57:56 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:57:57.172943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72424645-6e0e-45ab-9278-b206617074e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:57.173585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72424645-6e0e-45ab-9278-b206617074e8 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:57.173864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72424645-6e0e-45ab-9278-b206617074e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:57.174133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72424645-6e0e-45ab-9278-b206617074e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:57.174851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72424645-6e0e-45ab-9278-b206617074e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:57.175155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72424645-6e0e-45ab-9278-b206617074e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:57.176675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72424645-6e0e-45ab-9278-b206617074e8 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:57.197066 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 529/1050] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:57:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:57:57.198715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79230745-c456-42b4-bdf6-44c71ec72394 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:57.267071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:57.316387 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79230745-c456-42b4-bdf6-44c71ec72394 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:57.355250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b5828-1a7b-423c-b4b7-855572e544f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:57.355920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b5828-1a7b-423c-b4b7-855572e544f0 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:57.356203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b5828-1a7b-423c-b4b7-855572e544f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:57.356507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b5828-1a7b-423c-b4b7-855572e544f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:57.357309 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b5828-1a7b-423c-b4b7-855572e544f0 None admin] RBAC: Adding query filter params (role.id=4ff6270f4a6f4b95b4966128abe3ef9c, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=8af51476b48e45efbc3b626f9780e0be) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:57.357622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b5828-1a7b-423c-b4b7-855572e544f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:57.359076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b5828-1a7b-423c-b4b7-855572e544f0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:57.365743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 522/1051] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:57:57 2022] GET /identity/v3/role_assignments?user.id=8af51476b48e45efbc3b626f9780e0be&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=4ff6270f4a6f4b95b4966128abe3ef9c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:58.795403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9c33-515a-4027-9937-93b78af21ba9 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:58.795932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9c33-515a-4027-9937-93b78af21ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:58.795932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9c33-515a-4027-9937-93b78af21ba9 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:58.797500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 530/1052] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:58.802625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195b15e-ef8f-4356-9616-a56d7d311991 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:58.803027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195b15e-ef8f-4356-9616-a56d7d311991 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:58.803191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195b15e-ef8f-4356-9616-a56d7d311991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:58.823005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4195b15e-ef8f-4356-9616-a56d7d311991 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:58.824291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4195b15e-ef8f-4356-9616-a56d7d311991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:58.899451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 523/1053] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:59.165844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde00ddf-2117-4b7f-ab21-988872ad8243 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:59.166018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde00ddf-2117-4b7f-ab21-988872ad8243 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:59.166303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde00ddf-2117-4b7f-ab21-988872ad8243 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:59.167843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 531/1054] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:57:59.169540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195b15e-ef8f-4356-9616-a56d7d311991 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:59.172711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87159bc-bd5c-44cb-91d9-44ef99222c37 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:59.173002 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87159bc-bd5c-44cb-91d9-44ef99222c37 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:59.173277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87159bc-bd5c-44cb-91d9-44ef99222c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:59.192361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-a87159bc-bd5c-44cb-91d9-44ef99222c37 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:59.193577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a87159bc-bd5c-44cb-91d9-44ef99222c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:59.232157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:59.246166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:59.267903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 532/1055] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:57:59.278959 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59a38-a4d2-4fc2-847f-e62a66b429b5 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:59.279251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59a38-a4d2-4fc2-847f-e62a66b429b5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:59.279527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59a38-a4d2-4fc2-847f-e62a66b429b5 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:59.284320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 533/1056] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:57:59.285013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195b15e-ef8f-4356-9616-a56d7d311991 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:59.286750 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00dab2-8b81-428f-9018-109922007f59 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:59.287037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00dab2-8b81-428f-9018-109922007f59 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:59.288152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00dab2-8b81-428f-9018-109922007f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:59.309628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-bf00dab2-8b81-428f-9018-109922007f59 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:57:59.310899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bf00dab2-8b81-428f-9018-109922007f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:57:59.326218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cf71a-9c71-456a-9e7e-9fbb33a561ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:59.327226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cf71a-9c71-456a-9e7e-9fbb33a561ce None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:59.327707 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cf71a-9c71-456a-9e7e-9fbb33a561ce None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:59.328159 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cf71a-9c71-456a-9e7e-9fbb33a561ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:59.387784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 534/1057] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:57:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:57:59.405263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cf71a-9c71-456a-9e7e-9fbb33a561ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:59.406794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cf71a-9c71-456a-9e7e-9fbb33a561ce None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:59.464703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:59.516279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 524/1058] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:57:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:57:59.519461 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00dab2-8b81-428f-9018-109922007f59 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:59.544512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cf71a-9c71-456a-9e7e-9fbb33a561ce None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:59.629672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00dab2-8b81-428f-9018-109922007f59 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:59.642123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:59.652392 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cf71a-9c71-456a-9e7e-9fbb33a561ce None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:59.667146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd493522-a905-453f-b7ce-d83e9d8340e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:59.667819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd493522-a905-453f-b7ce-d83e9d8340e0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:59.668102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd493522-a905-453f-b7ce-d83e9d8340e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:59.668439 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd493522-a905-453f-b7ce-d83e9d8340e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:59.679677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd493522-a905-453f-b7ce-d83e9d8340e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:59.681698 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd493522-a905-453f-b7ce-d83e9d8340e0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:59.687216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42a36c-ba30-4969-806e-63f9e6c31514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:59.687841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42a36c-ba30-4969-806e-63f9e6c31514 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:59.688115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42a36c-ba30-4969-806e-63f9e6c31514 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:59.688422 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42a36c-ba30-4969-806e-63f9e6c31514 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-bd493522-a905-453f-b7ce-d83e9d8340e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:57:59.697602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:59.698577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:57:59.699474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:57:59.699474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:57:59.699474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:59.699474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 535/1059] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:59.699709 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42a36c-ba30-4969-806e-63f9e6c31514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:59.699782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd493522-a905-453f-b7ce-d83e9d8340e0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-1c42a36c-ba30-4969-806e-63f9e6c31514 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:59.704397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:59.705316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:57:59.706164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 525/1060] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:57:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:57:59.706865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42a36c-ba30-4969-806e-63f9e6c31514 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:59.724016 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:59.799769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd493522-a905-453f-b7ce-d83e9d8340e0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:59.808710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42a36c-ba30-4969-806e-63f9e6c31514 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:59.839227 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0f12-1a5e-4d0c-ae16-e2d9bb45d474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:59.839984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0f12-1a5e-4d0c-ae16-e2d9bb45d474 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:59.840307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0f12-1a5e-4d0c-ae16-e2d9bb45d474 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:59.840583 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee0f12-1a5e-4d0c-ae16-e2d9bb45d474 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:59.844131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e88617-29ca-46a2-87a1-5a34e919dd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:57:59.844985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e88617-29ca-46a2-87a1-5a34e919dd54 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:57:59.844985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e88617-29ca-46a2-87a1-5a34e919dd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:57:59.845595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e88617-29ca-46a2-87a1-5a34e919dd54 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:57:59.845846 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e88617-29ca-46a2-87a1-5a34e919dd54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:57:59.846147 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e88617-29ca-46a2-87a1-5a34e919dd54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:57:59.847759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e88617-29ca-46a2-87a1-5a34e919dd54 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:57:59.853117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdee0f12-1a5e-4d0c-ae16-e2d9bb45d474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-bdee0f12-1a5e-4d0c-ae16-e2d9bb45d474 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:57:59.857967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:57:59.865446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:57:59.866277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 536/1061] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Aug 24 16:57:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:57:59.867094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 526/1062] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:57:59.867170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0f12-1a5e-4d0c-ae16-e2d9bb45d474 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:59.867239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e88617-29ca-46a2-87a1-5a34e919dd54 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:57:59.895711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:59.960786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:57:59.983261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee0f12-1a5e-4d0c-ae16-e2d9bb45d474 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:57:59.989063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e88617-29ca-46a2-87a1-5a34e919dd54 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:00.025577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99695495-158d-4447-90cd-e6ea53a2f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:00.026267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99695495-158d-4447-90cd-e6ea53a2f615 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:00.026552 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99695495-158d-4447-90cd-e6ea53a2f615 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:00.026826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99695495-158d-4447-90cd-e6ea53a2f615 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:00.027506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99695495-158d-4447-90cd-e6ea53a2f615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:00.027806 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99695495-158d-4447-90cd-e6ea53a2f615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:00.029224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99695495-158d-4447-90cd-e6ea53a2f615 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:00.031522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a955d7c-4bfc-4179-945d-d798e816065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:00.032136 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955d7c-4bfc-4179-945d-d798e816065e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:00.032483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955d7c-4bfc-4179-945d-d798e816065e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:00.033421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955d7c-4bfc-4179-945d-d798e816065e None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:00.033421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a955d7c-4bfc-4179-945d-d798e816065e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:00.033742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a955d7c-4bfc-4179-945d-d798e816065e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:00.035752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a955d7c-4bfc-4179-945d-d798e816065e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:00.039843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 537/1063] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:57:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:00.044799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 527/1064] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Aug 24 16:57:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:58:00.046194 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99695495-158d-4447-90cd-e6ea53a2f615 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:00.050974 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a955d7c-4bfc-4179-945d-d798e816065e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:00.148589 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:00.167110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99695495-158d-4447-90cd-e6ea53a2f615 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:00.173918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a955d7c-4bfc-4179-945d-d798e816065e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:00.203348 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d86b23-6fae-435d-96c9-acca58ee64a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:00.204248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86b23-6fae-435d-96c9-acca58ee64a3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:00.204686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86b23-6fae-435d-96c9-acca58ee64a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:00.204961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86b23-6fae-435d-96c9-acca58ee64a3 None admin] PATH_INFO: `/v3/users/2146a7fbcead4c12bc1ea1d50f867025` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:00.209091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe8d20-dd44-4ddc-bac2-5b18f82878e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:00.209718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe8d20-dd44-4ddc-bac2-5b18f82878e1 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:00.209997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe8d20-dd44-4ddc-bac2-5b18f82878e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:00.210266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe8d20-dd44-4ddc-bac2-5b18f82878e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:00.213571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:00.218980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d86b23-6fae-435d-96c9-acca58ee64a3 None admin] RBAC: Authorizing `identity:get_user(user_id=2146a7fbcead4c12bc1ea1d50f867025)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:00.220452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d86b23-6fae-435d-96c9-acca58ee64a3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:00.221886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe8d20-dd44-4ddc-bac2-5b18f82878e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:00.222390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 538/1065] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:00 2022] GET /identity/v3/users/2146a7fbcead4c12bc1ea1d50f867025 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:58:00.223318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe8d20-dd44-4ddc-bac2-5b18f82878e1 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:00.228627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d86b23-6fae-435d-96c9-acca58ee64a3 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-bbbe8d20-dd44-4ddc-bac2-5b18f82878e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:58:00.238612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:00.239738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:58:00.240671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:58:00.240671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:58:00.240671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:00.240671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 528/1066] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:00.245801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe8d20-dd44-4ddc-bac2-5b18f82878e1 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:00.330869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d86b23-6fae-435d-96c9-acca58ee64a3 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:00.348416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe8d20-dd44-4ddc-bac2-5b18f82878e1 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:00.365100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286bdc2-2b32-4510-acb4-7c80547e16dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:00.365710 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286bdc2-2b32-4510-acb4-7c80547e16dd None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:00.365992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286bdc2-2b32-4510-acb4-7c80547e16dd None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:00.366270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286bdc2-2b32-4510-acb4-7c80547e16dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:00.378246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:00.383164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b5a81-6bee-4741-a53f-0f15067feb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:00.383815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b5a81-6bee-4741-a53f-0f15067feb51 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:00.384168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b5a81-6bee-4741-a53f-0f15067feb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:00.384471 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b5a81-6bee-4741-a53f-0f15067feb51 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:00.385114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b5a81-6bee-4741-a53f-0f15067feb51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:00.385416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b5a81-6bee-4741-a53f-0f15067feb51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:00.386781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b5a81-6bee-4741-a53f-0f15067feb51 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:00.399913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 529/1067] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:58:00.405452 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b5a81-6bee-4741-a53f-0f15067feb51 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:00.437339 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286bdc2-2b32-4510-acb4-7c80547e16dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:00.438793 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286bdc2-2b32-4510-acb4-7c80547e16dd None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:00.454140 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:00.506578 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b5a81-6bee-4741-a53f-0f15067feb51 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:00.536561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 539/1068] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:58:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:58:00.541178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b710dc-0d3f-412a-87fd-9d1ab1907af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:00.541803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b710dc-0d3f-412a-87fd-9d1ab1907af9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:00.542083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b710dc-0d3f-412a-87fd-9d1ab1907af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:00.542356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b710dc-0d3f-412a-87fd-9d1ab1907af9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:00.543148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286bdc2-2b32-4510-acb4-7c80547e16dd None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:00.550227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b710dc-0d3f-412a-87fd-9d1ab1907af9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:00.551653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b710dc-0d3f-412a-87fd-9d1ab1907af9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-76b710dc-0d3f-412a-87fd-9d1ab1907af9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:58:00.563154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:00.564199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:00.565314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:00.565314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:00.565314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:58:00.565314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:58:00.565314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:58:00.565314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:58:00.565314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:58:00.565314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:58:00.565314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:58:00.565314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:00.565314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 530/1069] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Aug 24 16:58:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:00.570005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b710dc-0d3f-412a-87fd-9d1ab1907af9 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:00.590599 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:00.647797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286bdc2-2b32-4510-acb4-7c80547e16dd None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:00.672450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b710dc-0d3f-412a-87fd-9d1ab1907af9 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:00.682371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:00.683856 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32d56a-be11-4c57-9d77-44f7ef069035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:00.684516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d56a-be11-4c57-9d77-44f7ef069035 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:00.684794 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d56a-be11-4c57-9d77-44f7ef069035 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:00.685068 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32d56a-be11-4c57-9d77-44f7ef069035 None admin] PATH_INFO: `/v3/projects/c67c6a799d184c179963f91313a58ab3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:00.686182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32d56a-be11-4c57-9d77-44f7ef069035 None admin] RBAC: Authorizing `identity:get_project(project_id=c67c6a799d184c179963f91313a58ab3)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:00.687718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32d56a-be11-4c57-9d77-44f7ef069035 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:00.689425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 540/1070] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:00 2022] GET /identity/v3/projects/c67c6a799d184c179963f91313a58ab3 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:00.695404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32d56a-be11-4c57-9d77-44f7ef069035 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:00.708641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7b9ea-ce7b-4661-ac39-f64b07146c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:00.709259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7b9ea-ce7b-4661-ac39-f64b07146c8b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:00.709540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7b9ea-ce7b-4661-ac39-f64b07146c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:00.709811 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7b9ea-ce7b-4661-ac39-f64b07146c8b None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:00.710541 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7b9ea-ce7b-4661-ac39-f64b07146c8b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:00.710849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7b9ea-ce7b-4661-ac39-f64b07146c8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:00.713055 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b7b9ea-ce7b-4661-ac39-f64b07146c8b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:00.731444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 531/1071] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Aug 24 16:58:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:58:00.736992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7b9ea-ce7b-4661-ac39-f64b07146c8b None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:00.796145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32d56a-be11-4c57-9d77-44f7ef069035 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:00.809258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:00.833571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ec06-f75a-41ef-8bd7-4630ca159212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:00.834188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ec06-f75a-41ef-8bd7-4630ca159212 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:00.834464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ec06-f75a-41ef-8bd7-4630ca159212 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:00.834734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ec06-f75a-41ef-8bd7-4630ca159212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:00.835457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ec06-f75a-41ef-8bd7-4630ca159212 None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=c67c6a799d184c179963f91313a58ab3, user.id=2146a7fbcead4c12bc1ea1d50f867025) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:00.835769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ec06-f75a-41ef-8bd7-4630ca159212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:00.838132 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54ec06-f75a-41ef-8bd7-4630ca159212 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:00.840025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7b9ea-ce7b-4661-ac39-f64b07146c8b None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:00.844127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 541/1072] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:58:00 2022] GET /identity/v3/role_assignments?user.id=2146a7fbcead4c12bc1ea1d50f867025&scope.project.id=c67c6a799d184c179963f91313a58ab3&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:58:00.877342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dabf4e-bd58-4490-9870-b83914ff201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:00.877991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dabf4e-bd58-4490-9870-b83914ff201e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:00.878268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dabf4e-bd58-4490-9870-b83914ff201e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:00.878535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dabf4e-bd58-4490-9870-b83914ff201e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:00.890399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dabf4e-bd58-4490-9870-b83914ff201e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:00.891881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dabf4e-bd58-4490-9870-b83914ff201e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-63dabf4e-bd58-4490-9870-b83914ff201e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:58:00.908534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:00.915039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:58:00.916179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:58:00.916179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:58:00.916179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:00.916179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 532/1073] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:58:00.917171 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ec06-f75a-41ef-8bd7-4630ca159212 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:01.025984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ec06-f75a-41ef-8bd7-4630ca159212 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:01.059678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273e6ce-378d-434a-a16d-5503a05ef59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:01.060219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273e6ce-378d-434a-a16d-5503a05ef59a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:01.060528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273e6ce-378d-434a-a16d-5503a05ef59a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:01.060802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273e6ce-378d-434a-a16d-5503a05ef59a None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:01.061450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273e6ce-378d-434a-a16d-5503a05ef59a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:01.061753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273e6ce-378d-434a-a16d-5503a05ef59a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:01.063117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273e6ce-378d-434a-a16d-5503a05ef59a None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:01.076011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 542/1074] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:01.081777 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dabf4e-bd58-4490-9870-b83914ff201e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:01.101299 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:01.181824 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dabf4e-bd58-4490-9870-b83914ff201e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:01.221340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e10579-7664-4408-9830-5f920586c498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:01.221965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e10579-7664-4408-9830-5f920586c498 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:01.222241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e10579-7664-4408-9830-5f920586c498 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:01.222508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e10579-7664-4408-9830-5f920586c498 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:01.229553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e10579-7664-4408-9830-5f920586c498 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:01.230977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e10579-7664-4408-9830-5f920586c498 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-39e10579-7664-4408-9830-5f920586c498 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:58:01.242153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:01.243731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:01.244679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:58:01.244679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:58:01.244679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:58:01.244679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:58:01.244679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:58:01.244679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:58:01.244679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:58:01.244679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:01.244679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 533/1075] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:58:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:01.249750 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273e6ce-378d-434a-a16d-5503a05ef59a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:01.287667 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:01.362073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273e6ce-378d-434a-a16d-5503a05ef59a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:01.397367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35cb0-91db-4048-bf0e-7246d91bf497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:01.397980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35cb0-91db-4048-bf0e-7246d91bf497 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:01.398253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35cb0-91db-4048-bf0e-7246d91bf497 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:01.398523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35cb0-91db-4048-bf0e-7246d91bf497 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:01.399234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35cb0-91db-4048-bf0e-7246d91bf497 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:01.399537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35cb0-91db-4048-bf0e-7246d91bf497 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:01.400991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35cb0-91db-4048-bf0e-7246d91bf497 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:01.412700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 543/1076] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:58:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:01.419242 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e10579-7664-4408-9830-5f920586c498 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:01.501111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:01.523098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e10579-7664-4408-9830-5f920586c498 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:01.557701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123acd3-5a6f-45c8-a422-f4fef4543b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:01.558351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123acd3-5a6f-45c8-a422-f4fef4543b59 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:01.558629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123acd3-5a6f-45c8-a422-f4fef4543b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:01.558901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123acd3-5a6f-45c8-a422-f4fef4543b59 None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/8af51476b48e45efbc3b626f9780e0be/roles/4ff6270f4a6f4b95b4966128abe3ef9c` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:01.561071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123acd3-5a6f-45c8-a422-f4fef4543b59 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=8af51476b48e45efbc3b626f9780e0be, role_id=4ff6270f4a6f4b95b4966128abe3ef9c)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:01.562495 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123acd3-5a6f-45c8-a422-f4fef4543b59 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:01.655883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 534/1077] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:58:01 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/8af51476b48e45efbc3b626f9780e0be/roles/4ff6270f4a6f4b95b4966128abe3ef9c => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:58:02.780641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99608a28-3748-4235-88f4-eac0deaf47a9 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:02.781212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99608a28-3748-4235-88f4-eac0deaf47a9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:02.781212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99608a28-3748-4235-88f4-eac0deaf47a9 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:02.782523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 544/1078] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:02.787666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ace0c-4389-460e-9bae-1ed091470233 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:02.788065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ace0c-4389-460e-9bae-1ed091470233 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:02.788219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ace0c-4389-460e-9bae-1ed091470233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:02.806585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b75ace0c-4389-460e-9bae-1ed091470233 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:02.808084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b75ace0c-4389-460e-9bae-1ed091470233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:02.879525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 535/1079] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:58:03.151555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99608a28-3748-4235-88f4-eac0deaf47a9 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:03.247056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:03.254829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99608a28-3748-4235-88f4-eac0deaf47a9 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:03.292692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494fbbd-cedc-42c0-bfcd-5fb08d6a0fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:03.293340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494fbbd-cedc-42c0-bfcd-5fb08d6a0fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:03.293620 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494fbbd-cedc-42c0-bfcd-5fb08d6a0fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:03.295077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494fbbd-cedc-42c0-bfcd-5fb08d6a0fd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:03.304501 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494fbbd-cedc-42c0-bfcd-5fb08d6a0fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-e494fbbd-cedc-42c0-bfcd-5fb08d6a0fd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:58:03.310117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:03.311301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:03.312528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:58:03.316278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 545/1080] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:58:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:03.317327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ace0c-4389-460e-9bae-1ed091470233 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:03.381607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:03.415881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ace0c-4389-460e-9bae-1ed091470233 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:03.450611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808c9e0-5650-45ce-94a3-81ce81412cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:03.451212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808c9e0-5650-45ce-94a3-81ce81412cfd None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:03.451493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808c9e0-5650-45ce-94a3-81ce81412cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:03.451767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808c9e0-5650-45ce-94a3-81ce81412cfd None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:03.452475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808c9e0-5650-45ce-94a3-81ce81412cfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:03.452780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808c9e0-5650-45ce-94a3-81ce81412cfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:03.454141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808c9e0-5650-45ce-94a3-81ce81412cfd None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:03.463411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 536/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:58:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:03.468705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494fbbd-cedc-42c0-bfcd-5fb08d6a0fd0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:03.545779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356940-9c2f-4db9-b4b0-121d01d577d7 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:03.546246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356940-9c2f-4db9-b4b0-121d01d577d7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:03.546601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356940-9c2f-4db9-b4b0-121d01d577d7 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:03.547953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 537/1082] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:58:03.553537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffef7b-351d-4cad-9ee8-2b379a492710 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:03.553816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffef7b-351d-4cad-9ee8-2b379a492710 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:03.554167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffef7b-351d-4cad-9ee8-2b379a492710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:03.571655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494fbbd-cedc-42c0-bfcd-5fb08d6a0fd0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:03.573371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-f3ffef7b-351d-4cad-9ee8-2b379a492710 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:03.574550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f3ffef7b-351d-4cad-9ee8-2b379a492710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:03.605883 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3efcba-187b-4170-82d3-c2a488d21a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:03.606513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3efcba-187b-4170-82d3-c2a488d21a61 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:03.606796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3efcba-187b-4170-82d3-c2a488d21a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:03.607070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3efcba-187b-4170-82d3-c2a488d21a61 None admin] PATH_INFO: `/v3/users/2146a7fbcead4c12bc1ea1d50f867025` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:03.608214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3efcba-187b-4170-82d3-c2a488d21a61 None admin] RBAC: Authorizing `identity:get_user(user_id=2146a7fbcead4c12bc1ea1d50f867025)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:03.609712 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3efcba-187b-4170-82d3-c2a488d21a61 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:03.611309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 546/1083] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:03 2022] GET /identity/v3/users/2146a7fbcead4c12bc1ea1d50f867025 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:03.617003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3efcba-187b-4170-82d3-c2a488d21a61 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:03.642898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:03.644559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 538/1084] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:03.717923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3efcba-187b-4170-82d3-c2a488d21a61 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:03.752577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c69f5-787f-4aef-a60e-44f549ddee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:03.753212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c69f5-787f-4aef-a60e-44f549ddee55 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:03.753516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c69f5-787f-4aef-a60e-44f549ddee55 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:03.753813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c69f5-787f-4aef-a60e-44f549ddee55 None admin] PATH_INFO: `/v3/projects/c67c6a799d184c179963f91313a58ab3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:03.754925 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c69f5-787f-4aef-a60e-44f549ddee55 None admin] RBAC: Authorizing `identity:get_project(project_id=c67c6a799d184c179963f91313a58ab3)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:03.756395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8c69f5-787f-4aef-a60e-44f549ddee55 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:03.758258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 547/1085] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:03 2022] GET /identity/v3/projects/c67c6a799d184c179963f91313a58ab3 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:58:03.764211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffef7b-351d-4cad-9ee8-2b379a492710 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:03.821632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:03.862508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffef7b-351d-4cad-9ee8-2b379a492710 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:03.899465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006117c3-7d8d-4ba0-8108-eb864c0cf133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:03.900124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006117c3-7d8d-4ba0-8108-eb864c0cf133 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:03.900423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006117c3-7d8d-4ba0-8108-eb864c0cf133 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:03.900692 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006117c3-7d8d-4ba0-8108-eb864c0cf133 None admin] PATH_INFO: `/v3/projects/c67c6a799d184c179963f91313a58ab3/users/2146a7fbcead4c12bc1ea1d50f867025/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:03.902570 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006117c3-7d8d-4ba0-8108-eb864c0cf133 None admin] RBAC: Authorizing `identity:create_grant(project_id=c67c6a799d184c179963f91313a58ab3, user_id=2146a7fbcead4c12bc1ea1d50f867025, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:03.903983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006117c3-7d8d-4ba0-8108-eb864c0cf133 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:03.917210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c69f5-787f-4aef-a60e-44f549ddee55 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:04.007991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:04.017534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c69f5-787f-4aef-a60e-44f549ddee55 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:04.056264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 539/1086] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:58:03 2022] PUT /identity/v3/projects/c67c6a799d184c179963f91313a58ab3/users/2146a7fbcead4c12bc1ea1d50f867025/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:58:04.056523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc153e-5a17-469f-8d0a-46292332f973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:04.056523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc153e-5a17-469f-8d0a-46292332f973 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:04.056523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc153e-5a17-469f-8d0a-46292332f973 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:04.056523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc153e-5a17-469f-8d0a-46292332f973 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:04.066573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc153e-5a17-469f-8d0a-46292332f973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-ebcc153e-5a17-469f-8d0a-46292332f973 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:58:04.071635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:04.072926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:58:04.073992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 548/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Aug 24 16:58:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:58:04.079457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006117c3-7d8d-4ba0-8108-eb864c0cf133 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:04.196127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006117c3-7d8d-4ba0-8108-eb864c0cf133 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:04.216881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:04.230906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731159e8-6396-4a48-830c-1b67081eb5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:04.231784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731159e8-6396-4a48-830c-1b67081eb5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:04.231784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731159e8-6396-4a48-830c-1b67081eb5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:04.232024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731159e8-6396-4a48-830c-1b67081eb5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:04.232736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731159e8-6396-4a48-830c-1b67081eb5e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:04.233037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731159e8-6396-4a48-830c-1b67081eb5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:04.234423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731159e8-6396-4a48-830c-1b67081eb5e0 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:04.244026 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 540/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Aug 24 16:58:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:04.249826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc153e-5a17-469f-8d0a-46292332f973 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:04.357246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc153e-5a17-469f-8d0a-46292332f973 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:04.391623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0be4-3754-4260-8aa2-5d1dc7b64975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:04.392282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0be4-3754-4260-8aa2-5d1dc7b64975 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:04.392565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0be4-3754-4260-8aa2-5d1dc7b64975 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:04.392841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0be4-3754-4260-8aa2-5d1dc7b64975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:04.403520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a0be4-3754-4260-8aa2-5d1dc7b64975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:04.404989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a0be4-3754-4260-8aa2-5d1dc7b64975 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-945a0be4-3754-4260-8aa2-5d1dc7b64975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:58:04.419430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:04.420468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:58:04.421397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:58:04.421397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:58:04.421397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:58:04.421397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 549/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:58:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:04.426636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731159e8-6396-4a48-830c-1b67081eb5e0 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:04.526199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731159e8-6396-4a48-830c-1b67081eb5e0 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:04.560669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbd72a-c324-40dc-81bf-aedbc5da418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:04.561199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbd72a-c324-40dc-81bf-aedbc5da418e None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:04.561479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbd72a-c324-40dc-81bf-aedbc5da418e None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:04.561752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbd72a-c324-40dc-81bf-aedbc5da418e None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:04.562394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbd72a-c324-40dc-81bf-aedbc5da418e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:04.562696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbd72a-c324-40dc-81bf-aedbc5da418e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:04.564053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbd72a-c324-40dc-81bf-aedbc5da418e None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:04.575428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 541/1090] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:04.580992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0be4-3754-4260-8aa2-5d1dc7b64975 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:04.583866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:04.684578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0be4-3754-4260-8aa2-5d1dc7b64975 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:04.718880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508bbc-26bd-48d2-a6c0-15066b4c71f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:04.719518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508bbc-26bd-48d2-a6c0-15066b4c71f9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:04.719800 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508bbc-26bd-48d2-a6c0-15066b4c71f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:04.720075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508bbc-26bd-48d2-a6c0-15066b4c71f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:04.728240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39508bbc-26bd-48d2-a6c0-15066b4c71f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:04.729688 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39508bbc-26bd-48d2-a6c0-15066b4c71f9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-39508bbc-26bd-48d2-a6c0-15066b4c71f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:58:04.740611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:04.741609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:04.742584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:04.742584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:04.742584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:58:04.742584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:58:04.742584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:58:04.742584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:58:04.742584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:58:04.742584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:58:04.742584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:58:04.742584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:58:04.742584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 550/1091] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Aug 24 16:58:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:04.747787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbd72a-c324-40dc-81bf-aedbc5da418e None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:04.791297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:04.848172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbd72a-c324-40dc-81bf-aedbc5da418e None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:04.883612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d12e0-eaf7-4c4e-90cb-aef416b70cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:04.884366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d12e0-eaf7-4c4e-90cb-aef416b70cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:04.884648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d12e0-eaf7-4c4e-90cb-aef416b70cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:04.884918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d12e0-eaf7-4c4e-90cb-aef416b70cb9 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:04.885653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d12e0-eaf7-4c4e-90cb-aef416b70cb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:04.885957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d12e0-eaf7-4c4e-90cb-aef416b70cb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:04.887387 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d12e0-eaf7-4c4e-90cb-aef416b70cb9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:04.906469 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 542/1092] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Aug 24 16:58:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:04.911988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508bbc-26bd-48d2-a6c0-15066b4c71f9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:04.974801 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:05.016149 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508bbc-26bd-48d2-a6c0-15066b4c71f9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:05.050138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c684d-cfc0-485c-8954-b30f900eaf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:05.050748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c684d-cfc0-485c-8954-b30f900eaf70 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:05.051027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c684d-cfc0-485c-8954-b30f900eaf70 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:05.051299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c684d-cfc0-485c-8954-b30f900eaf70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:05.119398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c684d-cfc0-485c-8954-b30f900eaf70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:05.120853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c684d-cfc0-485c-8954-b30f900eaf70 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:05.190187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:05.230485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 551/1093] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:58:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:58:05.236491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d12e0-eaf7-4c4e-90cb-aef416b70cb9 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:05.335963 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:05.339476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d12e0-eaf7-4c4e-90cb-aef416b70cb9 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:05.373585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12ced-c7fb-4315-be46-90153ccfe7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:05.374323 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12ced-c7fb-4315-be46-90153ccfe7cd None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:05.374899 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12ced-c7fb-4315-be46-90153ccfe7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:05.375184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12ced-c7fb-4315-be46-90153ccfe7cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:05.386218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12ced-c7fb-4315-be46-90153ccfe7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:05.387651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12ced-c7fb-4315-be46-90153ccfe7cd None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-94c12ced-c7fb-4315-be46-90153ccfe7cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:58:05.403134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:05.404143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:58:05.405297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:58:05.405297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:58:05.405297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:05.405297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 543/1094] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:05.409902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c684d-cfc0-485c-8954-b30f900eaf70 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:05.509328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c684d-cfc0-485c-8954-b30f900eaf70 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:05.542390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a89302-58fe-42f7-8738-77c02a445db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:05.542999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89302-58fe-42f7-8738-77c02a445db6 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:05.543286 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89302-58fe-42f7-8738-77c02a445db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:05.543557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a89302-58fe-42f7-8738-77c02a445db6 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:05.544193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a89302-58fe-42f7-8738-77c02a445db6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:05.544532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a89302-58fe-42f7-8738-77c02a445db6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:05.545894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a89302-58fe-42f7-8738-77c02a445db6 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:05.557840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 552/1095] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 16:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:05.563615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12ced-c7fb-4315-be46-90153ccfe7cd None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:05.665698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12ced-c7fb-4315-be46-90153ccfe7cd None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:05.700090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20b229-cd5d-4acf-aab7-07dee02d15e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:05.700763 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b229-cd5d-4acf-aab7-07dee02d15e1 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:05.701043 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b229-cd5d-4acf-aab7-07dee02d15e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:05.701317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20b229-cd5d-4acf-aab7-07dee02d15e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:05.708057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20b229-cd5d-4acf-aab7-07dee02d15e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:05.709523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20b229-cd5d-4acf-aab7-07dee02d15e1 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-af20b229-cd5d-4acf-aab7-07dee02d15e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:58:05.720670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:05.721775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:05.728030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:58:05.728030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:58:05.728030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:58:05.728030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:58:05.728030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:58:05.728030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:58:05.728030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:58:05.728030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:05.728030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 544/1096] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 16:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:05.728675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a89302-58fe-42f7-8738-77c02a445db6 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:05.753817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:05.831849 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a89302-58fe-42f7-8738-77c02a445db6 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:05.867009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f616e-2a9b-4007-833e-1eb9ec1b1d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:05.868280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f616e-2a9b-4007-833e-1eb9ec1b1d8b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:05.868564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f616e-2a9b-4007-833e-1eb9ec1b1d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:05.868834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f616e-2a9b-4007-833e-1eb9ec1b1d8b None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:05.869533 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f616e-2a9b-4007-833e-1eb9ec1b1d8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:05.869840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f616e-2a9b-4007-833e-1eb9ec1b1d8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:05.871289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f616e-2a9b-4007-833e-1eb9ec1b1d8b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:05.883723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 553/1097] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 16:58:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:05.889933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20b229-cd5d-4acf-aab7-07dee02d15e1 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:05.905493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:05.949056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ddd44-0f29-451c-87f3-edbf674b4ae9 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:05.949325 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ddd44-0f29-451c-87f3-edbf674b4ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:05.949609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ddd44-0f29-451c-87f3-edbf674b4ae9 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:05.950959 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 554/1098] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:58:05.955845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e3af0-a1d0-4519-9aac-8ee09e5aacba None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:05.956124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e3af0-a1d0-4519-9aac-8ee09e5aacba None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:05.956427 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e3af0-a1d0-4519-9aac-8ee09e5aacba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:05.974099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-883e3af0-a1d0-4519-9aac-8ee09e5aacba None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:05.975299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-883e3af0-a1d0-4519-9aac-8ee09e5aacba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:05.991585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20b229-cd5d-4acf-aab7-07dee02d15e1 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:06.025547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5800c-efb3-4f24-8ffc-0323b9ca308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:06.026145 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5800c-efb3-4f24-8ffc-0323b9ca308f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:06.026416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5800c-efb3-4f24-8ffc-0323b9ca308f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:06.026681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5800c-efb3-4f24-8ffc-0323b9ca308f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:06.027395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5800c-efb3-4f24-8ffc-0323b9ca308f None admin] RBAC: Adding query filter params (role.id=4ff6270f4a6f4b95b4966128abe3ef9c, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=8af51476b48e45efbc3b626f9780e0be) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:06.027697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5800c-efb3-4f24-8ffc-0323b9ca308f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:06.029130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5800c-efb3-4f24-8ffc-0323b9ca308f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:06.034807 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 545/1099] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:58:05 2022] GET /identity/v3/role_assignments?user.id=8af51476b48e45efbc3b626f9780e0be&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=4ff6270f4a6f4b95b4966128abe3ef9c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:06.046239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 555/1100] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:58:06.319643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5800c-efb3-4f24-8ffc-0323b9ca308f None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:06.400583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:06.423687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5800c-efb3-4f24-8ffc-0323b9ca308f None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:06.460283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516f875-4131-4b2b-81a6-d6a3df22be05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:06.461127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516f875-4131-4b2b-81a6-d6a3df22be05 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:06.461360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516f875-4131-4b2b-81a6-d6a3df22be05 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:06.461636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516f875-4131-4b2b-81a6-d6a3df22be05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:06.471891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516f875-4131-4b2b-81a6-d6a3df22be05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-1516f875-4131-4b2b-81a6-d6a3df22be05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:58:06.477221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:06.478143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:06.479033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 546/1101] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:58:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:06.484624 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e3af0-a1d0-4519-9aac-8ee09e5aacba None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:06.500490 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:06.594342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e3af0-a1d0-4519-9aac-8ee09e5aacba None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:06.631540 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a18e0-2459-4638-bf97-8b08edf9f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:06.632186 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a18e0-2459-4638-bf97-8b08edf9f56c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:06.632494 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a18e0-2459-4638-bf97-8b08edf9f56c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:06.632836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a18e0-2459-4638-bf97-8b08edf9f56c None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:06.633532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a18e0-2459-4638-bf97-8b08edf9f56c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:06.633842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a18e0-2459-4638-bf97-8b08edf9f56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:06.635208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a18e0-2459-4638-bf97-8b08edf9f56c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:06.643633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 556/1102] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:58:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:06.650123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516f875-4131-4b2b-81a6-d6a3df22be05 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:06.756968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516f875-4131-4b2b-81a6-d6a3df22be05 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:06.791980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6990a-9de2-4a8a-836e-445a5f48f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:06.792646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6990a-9de2-4a8a-836e-445a5f48f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:06.792922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6990a-9de2-4a8a-836e-445a5f48f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:06.793201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6990a-9de2-4a8a-836e-445a5f48f7a4 None admin] PATH_INFO: `/v3/users/2146a7fbcead4c12bc1ea1d50f867025` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:06.794347 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6990a-9de2-4a8a-836e-445a5f48f7a4 None admin] RBAC: Authorizing `identity:get_user(user_id=2146a7fbcead4c12bc1ea1d50f867025)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:06.795758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6990a-9de2-4a8a-836e-445a5f48f7a4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:06.797368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 547/1103] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:06 2022] GET /identity/v3/users/2146a7fbcead4c12bc1ea1d50f867025 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:06.803289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a18e0-2459-4638-bf97-8b08edf9f56c None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:06.885384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:06.910670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a18e0-2459-4638-bf97-8b08edf9f56c None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:06.946127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decfd8e-1d92-4a22-87a4-0ca41d781b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:06.946727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decfd8e-1d92-4a22-87a4-0ca41d781b60 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:06.947007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decfd8e-1d92-4a22-87a4-0ca41d781b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:06.947279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decfd8e-1d92-4a22-87a4-0ca41d781b60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:07.013343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decfd8e-1d92-4a22-87a4-0ca41d781b60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:07.014792 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decfd8e-1d92-4a22-87a4-0ca41d781b60 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:07.086376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:07.111543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 557/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:58:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:58:07.117664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6990a-9de2-4a8a-836e-445a5f48f7a4 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:07.121479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:07.214957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6990a-9de2-4a8a-836e-445a5f48f7a4 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:07.249551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99808e-05b3-4ad1-8d2d-8819c11b607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:07.250176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99808e-05b3-4ad1-8d2d-8819c11b607b None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:07.250457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99808e-05b3-4ad1-8d2d-8819c11b607b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:07.250729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99808e-05b3-4ad1-8d2d-8819c11b607b None admin] PATH_INFO: `/v3/projects/c67c6a799d184c179963f91313a58ab3` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:07.251831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99808e-05b3-4ad1-8d2d-8819c11b607b None admin] RBAC: Authorizing `identity:get_project(project_id=c67c6a799d184c179963f91313a58ab3)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:07.253352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99808e-05b3-4ad1-8d2d-8819c11b607b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:07.254976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 548/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:07 2022] GET /identity/v3/projects/c67c6a799d184c179963f91313a58ab3 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:07.261338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decfd8e-1d92-4a22-87a4-0ca41d781b60 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:07.359306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decfd8e-1d92-4a22-87a4-0ca41d781b60 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:07.392595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f8bee-cd75-4880-a1c4-6c0637a4c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:07.393203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8bee-cd75-4880-a1c4-6c0637a4c3ad None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:07.393483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8bee-cd75-4880-a1c4-6c0637a4c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:07.393754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f8bee-cd75-4880-a1c4-6c0637a4c3ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:07.394475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f8bee-cd75-4880-a1c4-6c0637a4c3ad None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=c67c6a799d184c179963f91313a58ab3, user.id=2146a7fbcead4c12bc1ea1d50f867025) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:07.394783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f8bee-cd75-4880-a1c4-6c0637a4c3ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:07.396208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f8bee-cd75-4880-a1c4-6c0637a4c3ad None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:07.402558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 558/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:58:07 2022] GET /identity/v3/role_assignments?user.id=2146a7fbcead4c12bc1ea1d50f867025&scope.project.id=c67c6a799d184c179963f91313a58ab3&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:09.350427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29516f9c-cca3-4c48-b49f-bb32a9129b5b None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:09.350938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29516f9c-cca3-4c48-b49f-bb32a9129b5b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:09.351069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29516f9c-cca3-4c48-b49f-bb32a9129b5b None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:09.352325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 549/1107] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:09.357464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef56946-13f2-49f5-9afb-b98112962da0 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:09.357875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef56946-13f2-49f5-9afb-b98112962da0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:09.358001 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef56946-13f2-49f5-9afb-b98112962da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:09.376112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-aef56946-13f2-49f5-9afb-b98112962da0 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:09.377335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-aef56946-13f2-49f5-9afb-b98112962da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:09.406723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:09.443387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 559/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:58:09.711512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29516f9c-cca3-4c48-b49f-bb32a9129b5b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:09.781952 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:09.812479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29516f9c-cca3-4c48-b49f-bb32a9129b5b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:09.845730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803c14c-26ee-4623-a091-cf14ba2454d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:09.846364 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803c14c-26ee-4623-a091-cf14ba2454d9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:09.846624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803c14c-26ee-4623-a091-cf14ba2454d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:09.846893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803c14c-26ee-4623-a091-cf14ba2454d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:09.847988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803c14c-26ee-4623-a091-cf14ba2454d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:09.849478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803c14c-26ee-4623-a091-cf14ba2454d9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:09.851058 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 550/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:58:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:09.857656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef56946-13f2-49f5-9afb-b98112962da0 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:10.067201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef56946-13f2-49f5-9afb-b98112962da0 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:10.100661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cf773-cb10-4feb-8b7f-72500f5bcb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:10.102030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cf773-cb10-4feb-8b7f-72500f5bcb1d None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:10.102535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cf773-cb10-4feb-8b7f-72500f5bcb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:10.102833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cf773-cb10-4feb-8b7f-72500f5bcb1d None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:10.103478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cf773-cb10-4feb-8b7f-72500f5bcb1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:10.105058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cf773-cb10-4feb-8b7f-72500f5bcb1d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:10.266657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 560/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:58:09 2022] POST /identity/v3/users => generated 286 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:58:12.230611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a92522-7cfc-422e-ab56-253f3320758b None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:12.231162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a92522-7cfc-422e-ab56-253f3320758b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:12.231162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a92522-7cfc-422e-ab56-253f3320758b None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:12.232560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 551/1111] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:12.237847 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355c768-dd1f-407b-89c8-5da00baa1e11 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:12.238220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355c768-dd1f-407b-89c8-5da00baa1e11 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:12.238400 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355c768-dd1f-407b-89c8-5da00baa1e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:12.257188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-8355c768-dd1f-407b-89c8-5da00baa1e11 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:12.258484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8355c768-dd1f-407b-89c8-5da00baa1e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:12.275774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:12.323986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 561/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:12.599254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a92522-7cfc-422e-ab56-253f3320758b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:12.701763 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a92522-7cfc-422e-ab56-253f3320758b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:12.735258 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ce11e-aba0-454c-8810-8f635b20af49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:12.735871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ce11e-aba0-454c-8810-8f635b20af49 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:12.736177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ce11e-aba0-454c-8810-8f635b20af49 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:12.736508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ce11e-aba0-454c-8810-8f635b20af49 None admin] PATH_INFO: `/v3/roles/2837bb5c87054ea7a046150d413d2561` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:12.737885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ce11e-aba0-454c-8810-8f635b20af49 None admin] RBAC: Authorizing `identity:get_role(role_id=2837bb5c87054ea7a046150d413d2561)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:12.739237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ce11e-aba0-454c-8810-8f635b20af49 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:12.740658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 552/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:12 2022] GET /identity/v3/roles/2837bb5c87054ea7a046150d413d2561 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:12.746656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355c768-dd1f-407b-89c8-5da00baa1e11 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:12.843520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355c768-dd1f-407b-89c8-5da00baa1e11 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:12.878031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1ce83-ca97-4701-a9b4-a0b2ec490560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:12.878598 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1ce83-ca97-4701-a9b4-a0b2ec490560 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:12.878879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1ce83-ca97-4701-a9b4-a0b2ec490560 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:12.879152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1ce83-ca97-4701-a9b4-a0b2ec490560 None admin] PATH_INFO: `/v3/users/3395b8fac47540afa6428a6ea0397887` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:12.893516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1ce83-ca97-4701-a9b4-a0b2ec490560 None admin] RBAC: Authorizing `identity:get_user(user_id=3395b8fac47540afa6428a6ea0397887)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:12.895005 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1ce83-ca97-4701-a9b4-a0b2ec490560 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:12.896658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 562/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:12 2022] GET /identity/v3/users/3395b8fac47540afa6428a6ea0397887 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:12.903375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ce11e-aba0-454c-8810-8f635b20af49 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:12.914821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:13.002452 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ce11e-aba0-454c-8810-8f635b20af49 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:13.035884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe72c-f074-40f5-9940-7212d80f25d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:13.036511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe72c-f074-40f5-9940-7212d80f25d9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:13.036838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe72c-f074-40f5-9940-7212d80f25d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:13.037111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebe72c-f074-40f5-9940-7212d80f25d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:13.102883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebe72c-f074-40f5-9940-7212d80f25d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:13.104332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebe72c-f074-40f5-9940-7212d80f25d9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:13.113615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:13.202238 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 553/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:58:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:58:13.208192 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1ce83-ca97-4701-a9b4-a0b2ec490560 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:13.222942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:13.308610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1ce83-ca97-4701-a9b4-a0b2ec490560 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:13.342653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd43c0-3d1a-4082-9d1e-ffa27fce96b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:13.343284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd43c0-3d1a-4082-9d1e-ffa27fce96b3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:13.343559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd43c0-3d1a-4082-9d1e-ffa27fce96b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:13.343831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd43c0-3d1a-4082-9d1e-ffa27fce96b3 None admin] PATH_INFO: `/v3/projects/c67c6a799d184c179963f91313a58ab3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:13.345020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd43c0-3d1a-4082-9d1e-ffa27fce96b3 None admin] RBAC: Authorizing `identity:get_project(project_id=c67c6a799d184c179963f91313a58ab3)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:13.346427 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd43c0-3d1a-4082-9d1e-ffa27fce96b3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:13.348048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 563/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:13 2022] GET /identity/v3/projects/c67c6a799d184c179963f91313a58ab3 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:13.355002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe72c-f074-40f5-9940-7212d80f25d9 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:13.451535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebe72c-f074-40f5-9940-7212d80f25d9 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:13.461730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:13.487036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5de776-97a3-4dab-b409-49e00c609b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:13.487635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5de776-97a3-4dab-b409-49e00c609b77 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:13.487920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5de776-97a3-4dab-b409-49e00c609b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:13.488193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5de776-97a3-4dab-b409-49e00c609b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:13.488940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5de776-97a3-4dab-b409-49e00c609b77 None admin] RBAC: Adding query filter params (role.id=2837bb5c87054ea7a046150d413d2561, scope.project.id=c67c6a799d184c179963f91313a58ab3, user.id=3395b8fac47540afa6428a6ea0397887) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:13.489247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5de776-97a3-4dab-b409-49e00c609b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:13.490659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5de776-97a3-4dab-b409-49e00c609b77 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:13.497328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 554/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:58:13 2022] GET /identity/v3/role_assignments?user.id=3395b8fac47540afa6428a6ea0397887&scope.project.id=c67c6a799d184c179963f91313a58ab3&role.id=2837bb5c87054ea7a046150d413d2561 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:15.390566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd84f48-e909-4b7b-bcf0-7dfdbb2456d3 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:15.391089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd84f48-e909-4b7b-bcf0-7dfdbb2456d3 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:15.391089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd84f48-e909-4b7b-bcf0-7dfdbb2456d3 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:15.393625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 564/1118] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:15.397576 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20185b23-0519-412d-997c-20e5fb2586c3 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:15.397976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20185b23-0519-412d-997c-20e5fb2586c3 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:15.398168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20185b23-0519-412d-997c-20e5fb2586c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:15.416812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-20185b23-0519-412d-997c-20e5fb2586c3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:15.418019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-20185b23-0519-412d-997c-20e5fb2586c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:15.484235 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 555/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:15.758832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd84f48-e909-4b7b-bcf0-7dfdbb2456d3 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:15.840964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:15.861009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd84f48-e909-4b7b-bcf0-7dfdbb2456d3 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:15.895038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee222cb-5b56-44fc-b158-287fc92e41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:15.895665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee222cb-5b56-44fc-b158-287fc92e41c9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:15.895947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee222cb-5b56-44fc-b158-287fc92e41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:15.896221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee222cb-5b56-44fc-b158-287fc92e41c9 None admin] PATH_INFO: `/v3/roles/2837bb5c87054ea7a046150d413d2561` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:15.897637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee222cb-5b56-44fc-b158-287fc92e41c9 None admin] RBAC: Authorizing `identity:get_role(role_id=2837bb5c87054ea7a046150d413d2561)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:15.899118 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee222cb-5b56-44fc-b158-287fc92e41c9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:15.900475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 565/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:15 2022] GET /identity/v3/roles/2837bb5c87054ea7a046150d413d2561 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:15.906594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20185b23-0519-412d-997c-20e5fb2586c3 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:16.005386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20185b23-0519-412d-997c-20e5fb2586c3 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:16.006900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:16.039293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06adf-e144-4f3d-8cc7-a87284bd1352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:16.039977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06adf-e144-4f3d-8cc7-a87284bd1352 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:16.040347 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06adf-e144-4f3d-8cc7-a87284bd1352 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:16.040688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06adf-e144-4f3d-8cc7-a87284bd1352 None admin] PATH_INFO: `/v3/users/3395b8fac47540afa6428a6ea0397887` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:16.041867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca06adf-e144-4f3d-8cc7-a87284bd1352 None admin] RBAC: Authorizing `identity:get_user(user_id=3395b8fac47540afa6428a6ea0397887)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:16.043375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca06adf-e144-4f3d-8cc7-a87284bd1352 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:16.044984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 556/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:15 2022] GET /identity/v3/users/3395b8fac47540afa6428a6ea0397887 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:16.050842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee222cb-5b56-44fc-b158-287fc92e41c9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:16.147687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee222cb-5b56-44fc-b158-287fc92e41c9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:16.181522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c1a6f-2b3b-4ce6-8916-8616337c57e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:16.182144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c1a6f-2b3b-4ce6-8916-8616337c57e4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:16.182421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c1a6f-2b3b-4ce6-8916-8616337c57e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:16.182689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c1a6f-2b3b-4ce6-8916-8616337c57e4 None admin] PATH_INFO: `/v3/projects/c67c6a799d184c179963f91313a58ab3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:16.183794 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c1a6f-2b3b-4ce6-8916-8616337c57e4 None admin] RBAC: Authorizing `identity:get_project(project_id=c67c6a799d184c179963f91313a58ab3)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:16.185249 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c1a6f-2b3b-4ce6-8916-8616337c57e4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:16.186854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 566/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:16 2022] GET /identity/v3/projects/c67c6a799d184c179963f91313a58ab3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:16.192856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06adf-e144-4f3d-8cc7-a87284bd1352 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:16.291775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06adf-e144-4f3d-8cc7-a87284bd1352 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:16.325018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5230a21-9029-414b-ae62-8a36e139dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:16.325659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230a21-9029-414b-ae62-8a36e139dace None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:16.325935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230a21-9029-414b-ae62-8a36e139dace None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:16.326206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5230a21-9029-414b-ae62-8a36e139dace None admin] PATH_INFO: `/v3/projects/c67c6a799d184c179963f91313a58ab3/users/3395b8fac47540afa6428a6ea0397887/roles/2837bb5c87054ea7a046150d413d2561` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:16.328367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5230a21-9029-414b-ae62-8a36e139dace None admin] RBAC: Authorizing `identity:create_grant(project_id=c67c6a799d184c179963f91313a58ab3, user_id=3395b8fac47540afa6428a6ea0397887, role_id=2837bb5c87054ea7a046150d413d2561)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:16.329780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5230a21-9029-414b-ae62-8a36e139dace None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:16.418455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 557/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:58:16 2022] PUT /identity/v3/projects/c67c6a799d184c179963f91313a58ab3/users/3395b8fac47540afa6428a6ea0397887/roles/2837bb5c87054ea7a046150d413d2561 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:58:18.310879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952da5-5224-4fa0-8cc4-0c827a8b7cc2 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:18.311359 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952da5-5224-4fa0-8cc4-0c827a8b7cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:18.311471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91952da5-5224-4fa0-8cc4-0c827a8b7cc2 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:18.312786 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 567/1124] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:18.318228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda20f-35dc-435d-af70-2ea6ecbafd1f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:18.318647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda20f-35dc-435d-af70-2ea6ecbafd1f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:18.318781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda20f-35dc-435d-af70-2ea6ecbafd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:18.338531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b0fda20f-35dc-435d-af70-2ea6ecbafd1f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:18.339721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b0fda20f-35dc-435d-af70-2ea6ecbafd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:18.363027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:18.407190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 558/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:18.690112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91952da5-5224-4fa0-8cc4-0c827a8b7cc2 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:18.709080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:18.791738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91952da5-5224-4fa0-8cc4-0c827a8b7cc2 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:18.826782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e46dea-4eb8-4971-a910-5b29dbee94ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:18.827398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e46dea-4eb8-4971-a910-5b29dbee94ca None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:18.827673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e46dea-4eb8-4971-a910-5b29dbee94ca None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:18.827941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e46dea-4eb8-4971-a910-5b29dbee94ca None admin] PATH_INFO: `/v3/roles/2837bb5c87054ea7a046150d413d2561` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:18.829334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e46dea-4eb8-4971-a910-5b29dbee94ca None admin] RBAC: Authorizing `identity:get_role(role_id=2837bb5c87054ea7a046150d413d2561)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:18.830700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e46dea-4eb8-4971-a910-5b29dbee94ca None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:18.832002 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 568/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:18 2022] GET /identity/v3/roles/2837bb5c87054ea7a046150d413d2561 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:18.839040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fda20f-35dc-435d-af70-2ea6ecbafd1f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:18.937980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fda20f-35dc-435d-af70-2ea6ecbafd1f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:18.971736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976f5fa-e7de-4f39-9632-491eef56a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:18.972312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976f5fa-e7de-4f39-9632-491eef56a256 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:18.972589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976f5fa-e7de-4f39-9632-491eef56a256 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:18.972857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976f5fa-e7de-4f39-9632-491eef56a256 None admin] PATH_INFO: `/v3/users/3395b8fac47540afa6428a6ea0397887` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:18.973958 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976f5fa-e7de-4f39-9632-491eef56a256 None admin] RBAC: Authorizing `identity:get_user(user_id=3395b8fac47540afa6428a6ea0397887)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:18.975374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976f5fa-e7de-4f39-9632-491eef56a256 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:18.977286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 559/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:18 2022] GET /identity/v3/users/3395b8fac47540afa6428a6ea0397887 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:18.983081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e46dea-4eb8-4971-a910-5b29dbee94ca None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:19.066095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:19.082004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e46dea-4eb8-4971-a910-5b29dbee94ca None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:19.114573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c5c53-c779-41e1-a257-77c5cc26dba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:19.115175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c5c53-c779-41e1-a257-77c5cc26dba3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:19.115456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c5c53-c779-41e1-a257-77c5cc26dba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:19.115729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c5c53-c779-41e1-a257-77c5cc26dba3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:19.182291 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c5c53-c779-41e1-a257-77c5cc26dba3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:19.183736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c5c53-c779-41e1-a257-77c5cc26dba3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:19.263321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:19.279114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 569/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:58:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:58:19.285267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976f5fa-e7de-4f39-9632-491eef56a256 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:19.313966 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:19.383473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976f5fa-e7de-4f39-9632-491eef56a256 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:19.416382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb37402-78e3-4198-bcc5-3bab1fb4bb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:19.416991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37402-78e3-4198-bcc5-3bab1fb4bb6f None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:19.417266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37402-78e3-4198-bcc5-3bab1fb4bb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:19.417538 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37402-78e3-4198-bcc5-3bab1fb4bb6f None admin] PATH_INFO: `/v3/projects/c67c6a799d184c179963f91313a58ab3` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:19.418631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb37402-78e3-4198-bcc5-3bab1fb4bb6f None admin] RBAC: Authorizing `identity:get_project(project_id=c67c6a799d184c179963f91313a58ab3)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:19.420028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb37402-78e3-4198-bcc5-3bab1fb4bb6f None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:19.421653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 560/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:19 2022] GET /identity/v3/projects/c67c6a799d184c179963f91313a58ab3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:19.427840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c5c53-c779-41e1-a257-77c5cc26dba3 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:19.524253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c5c53-c779-41e1-a257-77c5cc26dba3 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:19.557791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58d77c-7579-44db-8b48-9152782092cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:19.558391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d77c-7579-44db-8b48-9152782092cb None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:19.558664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d77c-7579-44db-8b48-9152782092cb None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:19.558930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d77c-7579-44db-8b48-9152782092cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:19.559636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58d77c-7579-44db-8b48-9152782092cb None admin] RBAC: Adding query filter params (role.id=2837bb5c87054ea7a046150d413d2561, scope.project.id=c67c6a799d184c179963f91313a58ab3, user.id=3395b8fac47540afa6428a6ea0397887) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:19.560082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58d77c-7579-44db-8b48-9152782092cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:19.561391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58d77c-7579-44db-8b48-9152782092cb None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:19.566910 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 570/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:58:19 2022] GET /identity/v3/role_assignments?user.id=3395b8fac47540afa6428a6ea0397887&scope.project.id=c67c6a799d184c179963f91313a58ab3&role.id=2837bb5c87054ea7a046150d413d2561 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:21.495616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757c8a-f4b1-425e-83a1-f2b758a03ea7 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:21.496138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757c8a-f4b1-425e-83a1-f2b758a03ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:21.496138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16757c8a-f4b1-425e-83a1-f2b758a03ea7 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:21.497529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 561/1131] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:21.502808 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606406d-d82c-4d1e-91b3-2545fff4c69a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:21.503259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606406d-d82c-4d1e-91b3-2545fff4c69a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:21.503361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606406d-d82c-4d1e-91b3-2545fff4c69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:21.521354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0606406d-d82c-4d1e-91b3-2545fff4c69a None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:21.523070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0606406d-d82c-4d1e-91b3-2545fff4c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:21.566472 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:21.589111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 571/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:21.866456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16757c8a-f4b1-425e-83a1-f2b758a03ea7 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:21.962050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:21.968692 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16757c8a-f4b1-425e-83a1-f2b758a03ea7 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:22.002245 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20de4f4-3310-4617-84d8-bf86f4f1a1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:22.002863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de4f4-3310-4617-84d8-bf86f4f1a1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:22.003144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de4f4-3310-4617-84d8-bf86f4f1a1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:22.003413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20de4f4-3310-4617-84d8-bf86f4f1a1e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:22.004545 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20de4f4-3310-4617-84d8-bf86f4f1a1e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:22.005964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20de4f4-3310-4617-84d8-bf86f4f1a1e4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:22.008251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 562/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:58:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:22.014286 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606406d-d82c-4d1e-91b3-2545fff4c69a None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:22.110168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606406d-d82c-4d1e-91b3-2545fff4c69a None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:22.144550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbe359-e70f-47e8-b18a-badf1ffea04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:22.145087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbe359-e70f-47e8-b18a-badf1ffea04c None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:22.145368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbe359-e70f-47e8-b18a-badf1ffea04c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:22.145643 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbe359-e70f-47e8-b18a-badf1ffea04c None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:22.146296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbe359-e70f-47e8-b18a-badf1ffea04c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:22.147923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbe359-e70f-47e8-b18a-badf1ffea04c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:22.250181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 572/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:58:22 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:58:24.209346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967752e-71e8-4857-8aca-bea7f745b2af None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:24.209877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967752e-71e8-4857-8aca-bea7f745b2af None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:24.209877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967752e-71e8-4857-8aca-bea7f745b2af None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:24.211690 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 563/1135] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:24.217027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932c956-e956-4ede-af0f-d31bb18e71c2 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:24.217459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932c956-e956-4ede-af0f-d31bb18e71c2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:24.217558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932c956-e956-4ede-af0f-d31bb18e71c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:24.236503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-3932c956-e956-4ede-af0f-d31bb18e71c2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:24.237687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3932c956-e956-4ede-af0f-d31bb18e71c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:24.261536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:24.306669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 573/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:24.577481 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967752e-71e8-4857-8aca-bea7f745b2af None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:24.684307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967752e-71e8-4857-8aca-bea7f745b2af None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:24.723035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56a99e-3c8a-4710-9fbe-b427cd7a45ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:24.723666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56a99e-3c8a-4710-9fbe-b427cd7a45ea None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:24.723946 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56a99e-3c8a-4710-9fbe-b427cd7a45ea None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:24.724218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56a99e-3c8a-4710-9fbe-b427cd7a45ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:24.726275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56a99e-3c8a-4710-9fbe-b427cd7a45ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:24.728418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56a99e-3c8a-4710-9fbe-b427cd7a45ea None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:24.730017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 564/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 16:58:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:24.735784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932c956-e956-4ede-af0f-d31bb18e71c2 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:24.840351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932c956-e956-4ede-af0f-d31bb18e71c2 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:24.875507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f99a34-8133-432f-b809-c32f4e6f448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:24.876126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99a34-8133-432f-b809-c32f4e6f448d None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:24.876435 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99a34-8133-432f-b809-c32f4e6f448d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:24.876707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f99a34-8133-432f-b809-c32f4e6f448d None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:24.877376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f99a34-8133-432f-b809-c32f4e6f448d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:24.878819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f99a34-8133-432f-b809-c32f4e6f448d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:24.984467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 574/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:58:24 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:58:26.998851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51152b-cd7e-48a9-b60d-cab5105e25df None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:26.999425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51152b-cd7e-48a9-b60d-cab5105e25df None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:26.999425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51152b-cd7e-48a9-b60d-cab5105e25df None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:27.000751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 565/1139] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:27.009162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d999450-0b6e-4de9-8dc9-a021467ad6c7 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:27.009654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d999450-0b6e-4de9-8dc9-a021467ad6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:27.009741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d999450-0b6e-4de9-8dc9-a021467ad6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:27.028481 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0d999450-0b6e-4de9-8dc9-a021467ad6c7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:27.029707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0d999450-0b6e-4de9-8dc9-a021467ad6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:27.042937 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:27.103798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 575/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:27.375923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51152b-cd7e-48a9-b60d-cab5105e25df None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:27.407914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:27.483123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51152b-cd7e-48a9-b60d-cab5105e25df None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:27.517895 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad6ed9-8f31-4e9c-833f-aa60b625984c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:27.518525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad6ed9-8f31-4e9c-833f-aa60b625984c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:27.518806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad6ed9-8f31-4e9c-833f-aa60b625984c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:27.519077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad6ed9-8f31-4e9c-833f-aa60b625984c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:27.529938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad6ed9-8f31-4e9c-833f-aa60b625984c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-f7ad6ed9-8f31-4e9c-833f-aa60b625984c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:58:27.534916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:27.536660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:27.538454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 566/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:27.544965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d999450-0b6e-4de9-8dc9-a021467ad6c7 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:27.644698 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d999450-0b6e-4de9-8dc9-a021467ad6c7 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:27.678991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42973a-5327-4391-80e5-53ef18bbd1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:27.679690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42973a-5327-4391-80e5-53ef18bbd1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:27.679970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42973a-5327-4391-80e5-53ef18bbd1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:27.680268 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42973a-5327-4391-80e5-53ef18bbd1f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:27.681197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42973a-5327-4391-80e5-53ef18bbd1f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:27.681502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42973a-5327-4391-80e5-53ef18bbd1f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:27.682879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42973a-5327-4391-80e5-53ef18bbd1f1 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:27.691396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 576/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:58:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:27.697884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad6ed9-8f31-4e9c-833f-aa60b625984c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:27.798500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:27.808481 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad6ed9-8f31-4e9c-833f-aa60b625984c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:27.848041 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5ca62-7761-4ef3-bc69-439b9ec9a2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:27.848703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5ca62-7761-4ef3-bc69-439b9ec9a2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:27.848986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5ca62-7761-4ef3-bc69-439b9ec9a2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:27.849260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5ca62-7761-4ef3-bc69-439b9ec9a2e5 None admin] PATH_INFO: `/v3/users/7eb626409e7c4bfea141e640d92eca34` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:27.865688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5ca62-7761-4ef3-bc69-439b9ec9a2e5 None admin] RBAC: Authorizing `identity:get_user(user_id=7eb626409e7c4bfea141e640d92eca34)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:27.867332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5ca62-7761-4ef3-bc69-439b9ec9a2e5 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:27.869183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 567/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:27 2022] GET /identity/v3/users/7eb626409e7c4bfea141e640d92eca34 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:27.875934 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42973a-5327-4391-80e5-53ef18bbd1f1 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:27.889705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:27.984200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42973a-5327-4391-80e5-53ef18bbd1f1 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:28.020006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3621d0-6b36-4479-b956-02465349a1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:28.020702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3621d0-6b36-4479-b956-02465349a1df None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:28.021051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3621d0-6b36-4479-b956-02465349a1df None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:28.021373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3621d0-6b36-4479-b956-02465349a1df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:28.095045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3621d0-6b36-4479-b956-02465349a1df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:28.096455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3621d0-6b36-4479-b956-02465349a1df None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:28.107224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:28.199982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 577/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:58:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 16:58:28.206449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5ca62-7761-4ef3-bc69-439b9ec9a2e5 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:28.310681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5ca62-7761-4ef3-bc69-439b9ec9a2e5 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:28.346155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d4b4e-6754-47c8-aa54-b3ffbe3cd5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:28.346705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4b4e-6754-47c8-aa54-b3ffbe3cd5a4 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:28.346983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4b4e-6754-47c8-aa54-b3ffbe3cd5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:28.347256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d4b4e-6754-47c8-aa54-b3ffbe3cd5a4 None admin] PATH_INFO: `/v3/projects/224525f411ec4d55889c80d2046f7f84` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:28.348403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d4b4e-6754-47c8-aa54-b3ffbe3cd5a4 None admin] RBAC: Authorizing `identity:get_project(project_id=224525f411ec4d55889c80d2046f7f84)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:28.349827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d4b4e-6754-47c8-aa54-b3ffbe3cd5a4 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:28.351652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 568/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:28 2022] GET /identity/v3/projects/224525f411ec4d55889c80d2046f7f84 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:28.358437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3621d0-6b36-4479-b956-02465349a1df None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:28.463179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3621d0-6b36-4479-b956-02465349a1df None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:28.473152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:28.499349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9516459-05d6-4cd6-a6e8-89d175a0b973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:28.499973 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9516459-05d6-4cd6-a6e8-89d175a0b973 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:28.500271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9516459-05d6-4cd6-a6e8-89d175a0b973 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:28.500546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9516459-05d6-4cd6-a6e8-89d175a0b973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:28.501279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9516459-05d6-4cd6-a6e8-89d175a0b973 None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=224525f411ec4d55889c80d2046f7f84, user.id=7eb626409e7c4bfea141e640d92eca34) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:28.501593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9516459-05d6-4cd6-a6e8-89d175a0b973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:28.503054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9516459-05d6-4cd6-a6e8-89d175a0b973 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:28.509906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 578/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:58:28 2022] GET /identity/v3/role_assignments?user.id=7eb626409e7c4bfea141e640d92eca34&scope.project.id=224525f411ec4d55889c80d2046f7f84&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:30.485886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5cc4-33ec-43af-9475-5b66d6776b30 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:30.486420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5cc4-33ec-43af-9475-5b66d6776b30 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:30.486420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea5cc4-33ec-43af-9475-5b66d6776b30 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:30.487746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 569/1147] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:30.493315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112d6c-562b-4577-b47c-9ce66ecb9c6a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:30.493762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112d6c-562b-4577-b47c-9ce66ecb9c6a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:30.493863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d112d6c-562b-4577-b47c-9ce66ecb9c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:30.511599 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-1d112d6c-562b-4577-b47c-9ce66ecb9c6a None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:30.512797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1d112d6c-562b-4577-b47c-9ce66ecb9c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:30.578548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 579/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:58:30.848166 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea5cc4-33ec-43af-9475-5b66d6776b30 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:30.868084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:30.949786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea5cc4-33ec-43af-9475-5b66d6776b30 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:30.982907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9d248-1431-46c7-9d08-ca2ea7364827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:30.983526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9d248-1431-46c7-9d08-ca2ea7364827 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:30.983805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9d248-1431-46c7-9d08-ca2ea7364827 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:30.984078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9d248-1431-46c7-9d08-ca2ea7364827 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:30.994524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9d248-1431-46c7-9d08-ca2ea7364827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-09d9d248-1431-46c7-9d08-ca2ea7364827 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:58:30.999176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:31.000296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:31.001345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 570/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:58:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:31.006503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d112d6c-562b-4577-b47c-9ce66ecb9c6a None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:31.104746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d112d6c-562b-4577-b47c-9ce66ecb9c6a None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:31.106159 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:31.138314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1935-aab2-4fc2-bb89-b46f08e691a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:31.138928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1935-aab2-4fc2-bb89-b46f08e691a1 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:31.139409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1935-aab2-4fc2-bb89-b46f08e691a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:31.139892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b1935-aab2-4fc2-bb89-b46f08e691a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:31.141432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b1935-aab2-4fc2-bb89-b46f08e691a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:31.141962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b1935-aab2-4fc2-bb89-b46f08e691a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:31.143512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b1935-aab2-4fc2-bb89-b46f08e691a1 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:31.154910 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 580/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:31.160932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9d248-1431-46c7-9d08-ca2ea7364827 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:31.240992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:31.261655 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9d248-1431-46c7-9d08-ca2ea7364827 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:31.296586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba64b-a80d-4cfe-8e01-cb1a8cb197f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:31.297221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba64b-a80d-4cfe-8e01-cb1a8cb197f7 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:31.297497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba64b-a80d-4cfe-8e01-cb1a8cb197f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:31.297768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ba64b-a80d-4cfe-8e01-cb1a8cb197f7 None admin] PATH_INFO: `/v3/users/7eb626409e7c4bfea141e640d92eca34` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:31.298881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ba64b-a80d-4cfe-8e01-cb1a8cb197f7 None admin] RBAC: Authorizing `identity:get_user(user_id=7eb626409e7c4bfea141e640d92eca34)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:31.300328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ba64b-a80d-4cfe-8e01-cb1a8cb197f7 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:31.301901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 571/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:31 2022] GET /identity/v3/users/7eb626409e7c4bfea141e640d92eca34 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:31.308295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1935-aab2-4fc2-bb89-b46f08e691a1 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:31.408736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b1935-aab2-4fc2-bb89-b46f08e691a1 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:31.441231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0af273-8d55-4430-b601-8f5b66f566a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:31.441889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af273-8d55-4430-b601-8f5b66f566a3 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:31.442167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af273-8d55-4430-b601-8f5b66f566a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:31.442442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af273-8d55-4430-b601-8f5b66f566a3 None admin] PATH_INFO: `/v3/projects/224525f411ec4d55889c80d2046f7f84` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:31.443559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0af273-8d55-4430-b601-8f5b66f566a3 None admin] RBAC: Authorizing `identity:get_project(project_id=224525f411ec4d55889c80d2046f7f84)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:31.445569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0af273-8d55-4430-b601-8f5b66f566a3 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:31.447206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 581/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:31 2022] GET /identity/v3/projects/224525f411ec4d55889c80d2046f7f84 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:31.453277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba64b-a80d-4cfe-8e01-cb1a8cb197f7 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:31.550358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ba64b-a80d-4cfe-8e01-cb1a8cb197f7 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:31.584450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d76b42-1168-4c58-be73-1805526dc8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:31.585108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d76b42-1168-4c58-be73-1805526dc8e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:31.585958 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d76b42-1168-4c58-be73-1805526dc8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:31.586313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d76b42-1168-4c58-be73-1805526dc8e6 None admin] PATH_INFO: `/v3/projects/224525f411ec4d55889c80d2046f7f84/users/7eb626409e7c4bfea141e640d92eca34/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:31.588182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d76b42-1168-4c58-be73-1805526dc8e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=224525f411ec4d55889c80d2046f7f84, user_id=7eb626409e7c4bfea141e640d92eca34, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:31.589630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d76b42-1168-4c58-be73-1805526dc8e6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:31.715842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 572/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:58:31 2022] PUT /identity/v3/projects/224525f411ec4d55889c80d2046f7f84/users/7eb626409e7c4bfea141e640d92eca34/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:58:33.605829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e9822-017f-4ec9-8ab6-1bbb419e5a71 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:33.606386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e9822-017f-4ec9-8ab6-1bbb419e5a71 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:33.606386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e9822-017f-4ec9-8ab6-1bbb419e5a71 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:33.607631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 582/1154] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:33.612806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9054e-78b4-4243-87d3-31225a28ab4b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:33.613218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9054e-78b4-4243-87d3-31225a28ab4b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:33.613444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9054e-78b4-4243-87d3-31225a28ab4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:33.627379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:33.632848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-3ba9054e-78b4-4243-87d3-31225a28ab4b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:33.634044 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3ba9054e-78b4-4243-87d3-31225a28ab4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:33.702902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 573/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:58:33.974695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e9822-017f-4ec9-8ab6-1bbb419e5a71 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:34.007749 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:34.079099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e9822-017f-4ec9-8ab6-1bbb419e5a71 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:34.111903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71ebfd-3faa-4186-8aed-a5a19ad11465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:34.112568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71ebfd-3faa-4186-8aed-a5a19ad11465 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:34.112848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71ebfd-3faa-4186-8aed-a5a19ad11465 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:34.113122 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71ebfd-3faa-4186-8aed-a5a19ad11465 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:34.124339 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71ebfd-3faa-4186-8aed-a5a19ad11465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-6c71ebfd-3faa-4186-8aed-a5a19ad11465 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:58:34.129065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:34.130211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:58:34.131298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 583/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:34.137056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9054e-78b4-4243-87d3-31225a28ab4b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:34.231057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9054e-78b4-4243-87d3-31225a28ab4b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:34.265485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bf452-684b-463b-9a79-7a6ccba28964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:34.266079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bf452-684b-463b-9a79-7a6ccba28964 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:34.266353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bf452-684b-463b-9a79-7a6ccba28964 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:34.266618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bf452-684b-463b-9a79-7a6ccba28964 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:34.267266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bf452-684b-463b-9a79-7a6ccba28964 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:34.267561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bf452-684b-463b-9a79-7a6ccba28964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:34.268929 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bf452-684b-463b-9a79-7a6ccba28964 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:34.271054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:34.277119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 574/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:34.283146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71ebfd-3faa-4186-8aed-a5a19ad11465 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:34.380829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:34.389661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71ebfd-3faa-4186-8aed-a5a19ad11465 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:34.423060 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487d18e-7c44-4e91-a932-9e158f5f8e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:34.423737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487d18e-7c44-4e91-a932-9e158f5f8e78 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:34.424017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487d18e-7c44-4e91-a932-9e158f5f8e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:34.424315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487d18e-7c44-4e91-a932-9e158f5f8e78 None admin] PATH_INFO: `/v3/users/7eb626409e7c4bfea141e640d92eca34` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:34.425443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487d18e-7c44-4e91-a932-9e158f5f8e78 None admin] RBAC: Authorizing `identity:get_user(user_id=7eb626409e7c4bfea141e640d92eca34)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:34.426872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487d18e-7c44-4e91-a932-9e158f5f8e78 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:34.428567 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 584/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:34 2022] GET /identity/v3/users/7eb626409e7c4bfea141e640d92eca34 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:34.435545 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bf452-684b-463b-9a79-7a6ccba28964 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:34.535313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bf452-684b-463b-9a79-7a6ccba28964 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:34.571109 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a181a-c4ce-4468-ac17-6aecd7869fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:34.571710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a181a-c4ce-4468-ac17-6aecd7869fcb None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:34.572031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a181a-c4ce-4468-ac17-6aecd7869fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:34.572336 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a181a-c4ce-4468-ac17-6aecd7869fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:34.635398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:34.638794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a181a-c4ce-4468-ac17-6aecd7869fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:34.640240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a181a-c4ce-4468-ac17-6aecd7869fcb None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:34.738583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 575/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:58:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:58:34.745230 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487d18e-7c44-4e91-a932-9e158f5f8e78 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:34.843655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487d18e-7c44-4e91-a932-9e158f5f8e78 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:34.876679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47fcbff-e3d6-4302-aa89-82e67b03f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:34.877314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fcbff-e3d6-4302-aa89-82e67b03f138 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:34.877594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fcbff-e3d6-4302-aa89-82e67b03f138 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:34.877869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fcbff-e3d6-4302-aa89-82e67b03f138 None admin] PATH_INFO: `/v3/projects/224525f411ec4d55889c80d2046f7f84` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:34.878990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fcbff-e3d6-4302-aa89-82e67b03f138 None admin] RBAC: Authorizing `identity:get_project(project_id=224525f411ec4d55889c80d2046f7f84)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:34.880452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47fcbff-e3d6-4302-aa89-82e67b03f138 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:34.882234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 585/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:34 2022] GET /identity/v3/projects/224525f411ec4d55889c80d2046f7f84 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:34.888931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a181a-c4ce-4468-ac17-6aecd7869fcb None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:34.984671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:34.988633 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a181a-c4ce-4468-ac17-6aecd7869fcb None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:35.021607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d28c20-a964-45fb-8e96-d651bf33d8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:35.022213 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d28c20-a964-45fb-8e96-d651bf33d8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:35.023007 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d28c20-a964-45fb-8e96-d651bf33d8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:35.023293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d28c20-a964-45fb-8e96-d651bf33d8b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:35.024069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d28c20-a964-45fb-8e96-d651bf33d8b3 None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=224525f411ec4d55889c80d2046f7f84, user.id=7eb626409e7c4bfea141e640d92eca34) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:35.024415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d28c20-a964-45fb-8e96-d651bf33d8b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:35.025836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d28c20-a964-45fb-8e96-d651bf33d8b3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:35.031872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 576/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:58:34 2022] GET /identity/v3/role_assignments?user.id=7eb626409e7c4bfea141e640d92eca34&scope.project.id=224525f411ec4d55889c80d2046f7f84&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:36.963208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e9e0-5e7c-44cc-bce1-add858f20f35 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:36.963786 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e9e0-5e7c-44cc-bce1-add858f20f35 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:36.963786 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e9e0-5e7c-44cc-bce1-add858f20f35 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:36.965110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 586/1162] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:36.970874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56cf23-c751-4a9b-b606-83422ba73bfd None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:36.971318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56cf23-c751-4a9b-b606-83422ba73bfd None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:36.971431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56cf23-c751-4a9b-b606-83422ba73bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:36.990198 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0e56cf23-c751-4a9b-b606-83422ba73bfd None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:36.991379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0e56cf23-c751-4a9b-b606-83422ba73bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:37.058235 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 577/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:37.339873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1e9e0-5e7c-44cc-bce1-add858f20f35 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:37.370204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:37.448718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1e9e0-5e7c-44cc-bce1-add858f20f35 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:37.484841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d24cba-4158-42e5-b2da-bde1693787a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:37.485467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d24cba-4158-42e5-b2da-bde1693787a8 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:37.485745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d24cba-4158-42e5-b2da-bde1693787a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:37.486014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d24cba-4158-42e5-b2da-bde1693787a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:37.559665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d24cba-4158-42e5-b2da-bde1693787a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:37.561064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d24cba-4158-42e5-b2da-bde1693787a8 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:37.589234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:37.666102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 587/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:58:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:58:37.672173 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56cf23-c751-4a9b-b606-83422ba73bfd None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:37.780855 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:37.789951 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56cf23-c751-4a9b-b606-83422ba73bfd None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:37.831633 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed992be3-411d-4623-9a56-03261d1c6ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:37.832601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed992be3-411d-4623-9a56-03261d1c6ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:37.833078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed992be3-411d-4623-9a56-03261d1c6ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:37.833582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed992be3-411d-4623-9a56-03261d1c6ca1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:37.842445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed992be3-411d-4623-9a56-03261d1c6ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:37.844445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed992be3-411d-4623-9a56-03261d1c6ca1 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-ed992be3-411d-4623-9a56-03261d1c6ca1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:37.859403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:37.860765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:37.861849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 578/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Aug 24 16:58:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:37.866984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d24cba-4158-42e5-b2da-bde1693787a8 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:37.974967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d24cba-4158-42e5-b2da-bde1693787a8 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:38.002791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:38.010972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f449b7f-d02e-480a-be79-eb741cf59386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:38.011659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f449b7f-d02e-480a-be79-eb741cf59386 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:38.011941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f449b7f-d02e-480a-be79-eb741cf59386 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:38.012285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f449b7f-d02e-480a-be79-eb741cf59386 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:38.012936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f449b7f-d02e-480a-be79-eb741cf59386 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:38.013238 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f449b7f-d02e-480a-be79-eb741cf59386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:38.014600 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f449b7f-d02e-480a-be79-eb741cf59386 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:38.022148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 588/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Aug 24 16:58:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:39.948972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ade6af-4e68-46fb-9f5e-3e6975991c99 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:39.949549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ade6af-4e68-46fb-9f5e-3e6975991c99 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:39.949549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ade6af-4e68-46fb-9f5e-3e6975991c99 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:39.950853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 579/1167] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:39.956163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625584-f546-4c35-9e55-f58d158ba087 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:39.956578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625584-f546-4c35-9e55-f58d158ba087 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:39.956763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625584-f546-4c35-9e55-f58d158ba087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:39.974589 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-d8625584-f546-4c35-9e55-f58d158ba087 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:39.975770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d8625584-f546-4c35-9e55-f58d158ba087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:40.043158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 589/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:40.315315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ade6af-4e68-46fb-9f5e-3e6975991c99 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:40.417292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ade6af-4e68-46fb-9f5e-3e6975991c99 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:40.451090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86353f-4b9f-463d-ab8a-43453379179a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:40.451686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86353f-4b9f-463d-ab8a-43453379179a None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:40.451957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86353f-4b9f-463d-ab8a-43453379179a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:40.452221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86353f-4b9f-463d-ab8a-43453379179a None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:40.452904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86353f-4b9f-463d-ab8a-43453379179a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:40.454233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86353f-4b9f-463d-ab8a-43453379179a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:40.559615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 580/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Wed Aug 24 16:58:40 2022] POST /identity/v3/domains => generated 267 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:58:42.519683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa014148-7b6b-41ee-aa2d-b0a1eb5858b3 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:42.520210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa014148-7b6b-41ee-aa2d-b0a1eb5858b3 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:42.520329 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa014148-7b6b-41ee-aa2d-b0a1eb5858b3 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:42.521616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 590/1170] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:42.527599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4edb7c-abd7-49be-babf-ab341d0b3a0f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:42.528083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4edb7c-abd7-49be-babf-ab341d0b3a0f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:42.528185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4edb7c-abd7-49be-babf-ab341d0b3a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:42.546335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ad4edb7c-abd7-49be-babf-ab341d0b3a0f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:42.547434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ad4edb7c-abd7-49be-babf-ab341d0b3a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:42.555347 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:42.613394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 581/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:42.888576 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa014148-7b6b-41ee-aa2d-b0a1eb5858b3 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:42.989288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa014148-7b6b-41ee-aa2d-b0a1eb5858b3 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:43.012621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:43.023968 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f432e1-6817-4db7-8d29-21be88279392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:43.024623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f432e1-6817-4db7-8d29-21be88279392 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:43.024904 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f432e1-6817-4db7-8d29-21be88279392 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:43.025175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f432e1-6817-4db7-8d29-21be88279392 None admin] PATH_INFO: `/v3/domains/a9a4b85ed43d4c03a32d317d6449a41b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:43.035134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f432e1-6817-4db7-8d29-21be88279392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a9a4b85ed43d4c03a32d317d6449a41b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:43.036596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f432e1-6817-4db7-8d29-21be88279392 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:43.038171 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 591/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Aug 24 16:58:42 2022] GET /identity/v3/domains/a9a4b85ed43d4c03a32d317d6449a41b => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:43.044138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4edb7c-abd7-49be-babf-ab341d0b3a0f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:43.151507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4edb7c-abd7-49be-babf-ab341d0b3a0f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:43.192080 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced3106-2d1c-4326-ba2e-d50ea511c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:43.192729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced3106-2d1c-4326-ba2e-d50ea511c166 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:43.193013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced3106-2d1c-4326-ba2e-d50ea511c166 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:43.193288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced3106-2d1c-4326-ba2e-d50ea511c166 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:43.193954 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced3106-2d1c-4326-ba2e-d50ea511c166 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:43.196474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced3106-2d1c-4326-ba2e-d50ea511c166 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:43.213357 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:43.370348 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 582/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 16:58:43 2022] POST /identity/v3/projects => generated 361 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:58:45.324485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1ff85-af23-4c90-a277-960cbb30ea50 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:45.325003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1ff85-af23-4c90-a277-960cbb30ea50 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:45.325003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1ff85-af23-4c90-a277-960cbb30ea50 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:45.326365 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 592/1174] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:45.331666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910cc5-2cbb-4c79-9558-8533e2c1aa79 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:45.332047 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910cc5-2cbb-4c79-9558-8533e2c1aa79 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:45.332209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910cc5-2cbb-4c79-9558-8533e2c1aa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:45.350441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-81910cc5-2cbb-4c79-9558-8533e2c1aa79 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:45.352254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-81910cc5-2cbb-4c79-9558-8533e2c1aa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:45.418018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 583/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:45.686486 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1ff85-af23-4c90-a277-960cbb30ea50 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:45.789682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1ff85-af23-4c90-a277-960cbb30ea50 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:45.822838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfea4c-136e-46b8-b163-06fd74d4426c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:45.823474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfea4c-136e-46b8-b163-06fd74d4426c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:45.823755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfea4c-136e-46b8-b163-06fd74d4426c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:45.824058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfea4c-136e-46b8-b163-06fd74d4426c None admin] PATH_INFO: `/v3/domains/a9a4b85ed43d4c03a32d317d6449a41b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:45.825209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfea4c-136e-46b8-b163-06fd74d4426c None admin] RBAC: Authorizing `identity:get_domain(domain_id=a9a4b85ed43d4c03a32d317d6449a41b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:45.826647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfea4c-136e-46b8-b163-06fd74d4426c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:45.828221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 593/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Aug 24 16:58:45 2022] GET /identity/v3/domains/a9a4b85ed43d4c03a32d317d6449a41b => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:45.834048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910cc5-2cbb-4c79-9558-8533e2c1aa79 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:45.935236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910cc5-2cbb-4c79-9558-8533e2c1aa79 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:45.958999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:45.969697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc8b3c-436a-4c15-aa6d-f86216739b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:45.970302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc8b3c-436a-4c15-aa6d-f86216739b99 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:45.970582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc8b3c-436a-4c15-aa6d-f86216739b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:45.970582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc8b3c-436a-4c15-aa6d-f86216739b99 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:45.970582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc8b3c-436a-4c15-aa6d-f86216739b99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:45.977646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc8b3c-436a-4c15-aa6d-f86216739b99 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:46.077165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 584/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 16:58:45 2022] POST /identity/v3/users => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:58:48.034317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaa0b2-8dd0-4318-8b28-3111122ede1c None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:48.034955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaa0b2-8dd0-4318-8b28-3111122ede1c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:48.034955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaa0b2-8dd0-4318-8b28-3111122ede1c None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:48.036173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 594/1178] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:48.042097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33fd31-5ecd-4ea4-ad19-07ee3f80626f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:48.042543 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33fd31-5ecd-4ea4-ad19-07ee3f80626f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:48.042657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33fd31-5ecd-4ea4-ad19-07ee3f80626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:48.061697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4a33fd31-5ecd-4ea4-ad19-07ee3f80626f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:48.062884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4a33fd31-5ecd-4ea4-ad19-07ee3f80626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:48.128003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 585/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:48.398752 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaa0b2-8dd0-4318-8b28-3111122ede1c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:48.450104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:48.504486 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaa0b2-8dd0-4318-8b28-3111122ede1c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:48.537613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca92d06-d1f4-48a4-a4ac-2f95c5430a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:48.538236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca92d06-d1f4-48a4-a4ac-2f95c5430a1d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:48.538623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca92d06-d1f4-48a4-a4ac-2f95c5430a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:48.538915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca92d06-d1f4-48a4-a4ac-2f95c5430a1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:48.549574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca92d06-d1f4-48a4-a4ac-2f95c5430a1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-eca92d06-d1f4-48a4-a4ac-2f95c5430a1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:58:48.555696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:48.556744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:58:48.557680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 595/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:48.562959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33fd31-5ecd-4ea4-ad19-07ee3f80626f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:48.660248 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33fd31-5ecd-4ea4-ad19-07ee3f80626f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:48.671624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:48.695189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d6787-f8f4-4065-a6bc-3e4ec66e6755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:48.695792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d6787-f8f4-4065-a6bc-3e4ec66e6755 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:48.696067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d6787-f8f4-4065-a6bc-3e4ec66e6755 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:48.696371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d6787-f8f4-4065-a6bc-3e4ec66e6755 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:48.697028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d6787-f8f4-4065-a6bc-3e4ec66e6755 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:48.697325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d6787-f8f4-4065-a6bc-3e4ec66e6755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:48.698846 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d6787-f8f4-4065-a6bc-3e4ec66e6755 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:48.706691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 586/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:58:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:48.712946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca92d06-d1f4-48a4-a4ac-2f95c5430a1d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:48.813016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca92d06-d1f4-48a4-a4ac-2f95c5430a1d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:48.822800 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:48.844908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d0eb4-ee36-4bca-8aeb-edbad4b8a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:48.845542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0eb4-ee36-4bca-8aeb-edbad4b8a622 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:48.845855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0eb4-ee36-4bca-8aeb-edbad4b8a622 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:48.846132 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0eb4-ee36-4bca-8aeb-edbad4b8a622 None admin] PATH_INFO: `/v3/users/bb3272816cf54fa48e6eeca25e13a9af` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:48.860155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d0eb4-ee36-4bca-8aeb-edbad4b8a622 None admin] RBAC: Authorizing `identity:get_user(user_id=bb3272816cf54fa48e6eeca25e13a9af)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:48.864517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d0eb4-ee36-4bca-8aeb-edbad4b8a622 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:48.864517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 596/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:48 2022] GET /identity/v3/users/bb3272816cf54fa48e6eeca25e13a9af => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:48.870252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d6787-f8f4-4065-a6bc-3e4ec66e6755 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:48.975599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d6787-f8f4-4065-a6bc-3e4ec66e6755 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:49.009782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c384214-3fd9-42dc-8fb9-db1e1c55d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:49.010385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c384214-3fd9-42dc-8fb9-db1e1c55d1aa None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:49.010669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c384214-3fd9-42dc-8fb9-db1e1c55d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:49.010941 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c384214-3fd9-42dc-8fb9-db1e1c55d1aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:49.051774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:49.077554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c384214-3fd9-42dc-8fb9-db1e1c55d1aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:49.078928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c384214-3fd9-42dc-8fb9-db1e1c55d1aa None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:49.177012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 587/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:58:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 16:58:49.183443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d0eb4-ee36-4bca-8aeb-edbad4b8a622 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:49.281276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d0eb4-ee36-4bca-8aeb-edbad4b8a622 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:49.317023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821590b9-f0d6-4ee8-9c18-4c6d60b5dafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:49.317685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821590b9-f0d6-4ee8-9c18-4c6d60b5dafb None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:49.317965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821590b9-f0d6-4ee8-9c18-4c6d60b5dafb None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:49.318237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821590b9-f0d6-4ee8-9c18-4c6d60b5dafb None admin] PATH_INFO: `/v3/projects/050de25d8d644f008efa0bf7941b5937` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:49.319345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821590b9-f0d6-4ee8-9c18-4c6d60b5dafb None admin] RBAC: Authorizing `identity:get_project(project_id=050de25d8d644f008efa0bf7941b5937)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:49.321349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821590b9-f0d6-4ee8-9c18-4c6d60b5dafb None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:49.322978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 597/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:49 2022] GET /identity/v3/projects/050de25d8d644f008efa0bf7941b5937 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:49.329344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c384214-3fd9-42dc-8fb9-db1e1c55d1aa None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:49.397596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:49.427145 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c384214-3fd9-42dc-8fb9-db1e1c55d1aa None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:49.461720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc72de-9143-40c8-bb0e-1c7ec4683985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:49.462313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc72de-9143-40c8-bb0e-1c7ec4683985 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:49.462591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc72de-9143-40c8-bb0e-1c7ec4683985 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:49.462859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc72de-9143-40c8-bb0e-1c7ec4683985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:49.463579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc72de-9143-40c8-bb0e-1c7ec4683985 None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=050de25d8d644f008efa0bf7941b5937, user.id=bb3272816cf54fa48e6eeca25e13a9af) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:49.463883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc72de-9143-40c8-bb0e-1c7ec4683985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:49.465316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc72de-9143-40c8-bb0e-1c7ec4683985 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:49.470598 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 588/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:58:49 2022] GET /identity/v3/role_assignments?user.id=bb3272816cf54fa48e6eeca25e13a9af&scope.project.id=050de25d8d644f008efa0bf7941b5937&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:58:51.362567 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99baea9-869b-47d1-91a4-bddd710e462c None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:51.363125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99baea9-869b-47d1-91a4-bddd710e462c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:51.363125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99baea9-869b-47d1-91a4-bddd710e462c None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:51.364511 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 598/1186] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:51.370301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237b33b-8c1d-4a43-ae43-a39294bfe25c None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:51.370718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237b33b-8c1d-4a43-ae43-a39294bfe25c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:51.370851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237b33b-8c1d-4a43-ae43-a39294bfe25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:51.388973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4237b33b-8c1d-4a43-ae43-a39294bfe25c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:51.390156 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4237b33b-8c1d-4a43-ae43-a39294bfe25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:51.455366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 589/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:51.719606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99baea9-869b-47d1-91a4-bddd710e462c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:51.756059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:51.821659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99baea9-869b-47d1-91a4-bddd710e462c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:51.854876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8776f-cf1b-4dd5-b2f8-2d9e420ac3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:51.855495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8776f-cf1b-4dd5-b2f8-2d9e420ac3ff None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:51.855763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8776f-cf1b-4dd5-b2f8-2d9e420ac3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:51.856027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8776f-cf1b-4dd5-b2f8-2d9e420ac3ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:51.865884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8776f-cf1b-4dd5-b2f8-2d9e420ac3ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-59d8776f-cf1b-4dd5-b2f8-2d9e420ac3ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:58:51.870776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:51.871970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:51.873162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 16:58:51.876395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 599/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:51.879283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237b33b-8c1d-4a43-ae43-a39294bfe25c None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:51.943985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:51.977949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237b33b-8c1d-4a43-ae43-a39294bfe25c None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:52.016610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31005fe-c450-4122-be15-edff335b9878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:52.017223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31005fe-c450-4122-be15-edff335b9878 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:52.017506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31005fe-c450-4122-be15-edff335b9878 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:52.017779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31005fe-c450-4122-be15-edff335b9878 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:52.018610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31005fe-c450-4122-be15-edff335b9878 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:52.018989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31005fe-c450-4122-be15-edff335b9878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:52.020394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31005fe-c450-4122-be15-edff335b9878 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:52.028851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 590/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:52.034717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8776f-cf1b-4dd5-b2f8-2d9e420ac3ff None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:52.128243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:52.134428 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8776f-cf1b-4dd5-b2f8-2d9e420ac3ff None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:52.166945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57c967-5102-4b70-b556-5086ef8ffe72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:52.167574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c967-5102-4b70-b556-5086ef8ffe72 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:52.167855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c967-5102-4b70-b556-5086ef8ffe72 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:52.168129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57c967-5102-4b70-b556-5086ef8ffe72 None admin] PATH_INFO: `/v3/users/bb3272816cf54fa48e6eeca25e13a9af` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:52.169299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57c967-5102-4b70-b556-5086ef8ffe72 None admin] RBAC: Authorizing `identity:get_user(user_id=bb3272816cf54fa48e6eeca25e13a9af)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:52.170728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57c967-5102-4b70-b556-5086ef8ffe72 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:52.172321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 600/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:52 2022] GET /identity/v3/users/bb3272816cf54fa48e6eeca25e13a9af => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:52.178282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31005fe-c450-4122-be15-edff335b9878 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:52.281610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31005fe-c450-4122-be15-edff335b9878 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:52.308421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:52.315768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81b9c9-3656-4cbe-8b93-049928ffd191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:52.316424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81b9c9-3656-4cbe-8b93-049928ffd191 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:52.316699 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81b9c9-3656-4cbe-8b93-049928ffd191 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:52.316967 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81b9c9-3656-4cbe-8b93-049928ffd191 None admin] PATH_INFO: `/v3/projects/050de25d8d644f008efa0bf7941b5937` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:52.318052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81b9c9-3656-4cbe-8b93-049928ffd191 None admin] RBAC: Authorizing `identity:get_project(project_id=050de25d8d644f008efa0bf7941b5937)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:52.319557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81b9c9-3656-4cbe-8b93-049928ffd191 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:52.321276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 591/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:52 2022] GET /identity/v3/projects/050de25d8d644f008efa0bf7941b5937 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:52.327302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57c967-5102-4b70-b556-5086ef8ffe72 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:52.426875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57c967-5102-4b70-b556-5086ef8ffe72 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:52.461517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7a476-4c2a-4ff6-8fe5-bf03f3368359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:52.462164 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a476-4c2a-4ff6-8fe5-bf03f3368359 None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:52.462445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a476-4c2a-4ff6-8fe5-bf03f3368359 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:52.462719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a476-4c2a-4ff6-8fe5-bf03f3368359 None admin] PATH_INFO: `/v3/projects/050de25d8d644f008efa0bf7941b5937/users/bb3272816cf54fa48e6eeca25e13a9af/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:52.464682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7a476-4c2a-4ff6-8fe5-bf03f3368359 None admin] RBAC: Authorizing `identity:create_grant(project_id=050de25d8d644f008efa0bf7941b5937, user_id=bb3272816cf54fa48e6eeca25e13a9af, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:52.466118 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7a476-4c2a-4ff6-8fe5-bf03f3368359 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:52.548166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 601/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 16:58:52 2022] PUT /identity/v3/projects/050de25d8d644f008efa0bf7941b5937/users/bb3272816cf54fa48e6eeca25e13a9af/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:58:54.461179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229f6cf-a4d7-4d64-a150-073ecbcc291b None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:54.461702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229f6cf-a4d7-4d64-a150-073ecbcc291b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:54.461810 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229f6cf-a4d7-4d64-a150-073ecbcc291b None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:54.463066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 592/1193] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 16:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:58:54.468500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbdd0b-2bba-476a-a976-13e1da8bc51d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:54.468897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbdd0b-2bba-476a-a976-13e1da8bc51d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:54.469057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbdd0b-2bba-476a-a976-13e1da8bc51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:54.487243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-8ecbdd0b-2bba-476a-a976-13e1da8bc51d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:58:54.488441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8ecbdd0b-2bba-476a-a976-13e1da8bc51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:58:54.505196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:54.554975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 602/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 16:58:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:58:54.829273 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229f6cf-a4d7-4d64-a150-073ecbcc291b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:54.934364 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229f6cf-a4d7-4d64-a150-073ecbcc291b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:54.968095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07903c66-0f6f-482a-a9ae-a5c3ea4d9538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:54.968792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07903c66-0f6f-482a-a9ae-a5c3ea4d9538 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:54.969016 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07903c66-0f6f-482a-a9ae-a5c3ea4d9538 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:54.969282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07903c66-0f6f-482a-a9ae-a5c3ea4d9538 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:54.979193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07903c66-0f6f-482a-a9ae-a5c3ea4d9538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-07903c66-0f6f-482a-a9ae-a5c3ea4d9538 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:58:54.983816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:58:54.984982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 16:58:54.985885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 593/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 16:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:58:54.991746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbdd0b-2bba-476a-a976-13e1da8bc51d None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:55.089173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbdd0b-2bba-476a-a976-13e1da8bc51d None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:55.122588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee100-ebfe-46f8-aa22-3464b9bd02de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:55.123197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee100-ebfe-46f8-aa22-3464b9bd02de None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:55.123478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee100-ebfe-46f8-aa22-3464b9bd02de None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:55.123754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee100-ebfe-46f8-aa22-3464b9bd02de None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:55.124441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ee100-ebfe-46f8-aa22-3464b9bd02de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:55.124747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ee100-ebfe-46f8-aa22-3464b9bd02de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:55.126112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ee100-ebfe-46f8-aa22-3464b9bd02de None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:55.134653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 603/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 16:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:55.140547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07903c66-0f6f-482a-a9ae-a5c3ea4d9538 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:55.198049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:55.239892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07903c66-0f6f-482a-a9ae-a5c3ea4d9538 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:55.273698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf87a98-18b8-4201-863b-56659f286b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:55.274337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf87a98-18b8-4201-863b-56659f286b66 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:55.274614 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf87a98-18b8-4201-863b-56659f286b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:55.274885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf87a98-18b8-4201-863b-56659f286b66 None admin] PATH_INFO: `/v3/users/bb3272816cf54fa48e6eeca25e13a9af` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:55.275996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf87a98-18b8-4201-863b-56659f286b66 None admin] RBAC: Authorizing `identity:get_user(user_id=bb3272816cf54fa48e6eeca25e13a9af)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:55.277472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf87a98-18b8-4201-863b-56659f286b66 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:55.279042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 594/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Aug 24 16:58:55 2022] GET /identity/v3/users/bb3272816cf54fa48e6eeca25e13a9af => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:55.285137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee100-ebfe-46f8-aa22-3464b9bd02de None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:55.305626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:55.385180 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee100-ebfe-46f8-aa22-3464b9bd02de None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:55.418307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c0a14-4821-409d-8573-addbf996680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:55.418907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c0a14-4821-409d-8573-addbf996680d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:55.419183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c0a14-4821-409d-8573-addbf996680d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:55.419448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c0a14-4821-409d-8573-addbf996680d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:55.484641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c0a14-4821-409d-8573-addbf996680d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:55.486086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c0a14-4821-409d-8573-addbf996680d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:55.502900 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:55.581557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 604/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 16:58:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:58:55.587546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf87a98-18b8-4201-863b-56659f286b66 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:55.688332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf87a98-18b8-4201-863b-56659f286b66 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:55.712007 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:55.722560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3eb0a-ec00-4b22-861c-59e7f54cad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:55.725034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3eb0a-ec00-4b22-861c-59e7f54cad9d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:55.725034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3eb0a-ec00-4b22-861c-59e7f54cad9d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:55.725034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3eb0a-ec00-4b22-861c-59e7f54cad9d None admin] PATH_INFO: `/v3/projects/050de25d8d644f008efa0bf7941b5937` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:55.725034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3eb0a-ec00-4b22-861c-59e7f54cad9d None admin] RBAC: Authorizing `identity:get_project(project_id=050de25d8d644f008efa0bf7941b5937)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:55.727079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3eb0a-ec00-4b22-861c-59e7f54cad9d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:55.728738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 595/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Aug 24 16:58:55 2022] GET /identity/v3/projects/050de25d8d644f008efa0bf7941b5937 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:58:55.734847 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c0a14-4821-409d-8573-addbf996680d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:58:55.832653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c0a14-4821-409d-8573-addbf996680d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:58:55.849444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:58:55.867616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6534e-cac8-4d7f-b38e-3d232e1cace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:58:55.868213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6534e-cac8-4d7f-b38e-3d232e1cace5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:58:55.868570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6534e-cac8-4d7f-b38e-3d232e1cace5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:58:55.868873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6534e-cac8-4d7f-b38e-3d232e1cace5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:58:55.869674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6534e-cac8-4d7f-b38e-3d232e1cace5 None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=050de25d8d644f008efa0bf7941b5937, user.id=bb3272816cf54fa48e6eeca25e13a9af) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:58:55.869983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6534e-cac8-4d7f-b38e-3d232e1cace5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:58:55.871425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6534e-cac8-4d7f-b38e-3d232e1cace5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:58:55.877503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 605/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 16:58:55 2022] GET /identity/v3/role_assignments?user.id=bb3272816cf54fa48e6eeca25e13a9af&scope.project.id=050de25d8d644f008efa0bf7941b5937&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:59:05.747736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:59:05.885466 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=10 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:15.221941 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4466228-0d41-4ba0-87dd-14c4865b27de None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:15.222627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4466228-0d41-4ba0-87dd-14c4865b27de None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:15.222627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4466228-0d41-4ba0-87dd-14c4865b27de None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:15.223857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 596/1201] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:00:15.229128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb70ad-e313-4438-87ef-b32a1929e0ae None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:15.231151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb70ad-e313-4438-87ef-b32a1929e0ae None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:15.231151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb70ad-e313-4438-87ef-b32a1929e0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:15.248545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-2afb70ad-e313-4438-87ef-b32a1929e0ae None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:00:15.249810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2afb70ad-e313-4438-87ef-b32a1929e0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:00:15.319471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 606/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:00:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:00:15.594758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4466228-0d41-4ba0-87dd-14c4865b27de None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:15.700349 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4466228-0d41-4ba0-87dd-14c4865b27de None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:15.736934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e9574-28fe-4713-87c7-62bec57842fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:15.737587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e9574-28fe-4713-87c7-62bec57842fc None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:15.737869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e9574-28fe-4713-87c7-62bec57842fc None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:15.738143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e9574-28fe-4713-87c7-62bec57842fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:15.750414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e9574-28fe-4713-87c7-62bec57842fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:15.753349 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e9574-28fe-4713-87c7-62bec57842fc None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-330e9574-28fe-4713-87c7-62bec57842fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:15.768534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:15.769679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:15.770719 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:15.770719 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:15.770719 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:15.770719 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 597/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:15.776344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb70ad-e313-4438-87ef-b32a1929e0ae None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:15.891911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb70ad-e313-4438-87ef-b32a1929e0ae None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:15.929263 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:15.935984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d19ad-86ee-4430-86e3-3f1e8a48820f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:15.936670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d19ad-86ee-4430-86e3-3f1e8a48820f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:15.937023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d19ad-86ee-4430-86e3-3f1e8a48820f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:15.937305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d19ad-86ee-4430-86e3-3f1e8a48820f None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:15.937961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d19ad-86ee-4430-86e3-3f1e8a48820f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:15.938272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d19ad-86ee-4430-86e3-3f1e8a48820f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:15.939699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d19ad-86ee-4430-86e3-3f1e8a48820f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:15.952661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 607/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:15.958628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e9574-28fe-4713-87c7-62bec57842fc None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:16.015511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:16.064961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e9574-28fe-4713-87c7-62bec57842fc None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:16.097174 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ae55d-12b0-4e92-b477-a6badd431a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:16.097768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae55d-12b0-4e92-b477-a6badd431a45 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:16.098045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae55d-12b0-4e92-b477-a6badd431a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:16.098314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae55d-12b0-4e92-b477-a6badd431a45 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:16.098953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ae55d-12b0-4e92-b477-a6badd431a45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:16.100442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ae55d-12b0-4e92-b477-a6badd431a45 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:16.242685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 598/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Aug 24 17:00:15 2022] POST /identity/v3/users => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:00:18.197675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c8d65-8a0e-4809-b41e-fcaa71ba4409 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:18.198302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c8d65-8a0e-4809-b41e-fcaa71ba4409 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:18.198302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c8d65-8a0e-4809-b41e-fcaa71ba4409 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:18.199634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 608/1206] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:00:18.205109 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c539b8-d94d-4635-aa17-0e6a6f6839f4 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:18.205557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c539b8-d94d-4635-aa17-0e6a6f6839f4 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:18.205684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c539b8-d94d-4635-aa17-0e6a6f6839f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:18.224517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b0c539b8-d94d-4635-aa17-0e6a6f6839f4 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:00:18.225703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b0c539b8-d94d-4635-aa17-0e6a6f6839f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:00:18.293983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 599/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:00:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:00:18.565574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c8d65-8a0e-4809-b41e-fcaa71ba4409 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:18.672675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c8d65-8a0e-4809-b41e-fcaa71ba4409 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:18.707460 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fbba1-c15c-4b1d-97f7-17cc7c1312d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:18.708091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fbba1-c15c-4b1d-97f7-17cc7c1312d5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:18.708402 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fbba1-c15c-4b1d-97f7-17cc7c1312d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:18.708675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fbba1-c15c-4b1d-97f7-17cc7c1312d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:18.720200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fbba1-c15c-4b1d-97f7-17cc7c1312d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-7d7fbba1-c15c-4b1d-97f7-17cc7c1312d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:00:18.725074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:18.726235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:18.727290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 609/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 17:00:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:18.733283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c539b8-d94d-4635-aa17-0e6a6f6839f4 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:18.771964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:18.832812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c539b8-d94d-4635-aa17-0e6a6f6839f4 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:18.868089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea31088-ecc0-475c-898a-732629102b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:18.868724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31088-ecc0-475c-898a-732629102b1c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:18.869002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31088-ecc0-475c-898a-732629102b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:18.869270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31088-ecc0-475c-898a-732629102b1c None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:18.869934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea31088-ecc0-475c-898a-732629102b1c None admin] RBAC: Adding query filter params (name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:18.870234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea31088-ecc0-475c-898a-732629102b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:18.871653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea31088-ecc0-475c-898a-732629102b1c None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:18.879792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 600/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 17:00:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:18.886209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fbba1-c15c-4b1d-97f7-17cc7c1312d5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:18.938044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:18.988616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fbba1-c15c-4b1d-97f7-17cc7c1312d5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:19.021193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82885bf9-ea67-470e-b3ef-fa79568f0437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:19.021846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885bf9-ea67-470e-b3ef-fa79568f0437 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:19.022153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885bf9-ea67-470e-b3ef-fa79568f0437 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:19.022429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885bf9-ea67-470e-b3ef-fa79568f0437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:19.034027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82885bf9-ea67-470e-b3ef-fa79568f0437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:19.035509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82885bf9-ea67-470e-b3ef-fa79568f0437 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-82885bf9-ea67-470e-b3ef-fa79568f0437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:19.050098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:19.051520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:19.052628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:19.052628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:19.052628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:19.052628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 610/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:19.057592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea31088-ecc0-475c-898a-732629102b1c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:19.162672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:19.165549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea31088-ecc0-475c-898a-732629102b1c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:19.199354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5852-a753-404d-99b4-1c7b05b875b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:19.200040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5852-a753-404d-99b4-1c7b05b875b3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:19.200530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5852-a753-404d-99b4-1c7b05b875b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:19.200530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c5852-a753-404d-99b4-1c7b05b875b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:19.201269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c5852-a753-404d-99b4-1c7b05b875b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:19.201561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c5852-a753-404d-99b4-1c7b05b875b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:19.202976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c5852-a753-404d-99b4-1c7b05b875b3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:19.214060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 601/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:19.220647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82885bf9-ea67-470e-b3ef-fa79568f0437 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:19.321794 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82885bf9-ea67-470e-b3ef-fa79568f0437 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:19.325167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:19.356957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0598ec7-7c94-4b29-bb44-a13ba8981c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:19.357669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598ec7-7c94-4b29-bb44-a13ba8981c11 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:19.358117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598ec7-7c94-4b29-bb44-a13ba8981c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:19.358394 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598ec7-7c94-4b29-bb44-a13ba8981c11 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:19.366529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0598ec7-7c94-4b29-bb44-a13ba8981c11 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:19.371017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0598ec7-7c94-4b29-bb44-a13ba8981c11 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-c0598ec7-7c94-4b29-bb44-a13ba8981c11 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:00:19.378838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:19.379978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:19.381343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:19.381343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:19.381343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:00:19.381343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:00:19.381343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:00:19.381343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:00:19.381343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:00:19.381343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:00:19.381343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:19.381343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:19.381343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 611/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:19.385935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5852-a753-404d-99b4-1c7b05b875b3 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:19.489554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c5852-a753-404d-99b4-1c7b05b875b3 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:19.523218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968df901-b6bb-44f7-ad80-b09982590161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:19.523818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968df901-b6bb-44f7-ad80-b09982590161 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:19.524093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968df901-b6bb-44f7-ad80-b09982590161 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:19.524393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968df901-b6bb-44f7-ad80-b09982590161 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:19.525113 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968df901-b6bb-44f7-ad80-b09982590161 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:19.525416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968df901-b6bb-44f7-ad80-b09982590161 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:19.526825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968df901-b6bb-44f7-ad80-b09982590161 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:19.543393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 602/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Aug 24 17:00:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:19.549374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0598ec7-7c94-4b29-bb44-a13ba8981c11 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:19.651028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0598ec7-7c94-4b29-bb44-a13ba8981c11 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:19.685287 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c85c6-8148-444b-bc3c-57139bf92e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:19.685975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c85c6-8148-444b-bc3c-57139bf92e38 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:19.686255 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c85c6-8148-444b-bc3c-57139bf92e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:19.686534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c85c6-8148-444b-bc3c-57139bf92e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:19.716548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:19.753388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c85c6-8148-444b-bc3c-57139bf92e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:19.754774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c85c6-8148-444b-bc3c-57139bf92e38 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:19.853743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 612/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 17:00:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:00:19.860024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968df901-b6bb-44f7-ad80-b09982590161 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:19.879497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:19.961180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968df901-b6bb-44f7-ad80-b09982590161 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:19.995903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e605ac-26b7-4a96-b19f-f8ccfc608e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:20.004081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e605ac-26b7-4a96-b19f-f8ccfc608e87 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:20.004081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e605ac-26b7-4a96-b19f-f8ccfc608e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:20.004081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e605ac-26b7-4a96-b19f-f8ccfc608e87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:20.007067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e605ac-26b7-4a96-b19f-f8ccfc608e87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:20.008532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e605ac-26b7-4a96-b19f-f8ccfc608e87 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-47e605ac-26b7-4a96-b19f-f8ccfc608e87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:20.023429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:20.024737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:20.026038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:20.026038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:20.026038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:20.026038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 603/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:20.031026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c85c6-8148-444b-bc3c-57139bf92e38 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:20.091686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:20.130470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c85c6-8148-444b-bc3c-57139bf92e38 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:20.167323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40851d7-be00-4464-bc51-6e486ccbaf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:20.167927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40851d7-be00-4464-bc51-6e486ccbaf9d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:20.168206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40851d7-be00-4464-bc51-6e486ccbaf9d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:20.168512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40851d7-be00-4464-bc51-6e486ccbaf9d None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:20.169151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40851d7-be00-4464-bc51-6e486ccbaf9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:20.169455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40851d7-be00-4464-bc51-6e486ccbaf9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:20.170872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40851d7-be00-4464-bc51-6e486ccbaf9d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:20.183061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 613/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:20.189339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e605ac-26b7-4a96-b19f-f8ccfc608e87 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:20.260942 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:20.292212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e605ac-26b7-4a96-b19f-f8ccfc608e87 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:20.326104 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d84033-4ce0-4be5-b147-0ac88a7c19b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:20.326722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84033-4ce0-4be5-b147-0ac88a7c19b7 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:20.327004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84033-4ce0-4be5-b147-0ac88a7c19b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:20.327277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d84033-4ce0-4be5-b147-0ac88a7c19b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:20.333766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d84033-4ce0-4be5-b147-0ac88a7c19b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:20.338302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d84033-4ce0-4be5-b147-0ac88a7c19b7 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-58d84033-4ce0-4be5-b147-0ac88a7c19b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:00:20.346628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:20.347708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:20.348666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:00:20.348666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:00:20.348666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:00:20.348666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:00:20.348666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:00:20.348666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:00:20.348666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:20.348666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:20.348666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 604/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 17:00:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:20.353998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40851d7-be00-4464-bc51-6e486ccbaf9d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:20.461063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40851d7-be00-4464-bc51-6e486ccbaf9d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:20.486760 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:20.499062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd85ecd-d008-428c-81ad-71a889f5ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:20.499665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85ecd-d008-428c-81ad-71a889f5ade7 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:20.499941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85ecd-d008-428c-81ad-71a889f5ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:20.500207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd85ecd-d008-428c-81ad-71a889f5ade7 None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:20.500917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd85ecd-d008-428c-81ad-71a889f5ade7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:20.501221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd85ecd-d008-428c-81ad-71a889f5ade7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:20.502641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd85ecd-d008-428c-81ad-71a889f5ade7 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:20.515030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 614/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 17:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:20.521455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d84033-4ce0-4be5-b147-0ac88a7c19b7 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:20.625124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d84033-4ce0-4be5-b147-0ac88a7c19b7 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:20.653584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:20.659320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ea0f-b7e1-4308-9891-3d0007cc2b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:20.659924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ea0f-b7e1-4308-9891-3d0007cc2b8a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:20.660200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ea0f-b7e1-4308-9891-3d0007cc2b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:20.666249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ea0f-b7e1-4308-9891-3d0007cc2b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:20.666249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543ea0f-b7e1-4308-9891-3d0007cc2b8a None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=a698e566a46841cf83aa1711e83f8829) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:20.666249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543ea0f-b7e1-4308-9891-3d0007cc2b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:20.666249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543ea0f-b7e1-4308-9891-3d0007cc2b8a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:20.669418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 605/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 17:00:20 2022] GET /identity/v3/role_assignments?user.id=a698e566a46841cf83aa1711e83f8829&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:22.580792 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3666983-09fb-4d76-941a-d67b7e64fb2d None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:22.581308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3666983-09fb-4d76-941a-d67b7e64fb2d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:22.581308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3666983-09fb-4d76-941a-d67b7e64fb2d None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:22.582577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 615/1220] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:00:22.587825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70d83f-4486-4663-9e9f-0cbf0f7c5ea2 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:22.597065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70d83f-4486-4663-9e9f-0cbf0f7c5ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:22.597065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70d83f-4486-4663-9e9f-0cbf0f7c5ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:22.607131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-2b70d83f-4486-4663-9e9f-0cbf0f7c5ea2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:00:22.608388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2b70d83f-4486-4663-9e9f-0cbf0f7c5ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:00:22.674127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 606/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:00:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:00:22.949277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3666983-09fb-4d76-941a-d67b7e64fb2d None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:23.051354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3666983-09fb-4d76-941a-d67b7e64fb2d None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:23.085687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e8c7b-d3e0-4b83-8864-4c5c40a3405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:23.086274 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e8c7b-d3e0-4b83-8864-4c5c40a3405a None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:23.086553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e8c7b-d3e0-4b83-8864-4c5c40a3405a None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:23.086827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e8c7b-d3e0-4b83-8864-4c5c40a3405a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:23.097388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e8c7b-d3e0-4b83-8864-4c5c40a3405a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-dc3e8c7b-d3e0-4b83-8864-4c5c40a3405a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:00:23.102239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:23.103345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:23.104190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 616/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 17:00:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:23.109645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70d83f-4486-4663-9e9f-0cbf0f7c5ea2 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:23.212956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70d83f-4486-4663-9e9f-0cbf0f7c5ea2 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:23.236285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:23.247671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2504443-cf53-4d51-b64f-a56e1457efdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:23.248289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2504443-cf53-4d51-b64f-a56e1457efdc None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:23.249300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2504443-cf53-4d51-b64f-a56e1457efdc None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:23.249300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2504443-cf53-4d51-b64f-a56e1457efdc None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:23.249529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2504443-cf53-4d51-b64f-a56e1457efdc None admin] RBAC: Adding query filter params (name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:23.249810 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2504443-cf53-4d51-b64f-a56e1457efdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:23.251187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2504443-cf53-4d51-b64f-a56e1457efdc None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:23.258847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 607/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 17:00:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:23.265410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e8c7b-d3e0-4b83-8864-4c5c40a3405a None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:23.312827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:23.368088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e8c7b-d3e0-4b83-8864-4c5c40a3405a None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:23.402956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156c9f2-3e8b-4676-835b-ae2f33e84732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:23.403582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156c9f2-3e8b-4676-835b-ae2f33e84732 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:23.403864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156c9f2-3e8b-4676-835b-ae2f33e84732 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:23.404140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156c9f2-3e8b-4676-835b-ae2f33e84732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:23.414439 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156c9f2-3e8b-4676-835b-ae2f33e84732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:23.415994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156c9f2-3e8b-4676-835b-ae2f33e84732 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-8156c9f2-3e8b-4676-835b-ae2f33e84732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:23.431113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:23.432297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:23.434138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:23.434138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:23.434138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:23.434138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 617/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 17:00:23.438945 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2504443-cf53-4d51-b64f-a56e1457efdc None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:23.541793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2504443-cf53-4d51-b64f-a56e1457efdc None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:23.576040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a18c3a-a4e3-4a3b-ad4c-c7e2d61d48e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:23.576687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a18c3a-a4e3-4a3b-ad4c-c7e2d61d48e6 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:23.580626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a18c3a-a4e3-4a3b-ad4c-c7e2d61d48e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:23.580626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a18c3a-a4e3-4a3b-ad4c-c7e2d61d48e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:23.580626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a18c3a-a4e3-4a3b-ad4c-c7e2d61d48e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:23.580626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a18c3a-a4e3-4a3b-ad4c-c7e2d61d48e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:23.580626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a18c3a-a4e3-4a3b-ad4c-c7e2d61d48e6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:23.591646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 608/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:23.597461 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156c9f2-3e8b-4676-835b-ae2f33e84732 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:23.692323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:23.698978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156c9f2-3e8b-4676-835b-ae2f33e84732 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:23.732573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d09ed7-e6d5-43f6-a489-602ff85376e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:23.733199 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09ed7-e6d5-43f6-a489-602ff85376e1 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:23.733472 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09ed7-e6d5-43f6-a489-602ff85376e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:23.733738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d09ed7-e6d5-43f6-a489-602ff85376e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:23.741152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d09ed7-e6d5-43f6-a489-602ff85376e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:23.742634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d09ed7-e6d5-43f6-a489-602ff85376e1 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-09d09ed7-e6d5-43f6-a489-602ff85376e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:00:23.756020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:23.757221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:23.758185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:23.758185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:23.758185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:00:23.758185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:00:23.758185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:00:23.758185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:00:23.758185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:00:23.758185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:00:23.758185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:23.758185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:23.758185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 618/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:23.763354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a18c3a-a4e3-4a3b-ad4c-c7e2d61d48e6 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:23.814589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:23.867476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a18c3a-a4e3-4a3b-ad4c-c7e2d61d48e6 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:23.903037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56677b-2387-4795-b244-a2eb724019f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:23.903653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56677b-2387-4795-b244-a2eb724019f2 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:23.903921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56677b-2387-4795-b244-a2eb724019f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:23.904199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56677b-2387-4795-b244-a2eb724019f2 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:23.904953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56677b-2387-4795-b244-a2eb724019f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:23.905258 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56677b-2387-4795-b244-a2eb724019f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:23.906703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56677b-2387-4795-b244-a2eb724019f2 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:23.925348 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 609/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Aug 24 17:00:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:23.931124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d09ed7-e6d5-43f6-a489-602ff85376e1 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:24.033846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d09ed7-e6d5-43f6-a489-602ff85376e1 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:24.068474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ebe0e-0c8f-4e2f-9947-f4ba0e8acac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:24.069032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebe0e-0c8f-4e2f-9947-f4ba0e8acac8 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:24.069320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebe0e-0c8f-4e2f-9947-f4ba0e8acac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:24.069595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ebe0e-0c8f-4e2f-9947-f4ba0e8acac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:24.080375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ebe0e-0c8f-4e2f-9947-f4ba0e8acac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:24.081833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ebe0e-0c8f-4e2f-9947-f4ba0e8acac8 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-500ebe0e-0c8f-4e2f-9947-f4ba0e8acac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:24.096845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:24.101382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:24.102488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:24.102488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:24.102488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:24.102488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 619/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:24.103981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56677b-2387-4795-b244-a2eb724019f2 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:24.205837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56677b-2387-4795-b244-a2eb724019f2 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:24.208107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:24.240809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02251f7f-b2ae-468f-a453-503d28ebca93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:24.241434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02251f7f-b2ae-468f-a453-503d28ebca93 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:24.241679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02251f7f-b2ae-468f-a453-503d28ebca93 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:24.241949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02251f7f-b2ae-468f-a453-503d28ebca93 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:24.242575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02251f7f-b2ae-468f-a453-503d28ebca93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:24.242870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02251f7f-b2ae-468f-a453-503d28ebca93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:24.244220 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02251f7f-b2ae-468f-a453-503d28ebca93 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:24.255012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 610/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:24.260837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ebe0e-0c8f-4e2f-9947-f4ba0e8acac8 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:24.270279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:24.362973 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ebe0e-0c8f-4e2f-9947-f4ba0e8acac8 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:24.397159 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a545fc9-837d-464b-8189-74b65e436165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:24.397788 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545fc9-837d-464b-8189-74b65e436165 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:24.398069 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545fc9-837d-464b-8189-74b65e436165 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:24.398343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545fc9-837d-464b-8189-74b65e436165 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:24.405184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a545fc9-837d-464b-8189-74b65e436165 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:24.406631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a545fc9-837d-464b-8189-74b65e436165 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-4a545fc9-837d-464b-8189-74b65e436165 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:00:24.418398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:24.419485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:24.420597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:00:24.420597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:00:24.420597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:00:24.420597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:00:24.420597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:00:24.420597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:00:24.420597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:24.420597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:24.420597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 620/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 17:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:24.425850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02251f7f-b2ae-468f-a453-503d28ebca93 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:24.528087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02251f7f-b2ae-468f-a453-503d28ebca93 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:24.563186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c4498-37b0-421c-bea0-72d022f36751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:24.563788 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c4498-37b0-421c-bea0-72d022f36751 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:24.564068 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c4498-37b0-421c-bea0-72d022f36751 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:24.564410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c4498-37b0-421c-bea0-72d022f36751 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:24.565183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c4498-37b0-421c-bea0-72d022f36751 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:24.565491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c4498-37b0-421c-bea0-72d022f36751 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:24.566913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c4498-37b0-421c-bea0-72d022f36751 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:24.578827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 611/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 17:00:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:24.585102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a545fc9-837d-464b-8189-74b65e436165 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:24.651939 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:24.687344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a545fc9-837d-464b-8189-74b65e436165 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:24.721042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf8735-edac-414c-998d-9e1724c1e372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:24.725625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf8735-edac-414c-998d-9e1724c1e372 None admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:24.725625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf8735-edac-414c-998d-9e1724c1e372 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:24.725625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf8735-edac-414c-998d-9e1724c1e372 None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/a698e566a46841cf83aa1711e83f8829/roles/fd16473b81a24082b019c8d3effe2e66` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:24.737219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf8735-edac-414c-998d-9e1724c1e372 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=a698e566a46841cf83aa1711e83f8829, role_id=fd16473b81a24082b019c8d3effe2e66)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:24.738775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf8735-edac-414c-998d-9e1724c1e372 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:24.863902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 621/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 17:00:24 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/a698e566a46841cf83aa1711e83f8829/roles/fd16473b81a24082b019c8d3effe2e66 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:00:26.772988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f7f87-fd07-4a54-a532-79086a707e09 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:26.773545 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f7f87-fd07-4a54-a532-79086a707e09 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:26.773545 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f7f87-fd07-4a54-a532-79086a707e09 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:26.774928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 612/1233] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:00:26.780294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079b905-6c15-4e65-8e44-787322728125 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:26.780711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079b905-6c15-4e65-8e44-787322728125 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:26.780823 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079b905-6c15-4e65-8e44-787322728125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:26.801932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-a079b905-6c15-4e65-8e44-787322728125 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:00:26.803114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a079b905-6c15-4e65-8e44-787322728125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:00:26.869694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 622/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:00:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:00:27.140314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f7f87-fd07-4a54-a532-79086a707e09 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:27.166416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:27.244126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f7f87-fd07-4a54-a532-79086a707e09 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:27.279451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ed539-415e-4b53-b398-f8aa7fdd804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:27.280058 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed539-415e-4b53-b398-f8aa7fdd804c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:27.280374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed539-415e-4b53-b398-f8aa7fdd804c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:27.280650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ed539-415e-4b53-b398-f8aa7fdd804c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:27.292004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ed539-415e-4b53-b398-f8aa7fdd804c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-140ed539-415e-4b53-b398-f8aa7fdd804c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:00:27.297487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:27.298654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:27.299575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 613/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Aug 24 17:00:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:27.304916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079b905-6c15-4e65-8e44-787322728125 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:27.353645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:27.404736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079b905-6c15-4e65-8e44-787322728125 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:27.437500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ae66b-3de0-40a8-8d58-47fc57369613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:27.438151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ae66b-3de0-40a8-8d58-47fc57369613 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:27.438523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ae66b-3de0-40a8-8d58-47fc57369613 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:27.438804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ae66b-3de0-40a8-8d58-47fc57369613 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:27.439476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ae66b-3de0-40a8-8d58-47fc57369613 None admin] RBAC: Adding query filter params (name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:27.439781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ae66b-3de0-40a8-8d58-47fc57369613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:27.441226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ae66b-3de0-40a8-8d58-47fc57369613 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:27.450457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 623/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Aug 24 17:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:27.456285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ed539-415e-4b53-b398-f8aa7fdd804c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:27.540656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:27.557640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ed539-415e-4b53-b398-f8aa7fdd804c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:27.592082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b9235-2da8-4473-b55b-0b8aff887591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:27.592721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9235-2da8-4473-b55b-0b8aff887591 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:27.593001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9235-2da8-4473-b55b-0b8aff887591 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:27.593589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b9235-2da8-4473-b55b-0b8aff887591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:27.602972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b9235-2da8-4473-b55b-0b8aff887591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:27.604512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b9235-2da8-4473-b55b-0b8aff887591 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-875b9235-2da8-4473-b55b-0b8aff887591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:27.618845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:27.619969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:27.621012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:27.621012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:27.621012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:27.621012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 614/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:27.626798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ae66b-3de0-40a8-8d58-47fc57369613 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:27.729154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ae66b-3de0-40a8-8d58-47fc57369613 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:27.738733 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:27.763456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c4a07-0e7c-4c3b-b8b4-100e6230fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:27.764063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4a07-0e7c-4c3b-b8b4-100e6230fef0 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:27.764374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4a07-0e7c-4c3b-b8b4-100e6230fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:27.764649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c4a07-0e7c-4c3b-b8b4-100e6230fef0 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:27.765288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4a07-0e7c-4c3b-b8b4-100e6230fef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:27.765626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4a07-0e7c-4c3b-b8b4-100e6230fef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:27.766986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c4a07-0e7c-4c3b-b8b4-100e6230fef0 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:27.779241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 624/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:27.785079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b9235-2da8-4473-b55b-0b8aff887591 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:27.887902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b9235-2da8-4473-b55b-0b8aff887591 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:27.923722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c8b09-5c5a-434d-8749-49ad91df2b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:27.924370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c8b09-5c5a-434d-8749-49ad91df2b27 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:27.924652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c8b09-5c5a-434d-8749-49ad91df2b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:27.925187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c8b09-5c5a-434d-8749-49ad91df2b27 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:27.927819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:27.932521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c8b09-5c5a-434d-8749-49ad91df2b27 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:27.934171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c8b09-5c5a-434d-8749-49ad91df2b27 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-f57c8b09-5c5a-434d-8749-49ad91df2b27 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:00:27.946148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:27.952271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:27.953540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:27.953540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:27.953540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:00:27.953540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:00:27.953540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:00:27.953540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:00:27.953540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:00:27.953540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:00:27.953540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:27.953540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:27.953540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 615/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:27.954298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c4a07-0e7c-4c3b-b8b4-100e6230fef0 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:28.054246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c4a07-0e7c-4c3b-b8b4-100e6230fef0 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:28.087928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca03f9-9c0f-40c7-9bca-19f89c079bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:28.088566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca03f9-9c0f-40c7-9bca-19f89c079bdd None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:28.088848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca03f9-9c0f-40c7-9bca-19f89c079bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:28.089780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca03f9-9c0f-40c7-9bca-19f89c079bdd None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:28.090510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca03f9-9c0f-40c7-9bca-19f89c079bdd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:28.090810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca03f9-9c0f-40c7-9bca-19f89c079bdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:28.094592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca03f9-9c0f-40c7-9bca-19f89c079bdd None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:28.109172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 625/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Aug 24 17:00:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:28.115029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c8b09-5c5a-434d-8749-49ad91df2b27 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:28.216572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c8b09-5c5a-434d-8749-49ad91df2b27 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:28.249402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7da90-d174-4e9f-8ab3-bedd2bb0235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:28.250003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7da90-d174-4e9f-8ab3-bedd2bb0235a None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:28.250285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7da90-d174-4e9f-8ab3-bedd2bb0235a None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:28.250561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7da90-d174-4e9f-8ab3-bedd2bb0235a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:28.358718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:28.358718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7da90-d174-4e9f-8ab3-bedd2bb0235a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:28.358718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7da90-d174-4e9f-8ab3-bedd2bb0235a None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:28.423388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 616/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 17:00:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:00:28.429552 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca03f9-9c0f-40c7-9bca-19f89c079bdd None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:28.458388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:28.534411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca03f9-9c0f-40c7-9bca-19f89c079bdd None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:28.568951 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04921-72ca-4160-9001-5c13c468fd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:28.569582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04921-72ca-4160-9001-5c13c468fd0c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:28.569862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04921-72ca-4160-9001-5c13c468fd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:28.570214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04921-72ca-4160-9001-5c13c468fd0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:28.580352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f04921-72ca-4160-9001-5c13c468fd0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:28.581865 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f04921-72ca-4160-9001-5c13c468fd0c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-07f04921-72ca-4160-9001-5c13c468fd0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:28.598173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:28.600674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:28.601867 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:28.601867 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:28.601867 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:28.601867 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 626/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:28.606060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7da90-d174-4e9f-8ab3-bedd2bb0235a None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:28.699414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:28.704984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7da90-d174-4e9f-8ab3-bedd2bb0235a None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:28.739358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15691-e8e3-4094-af8d-3e8430052d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:28.739960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15691-e8e3-4094-af8d-3e8430052d12 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:28.740254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15691-e8e3-4094-af8d-3e8430052d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:28.740534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf15691-e8e3-4094-af8d-3e8430052d12 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:28.741176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf15691-e8e3-4094-af8d-3e8430052d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:28.741479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf15691-e8e3-4094-af8d-3e8430052d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:28.742842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf15691-e8e3-4094-af8d-3e8430052d12 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:28.754580 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 617/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:00:28.760337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04921-72ca-4160-9001-5c13c468fd0c None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:28.841190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:28.861898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04921-72ca-4160-9001-5c13c468fd0c None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:28.897650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2294e-0449-4753-a5a1-fafc7aca7b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:28.898285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2294e-0449-4753-a5a1-fafc7aca7b42 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:28.898564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2294e-0449-4753-a5a1-fafc7aca7b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:28.898834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2294e-0449-4753-a5a1-fafc7aca7b42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:28.906166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2294e-0449-4753-a5a1-fafc7aca7b42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:28.907598 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee2294e-0449-4753-a5a1-fafc7aca7b42 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-aee2294e-0449-4753-a5a1-fafc7aca7b42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:00:28.918802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:28.919885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:28.921191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:00:28.921191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:00:28.921191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:00:28.921191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:00:28.921191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:00:28.921191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:00:28.921191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:28.921191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:28.921191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 627/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 17:00:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:28.926298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15691-e8e3-4094-af8d-3e8430052d12 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:29.026099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf15691-e8e3-4094-af8d-3e8430052d12 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:29.061378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219c3b9-b895-4f4d-945b-64c082d65664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:29.061981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219c3b9-b895-4f4d-945b-64c082d65664 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:29.062255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219c3b9-b895-4f4d-945b-64c082d65664 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:29.062522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219c3b9-b895-4f4d-945b-64c082d65664 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:29.063206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219c3b9-b895-4f4d-945b-64c082d65664 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:29.063506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219c3b9-b895-4f4d-945b-64c082d65664 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:29.064978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219c3b9-b895-4f4d-945b-64c082d65664 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:29.077632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 618/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 17:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:29.083807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2294e-0449-4753-a5a1-fafc7aca7b42 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:29.184664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2294e-0449-4753-a5a1-fafc7aca7b42 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:29.217452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef85453-575a-4751-a787-92e3e43c7022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:29.218049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85453-575a-4751-a787-92e3e43c7022 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:29.218328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85453-575a-4751-a787-92e3e43c7022 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:29.218599 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef85453-575a-4751-a787-92e3e43c7022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:29.219314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef85453-575a-4751-a787-92e3e43c7022 None admin] RBAC: Adding query filter params (role.id=fd16473b81a24082b019c8d3effe2e66, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=a698e566a46841cf83aa1711e83f8829) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:29.219619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef85453-575a-4751-a787-92e3e43c7022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:29.221070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef85453-575a-4751-a787-92e3e43c7022 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:29.226660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 628/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 17:00:29 2022] GET /identity/v3/role_assignments?user.id=a698e566a46841cf83aa1711e83f8829&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=fd16473b81a24082b019c8d3effe2e66 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:31.192560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61dd71-d3a8-41ba-be0d-4671a932cc14 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:31.193154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61dd71-d3a8-41ba-be0d-4671a932cc14 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:31.193242 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61dd71-d3a8-41ba-be0d-4671a932cc14 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:31.194559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 619/1247] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:00:31.200348 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4236d89-dfd8-4996-b0a5-5b3066cc630c None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:31.200782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4236d89-dfd8-4996-b0a5-5b3066cc630c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:31.200912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4236d89-dfd8-4996-b0a5-5b3066cc630c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:31.207173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:31.219183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-d4236d89-dfd8-4996-b0a5-5b3066cc630c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:00:31.220393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d4236d89-dfd8-4996-b0a5-5b3066cc630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:00:31.286704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 629/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:00:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 17:00:31.554736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61dd71-d3a8-41ba-be0d-4671a932cc14 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:31.573088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:31.654897 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61dd71-d3a8-41ba-be0d-4671a932cc14 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:31.688956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4337ed2-db5b-41e5-8970-74d4dd6367ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:31.689559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4337ed2-db5b-41e5-8970-74d4dd6367ca None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:31.689835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4337ed2-db5b-41e5-8970-74d4dd6367ca None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:31.690124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4337ed2-db5b-41e5-8970-74d4dd6367ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:31.700037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4337ed2-db5b-41e5-8970-74d4dd6367ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-c4337ed2-db5b-41e5-8970-74d4dd6367ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:00:31.704718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:31.713539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:31.715204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 620/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 17:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:31.715960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4236d89-dfd8-4996-b0a5-5b3066cc630c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:31.811756 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4236d89-dfd8-4996-b0a5-5b3066cc630c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:31.843593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:31.845949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea085b0-485b-4260-b487-516b6aaf25f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:31.846572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea085b0-485b-4260-b487-516b6aaf25f5 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:31.846860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea085b0-485b-4260-b487-516b6aaf25f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:31.847116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea085b0-485b-4260-b487-516b6aaf25f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:31.847788 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea085b0-485b-4260-b487-516b6aaf25f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:31.848089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea085b0-485b-4260-b487-516b6aaf25f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:31.849503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea085b0-485b-4260-b487-516b6aaf25f5 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:31.858066 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 630/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 17:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:31.863901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4337ed2-db5b-41e5-8970-74d4dd6367ca None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:31.941410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:31.963811 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4337ed2-db5b-41e5-8970-74d4dd6367ca None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:31.996579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a51dad-808d-4784-9ddd-aceb1f350b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:31.997200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a51dad-808d-4784-9ddd-aceb1f350b62 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:31.997478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a51dad-808d-4784-9ddd-aceb1f350b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:31.997748 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a51dad-808d-4784-9ddd-aceb1f350b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:32.007282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a51dad-808d-4784-9ddd-aceb1f350b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:32.008765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a51dad-808d-4784-9ddd-aceb1f350b62 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-30a51dad-808d-4784-9ddd-aceb1f350b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:32.023249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:32.024420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:32.025511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:32.025511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:32.025511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:32.025511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 621/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:32.031046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea085b0-485b-4260-b487-516b6aaf25f5 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:32.130039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea085b0-485b-4260-b487-516b6aaf25f5 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:32.165954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf01af-f3dd-47d7-b823-36465b07275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:32.166558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf01af-f3dd-47d7-b823-36465b07275c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:32.166855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf01af-f3dd-47d7-b823-36465b07275c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:32.167665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf01af-f3dd-47d7-b823-36465b07275c None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:32.168338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf01af-f3dd-47d7-b823-36465b07275c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:32.168631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf01af-f3dd-47d7-b823-36465b07275c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:32.169987 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf01af-f3dd-47d7-b823-36465b07275c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:32.185156 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 631/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:32.191039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a51dad-808d-4784-9ddd-aceb1f350b62 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:32.293640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a51dad-808d-4784-9ddd-aceb1f350b62 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:32.319644 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:32.327342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bde8e-39e4-4b03-8d69-88a953e094e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:32.327958 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bde8e-39e4-4b03-8d69-88a953e094e3 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:32.328259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bde8e-39e4-4b03-8d69-88a953e094e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:32.328521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bde8e-39e4-4b03-8d69-88a953e094e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:32.335752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bde8e-39e4-4b03-8d69-88a953e094e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:32.337205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bde8e-39e4-4b03-8d69-88a953e094e3 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-476bde8e-39e4-4b03-8d69-88a953e094e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:00:32.348600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:32.349756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:32.350934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:32.350934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:32.350934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:00:32.350934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:00:32.350934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:00:32.350934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:00:32.350934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:00:32.350934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:00:32.350934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:32.350934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:32.350934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 622/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:32.356469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf01af-f3dd-47d7-b823-36465b07275c None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:32.410995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:32.456131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf01af-f3dd-47d7-b823-36465b07275c None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:32.490652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d4014-4506-453b-93a9-6d51008fea6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:32.491252 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d4014-4506-453b-93a9-6d51008fea6d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:32.491530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d4014-4506-453b-93a9-6d51008fea6d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:32.491802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d4014-4506-453b-93a9-6d51008fea6d None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:32.492555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d4014-4506-453b-93a9-6d51008fea6d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:32.492860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d4014-4506-453b-93a9-6d51008fea6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:32.494281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d4014-4506-453b-93a9-6d51008fea6d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:32.513208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 632/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Aug 24 17:00:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:32.519167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bde8e-39e4-4b03-8d69-88a953e094e3 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:32.621961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bde8e-39e4-4b03-8d69-88a953e094e3 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:32.656474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b55e4-b050-45e9-ab7b-cb19c5859a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:32.657070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b55e4-b050-45e9-ab7b-cb19c5859a66 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:32.657342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b55e4-b050-45e9-ab7b-cb19c5859a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:32.657607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b55e4-b050-45e9-ab7b-cb19c5859a66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:32.711701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:32.724412 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b55e4-b050-45e9-ab7b-cb19c5859a66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:32.725937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b55e4-b050-45e9-ab7b-cb19c5859a66 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:32.824921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 623/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 17:00:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:00:32.830609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d4014-4506-453b-93a9-6d51008fea6d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:32.930550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d4014-4506-453b-93a9-6d51008fea6d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:32.944861 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:32.966562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06975350-0f81-4891-b496-cd4f8e739dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:32.967126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06975350-0f81-4891-b496-cd4f8e739dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:32.967403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06975350-0f81-4891-b496-cd4f8e739dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:32.967673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06975350-0f81-4891-b496-cd4f8e739dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:32.977357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06975350-0f81-4891-b496-cd4f8e739dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:32.978786 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06975350-0f81-4891-b496-cd4f8e739dd9 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-06975350-0f81-4891-b496-cd4f8e739dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:32.993013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:32.994212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:32.996212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:32.996212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:32.996212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:32.996212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 633/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:33.000393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b55e4-b050-45e9-ab7b-cb19c5859a66 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:33.089833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:33.101697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b55e4-b050-45e9-ab7b-cb19c5859a66 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:33.137370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda9b9e-f657-4c5b-bff9-51c3c35ccc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:33.137977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda9b9e-f657-4c5b-bff9-51c3c35ccc67 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:33.138262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda9b9e-f657-4c5b-bff9-51c3c35ccc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:33.138534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda9b9e-f657-4c5b-bff9-51c3c35ccc67 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:33.139177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda9b9e-f657-4c5b-bff9-51c3c35ccc67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:33.139480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda9b9e-f657-4c5b-bff9-51c3c35ccc67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:33.141068 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bda9b9e-f657-4c5b-bff9-51c3c35ccc67 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:33.153080 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 624/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:33.162386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06975350-0f81-4891-b496-cd4f8e739dd9 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:33.265543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06975350-0f81-4891-b496-cd4f8e739dd9 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:33.300735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ea91f-410c-4084-bea6-cba650a0a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:33.301518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ea91f-410c-4084-bea6-cba650a0a447 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:33.301802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ea91f-410c-4084-bea6-cba650a0a447 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:33.302073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ea91f-410c-4084-bea6-cba650a0a447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:33.309143 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ea91f-410c-4084-bea6-cba650a0a447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:33.310578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ea91f-410c-4084-bea6-cba650a0a447 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-052ea91f-410c-4084-bea6-cba650a0a447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:00:33.324081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:33.328396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:33.329495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:00:33.329495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:00:33.329495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:00:33.329495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:00:33.329495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:00:33.329495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:00:33.329495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:33.329495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:33.329495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 634/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 17:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:33.331333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda9b9e-f657-4c5b-bff9-51c3c35ccc67 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:33.434080 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda9b9e-f657-4c5b-bff9-51c3c35ccc67 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:33.467876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb69b9-0c79-4b87-a42c-f1b28dad3090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:33.468518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb69b9-0c79-4b87-a42c-f1b28dad3090 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:33.468799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb69b9-0c79-4b87-a42c-f1b28dad3090 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:33.469070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb69b9-0c79-4b87-a42c-f1b28dad3090 None admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:33.469758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb69b9-0c79-4b87-a42c-f1b28dad3090 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:33.470061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb69b9-0c79-4b87-a42c-f1b28dad3090 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:33.471483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb69b9-0c79-4b87-a42c-f1b28dad3090 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:33.483386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 625/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 17:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:33.489806 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ea91f-410c-4084-bea6-cba650a0a447 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:33.516151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:33.594594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ea91f-410c-4084-bea6-cba650a0a447 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:33.627346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924f41a-4909-4dd5-8f7f-d44b9f66f03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:33.627965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924f41a-4909-4dd5-8f7f-d44b9f66f03e None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:33.628261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924f41a-4909-4dd5-8f7f-d44b9f66f03e None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:33.628568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924f41a-4909-4dd5-8f7f-d44b9f66f03e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:33.629277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924f41a-4909-4dd5-8f7f-d44b9f66f03e None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=a698e566a46841cf83aa1711e83f8829) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:33.629581 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924f41a-4909-4dd5-8f7f-d44b9f66f03e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:33.630992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924f41a-4909-4dd5-8f7f-d44b9f66f03e None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:33.636792 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 635/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 17:00:33 2022] GET /identity/v3/role_assignments?user.id=a698e566a46841cf83aa1711e83f8829&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:35.516130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b98a-089d-46da-b109-ebc883c8c5b2 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:35.516809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b98a-089d-46da-b109-ebc883c8c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:35.516809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b98a-089d-46da-b109-ebc883c8c5b2 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:35.518061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 626/1261] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:00:35.523181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc2eb-c6f2-47cb-8710-dfa4239f0378 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:35.523585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc2eb-c6f2-47cb-8710-dfa4239f0378 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:35.523739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fc2eb-c6f2-47cb-8710-dfa4239f0378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:35.542761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-521fc2eb-c6f2-47cb-8710-dfa4239f0378 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:00:35.543869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-521fc2eb-c6f2-47cb-8710-dfa4239f0378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:00:35.610061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 636/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:00:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:00:35.876995 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b98a-089d-46da-b109-ebc883c8c5b2 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:35.888822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:35.980931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b98a-089d-46da-b109-ebc883c8c5b2 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:36.013192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166d28b-1e88-4079-a39b-5f526d27f367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:36.013803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166d28b-1e88-4079-a39b-5f526d27f367 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:36.014075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166d28b-1e88-4079-a39b-5f526d27f367 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:36.014339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166d28b-1e88-4079-a39b-5f526d27f367 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:36.025131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166d28b-1e88-4079-a39b-5f526d27f367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-b166d28b-1e88-4079-a39b-5f526d27f367 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:00:36.030473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:36.031874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:00:36.033019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:36.036685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 627/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 17:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:36.037595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fc2eb-c6f2-47cb-8710-dfa4239f0378 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:36.056949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:36.134758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521fc2eb-c6f2-47cb-8710-dfa4239f0378 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:36.169493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f37fd1-5bfa-4cb1-a305-24374863a667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:36.170122 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f37fd1-5bfa-4cb1-a305-24374863a667 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:36.170860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f37fd1-5bfa-4cb1-a305-24374863a667 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:36.171799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f37fd1-5bfa-4cb1-a305-24374863a667 None admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:36.172549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f37fd1-5bfa-4cb1-a305-24374863a667 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:36.172849 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f37fd1-5bfa-4cb1-a305-24374863a667 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:36.174208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f37fd1-5bfa-4cb1-a305-24374863a667 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:36.182319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 637/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 17:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:00:36.188381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166d28b-1e88-4079-a39b-5f526d27f367 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:36.264887 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:36.300136 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166d28b-1e88-4079-a39b-5f526d27f367 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:36.333623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758173f2-c3a3-4443-bfc6-46769c073f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:36.334241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758173f2-c3a3-4443-bfc6-46769c073f6c None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:36.334512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758173f2-c3a3-4443-bfc6-46769c073f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:36.334781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758173f2-c3a3-4443-bfc6-46769c073f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:36.346697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758173f2-c3a3-4443-bfc6-46769c073f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:36.348204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758173f2-c3a3-4443-bfc6-46769c073f6c None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-758173f2-c3a3-4443-bfc6-46769c073f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:36.362165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:36.363337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:36.364685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:36.364685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:36.364685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:36.364685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 628/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:36.369146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f37fd1-5bfa-4cb1-a305-24374863a667 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:36.453337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:36.472256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f37fd1-5bfa-4cb1-a305-24374863a667 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:36.505536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d6472-9f17-4cdc-813e-b35f3770dc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:36.506139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d6472-9f17-4cdc-813e-b35f3770dc40 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:36.506419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d6472-9f17-4cdc-813e-b35f3770dc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:36.506692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d6472-9f17-4cdc-813e-b35f3770dc40 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:36.507359 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d6472-9f17-4cdc-813e-b35f3770dc40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:36.507673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d6472-9f17-4cdc-813e-b35f3770dc40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:36.509070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d6472-9f17-4cdc-813e-b35f3770dc40 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:36.521522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 638/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:36.527713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758173f2-c3a3-4443-bfc6-46769c073f6c None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:36.628732 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758173f2-c3a3-4443-bfc6-46769c073f6c None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:36.648033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:36.662365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a217ed-ec8a-4f4b-b997-2ae438cd6844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:36.662990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a217ed-ec8a-4f4b-b997-2ae438cd6844 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:36.668600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a217ed-ec8a-4f4b-b997-2ae438cd6844 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:36.668600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a217ed-ec8a-4f4b-b997-2ae438cd6844 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:36.671014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a217ed-ec8a-4f4b-b997-2ae438cd6844 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:36.672543 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a217ed-ec8a-4f4b-b997-2ae438cd6844 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-c8a217ed-ec8a-4f4b-b997-2ae438cd6844 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:00:36.684478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:36.685435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:36.686444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:36.686444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:36.686444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:00:36.686444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:00:36.686444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:00:36.686444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:00:36.686444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:00:36.686444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:00:36.686444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:36.686444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:36.686444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 629/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:36.691650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d6472-9f17-4cdc-813e-b35f3770dc40 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:36.791085 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d6472-9f17-4cdc-813e-b35f3770dc40 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:36.827378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbbf4d-d728-46bb-8029-383cff40285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:36.827983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbf4d-d728-46bb-8029-383cff40285c None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:36.828295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbf4d-d728-46bb-8029-383cff40285c None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:36.828578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbbf4d-d728-46bb-8029-383cff40285c None admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:36.829305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbbf4d-d728-46bb-8029-383cff40285c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:36.829615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbbf4d-d728-46bb-8029-383cff40285c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:36.831047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbbf4d-d728-46bb-8029-383cff40285c None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:36.839664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:36.848034 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 639/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Aug 24 17:00:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:36.853808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a217ed-ec8a-4f4b-b997-2ae438cd6844 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:36.956124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a217ed-ec8a-4f4b-b997-2ae438cd6844 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:36.989413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9543ae-1eb6-44df-ae56-348554a2c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:36.990035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9543ae-1eb6-44df-ae56-348554a2c9be None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:36.990315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9543ae-1eb6-44df-ae56-348554a2c9be None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:36.990586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9543ae-1eb6-44df-ae56-348554a2c9be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:37.001767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9543ae-1eb6-44df-ae56-348554a2c9be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:37.003199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9543ae-1eb6-44df-ae56-348554a2c9be None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-ea9543ae-1eb6-44df-ae56-348554a2c9be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:37.017648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:37.019623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:37.020845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:37.020845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:37.020845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:37.020845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 630/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:37.024902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbbf4d-d728-46bb-8029-383cff40285c None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:37.125677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbbf4d-d728-46bb-8029-383cff40285c None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:37.158443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bd17a-5f57-487c-af68-45a26ac0b784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:37.160169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd17a-5f57-487c-af68-45a26ac0b784 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:37.160169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd17a-5f57-487c-af68-45a26ac0b784 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:37.160169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bd17a-5f57-487c-af68-45a26ac0b784 None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:37.160169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bd17a-5f57-487c-af68-45a26ac0b784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:37.160583 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bd17a-5f57-487c-af68-45a26ac0b784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:37.161866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bd17a-5f57-487c-af68-45a26ac0b784 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:37.173381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 640/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:37.179470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9543ae-1eb6-44df-ae56-348554a2c9be None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:37.211216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:37.279091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9543ae-1eb6-44df-ae56-348554a2c9be None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:37.314410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c727aeb-b8aa-4af2-a538-b7714e73fb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:37.318816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727aeb-b8aa-4af2-a538-b7714e73fb29 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:37.318816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727aeb-b8aa-4af2-a538-b7714e73fb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:37.318816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727aeb-b8aa-4af2-a538-b7714e73fb29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:37.322092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c727aeb-b8aa-4af2-a538-b7714e73fb29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:37.323571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c727aeb-b8aa-4af2-a538-b7714e73fb29 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-2c727aeb-b8aa-4af2-a538-b7714e73fb29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:00:37.334524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:37.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:37.341503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:00:37.341503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:00:37.341503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:00:37.341503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:00:37.341503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:00:37.341503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:00:37.341503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:37.341503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:37.341503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 631/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 17:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:37.342070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bd17a-5f57-487c-af68-45a26ac0b784 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:37.401847 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:37.445533 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bd17a-5f57-487c-af68-45a26ac0b784 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:37.479103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6ba4c-124d-4725-9455-68a76a55451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:37.480425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6ba4c-124d-4725-9455-68a76a55451b None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:37.480674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6ba4c-124d-4725-9455-68a76a55451b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:37.480954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6ba4c-124d-4725-9455-68a76a55451b None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:37.481644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6ba4c-124d-4725-9455-68a76a55451b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:37.481954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6ba4c-124d-4725-9455-68a76a55451b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:37.483427 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6ba4c-124d-4725-9455-68a76a55451b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:37.496111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 641/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 17:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:37.502255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c727aeb-b8aa-4af2-a538-b7714e73fb29 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:37.593552 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:37.602092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c727aeb-b8aa-4af2-a538-b7714e73fb29 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:37.636479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729777f1-9351-472e-98f5-764096c8d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:37.637119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729777f1-9351-472e-98f5-764096c8d13b None admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:37.637400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729777f1-9351-472e-98f5-764096c8d13b None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:37.637674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729777f1-9351-472e-98f5-764096c8d13b None admin] PATH_INFO: `/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/a698e566a46841cf83aa1711e83f8829/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:37.639594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729777f1-9351-472e-98f5-764096c8d13b None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user_id=a698e566a46841cf83aa1711e83f8829, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:37.641030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729777f1-9351-472e-98f5-764096c8d13b None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:37.739158 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 632/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Aug 24 17:00:37 2022] PUT /identity/v3/projects/ecf4f3d778a84980bb9b4bfdd2b26c3c/users/a698e566a46841cf83aa1711e83f8829/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:00:39.677080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cdd18-341a-47be-b2c5-9ecb6bc9a1de None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:39.677584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cdd18-341a-47be-b2c5-9ecb6bc9a1de None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:39.677584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cdd18-341a-47be-b2c5-9ecb6bc9a1de None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:39.678967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 642/1274] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:00:39.685012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366498f-e3b6-4532-b960-5d28e955dd2e None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:39.685581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366498f-e3b6-4532-b960-5d28e955dd2e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:39.685751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366498f-e3b6-4532-b960-5d28e955dd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:39.705075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a366498f-e3b6-4532-b960-5d28e955dd2e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:00:39.706279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a366498f-e3b6-4532-b960-5d28e955dd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:00:39.775276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 633/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:00:40.048358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cdd18-341a-47be-b2c5-9ecb6bc9a1de None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:40.149582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cdd18-341a-47be-b2c5-9ecb6bc9a1de None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:40.167607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:40.186527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bacba2-17c6-4549-bc13-ed59adc68c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:40.187154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bacba2-17c6-4549-bc13-ed59adc68c62 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:40.187432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bacba2-17c6-4549-bc13-ed59adc68c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:40.187746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bacba2-17c6-4549-bc13-ed59adc68c62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:40.197940 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bacba2-17c6-4549-bc13-ed59adc68c62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-18bacba2-17c6-4549-bc13-ed59adc68c62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 17:00:40.202885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:40.204106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:40.205110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 643/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Aug 24 17:00:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:40.210261 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366498f-e3b6-4532-b960-5d28e955dd2e None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:40.290180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:40.309298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366498f-e3b6-4532-b960-5d28e955dd2e None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:40.342034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3da25-fe34-4300-b73e-0c79ba263834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:40.342831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3da25-fe34-4300-b73e-0c79ba263834 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:40.343173 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3da25-fe34-4300-b73e-0c79ba263834 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:40.343789 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3da25-fe34-4300-b73e-0c79ba263834 None admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:40.344547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3da25-fe34-4300-b73e-0c79ba263834 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:40.344847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3da25-fe34-4300-b73e-0c79ba263834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:40.346197 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc3da25-fe34-4300-b73e-0c79ba263834 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:40.354346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 634/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Aug 24 17:00:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:40.360781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bacba2-17c6-4549-bc13-ed59adc68c62 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:40.464611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bacba2-17c6-4549-bc13-ed59adc68c62 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:40.500573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead6bf7-682f-4e01-b139-d791fa64f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:40.501207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6bf7-682f-4e01-b139-d791fa64f70f None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:40.501796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6bf7-682f-4e01-b139-d791fa64f70f None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:40.501972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6bf7-682f-4e01-b139-d791fa64f70f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:40.512259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead6bf7-682f-4e01-b139-d791fa64f70f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:40.513759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead6bf7-682f-4e01-b139-d791fa64f70f None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-fead6bf7-682f-4e01-b139-d791fa64f70f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:40.528859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:40.530119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:40.531157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:40.531157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:40.531157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:40.531157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 644/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:40.535810 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3da25-fe34-4300-b73e-0c79ba263834 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:40.637126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3da25-fe34-4300-b73e-0c79ba263834 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:40.671666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe51b9a-1863-465c-99ec-56e56e7cef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:40.672290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe51b9a-1863-465c-99ec-56e56e7cef99 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:40.672596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe51b9a-1863-465c-99ec-56e56e7cef99 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:40.672870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe51b9a-1863-465c-99ec-56e56e7cef99 None admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:40.673506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe51b9a-1863-465c-99ec-56e56e7cef99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:40.673863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe51b9a-1863-465c-99ec-56e56e7cef99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:40.675461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe51b9a-1863-465c-99ec-56e56e7cef99 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:40.687411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 635/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:40.693408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead6bf7-682f-4e01-b139-d791fa64f70f None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:40.724404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:40.792824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead6bf7-682f-4e01-b139-d791fa64f70f None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:40.826244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2f921-57e9-463f-9d9d-0089e0a54026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:40.826869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2f921-57e9-463f-9d9d-0089e0a54026 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:40.827147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2f921-57e9-463f-9d9d-0089e0a54026 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:40.827468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2f921-57e9-463f-9d9d-0089e0a54026 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:40.835585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2f921-57e9-463f-9d9d-0089e0a54026 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:40.837037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2f921-57e9-463f-9d9d-0089e0a54026 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-b6e2f921-57e9-463f-9d9d-0089e0a54026 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 17:00:40.848841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:40.850074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:40.851271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:40.851271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:40.851271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 17:00:40.851271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 17:00:40.851271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 17:00:40.851271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 17:00:40.851271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 17:00:40.851271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 17:00:40.851271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 17:00:40.851271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:40.851271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 645/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:40.855967 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe51b9a-1863-465c-99ec-56e56e7cef99 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:40.859817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:40.961182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe51b9a-1863-465c-99ec-56e56e7cef99 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:40.995723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8152d64-36e6-4717-83b8-3e175e0e9599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:40.996758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8152d64-36e6-4717-83b8-3e175e0e9599 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:40.996758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8152d64-36e6-4717-83b8-3e175e0e9599 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:40.996955 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8152d64-36e6-4717-83b8-3e175e0e9599 None admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:40.997678 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8152d64-36e6-4717-83b8-3e175e0e9599 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:40.997985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8152d64-36e6-4717-83b8-3e175e0e9599 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:40.999419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8152d64-36e6-4717-83b8-3e175e0e9599 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:41.017344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 636/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Aug 24 17:00:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:41.023189 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2f921-57e9-463f-9d9d-0089e0a54026 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:41.120292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:41.129637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2f921-57e9-463f-9d9d-0089e0a54026 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:41.165305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc86b39-05ba-435c-ad8c-41ee96002b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:41.165922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc86b39-05ba-435c-ad8c-41ee96002b0d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:41.166204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc86b39-05ba-435c-ad8c-41ee96002b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:41.166476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc86b39-05ba-435c-ad8c-41ee96002b0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:41.238513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc86b39-05ba-435c-ad8c-41ee96002b0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:41.240031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc86b39-05ba-435c-ad8c-41ee96002b0d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:41.336309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:41.346420 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 646/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Aug 24 17:00:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 17:00:41.352619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8152d64-36e6-4717-83b8-3e175e0e9599 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:41.415326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:41.458537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8152d64-36e6-4717-83b8-3e175e0e9599 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:41.491281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303dc39-4cda-40c7-85e0-5ec8e0f7435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:41.491836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303dc39-4cda-40c7-85e0-5ec8e0f7435d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:41.492091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303dc39-4cda-40c7-85e0-5ec8e0f7435d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:41.492400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303dc39-4cda-40c7-85e0-5ec8e0f7435d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:41.503139 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303dc39-4cda-40c7-85e0-5ec8e0f7435d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:41.504600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303dc39-4cda-40c7-85e0-5ec8e0f7435d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-7303dc39-4cda-40c7-85e0-5ec8e0f7435d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 17:00:41.518927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:41.520784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 17:00:41.522849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 17:00:41.522849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 17:00:41.522849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:41.522849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 637/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:41.527645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc86b39-05ba-435c-ad8c-41ee96002b0d None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:41.638552 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc86b39-05ba-435c-ad8c-41ee96002b0d None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:41.676405 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031859-315b-47de-a960-3c3910876ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:41.677015 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031859-315b-47de-a960-3c3910876ccc None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:41.677292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031859-315b-47de-a960-3c3910876ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:41.677566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a031859-315b-47de-a960-3c3910876ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:41.678204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031859-315b-47de-a960-3c3910876ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:41.678508 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031859-315b-47de-a960-3c3910876ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:41.679874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a031859-315b-47de-a960-3c3910876ccc None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:41.691823 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 647/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Aug 24 17:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:41.697524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303dc39-4cda-40c7-85e0-5ec8e0f7435d None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:41.796445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303dc39-4cda-40c7-85e0-5ec8e0f7435d None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:41.810518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:41.829701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc463e-b601-48a0-9e97-8166145bf279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:41.830327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc463e-b601-48a0-9e97-8166145bf279 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:41.830611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc463e-b601-48a0-9e97-8166145bf279 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:41.830880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc463e-b601-48a0-9e97-8166145bf279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:41.837465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc463e-b601-48a0-9e97-8166145bf279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:41.838972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc463e-b601-48a0-9e97-8166145bf279 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application [None req-a9fc463e-b601-48a0-9e97-8166145bf279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 17:00:41.850289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:41.851361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:41.852503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 17:00:41.852503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 17:00:41.852503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 17:00:41.852503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 17:00:41.852503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 17:00:41.852503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 17:00:41.852503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 17:00:41.852503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: ERROR keystone.server.flask.application Aug 24 17:00:41.852503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 638/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Aug 24 17:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:41.858331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031859-315b-47de-a960-3c3910876ccc None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:41.909441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:41.959583 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a031859-315b-47de-a960-3c3910876ccc None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:41.993311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16459bf1-48ca-4b52-b16c-d03c93eeb0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:41.993910 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16459bf1-48ca-4b52-b16c-d03c93eeb0ef None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:41.994186 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16459bf1-48ca-4b52-b16c-d03c93eeb0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:41.994455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16459bf1-48ca-4b52-b16c-d03c93eeb0ef None admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:41.995168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16459bf1-48ca-4b52-b16c-d03c93eeb0ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:41.995464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16459bf1-48ca-4b52-b16c-d03c93eeb0ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:41.996917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16459bf1-48ca-4b52-b16c-d03c93eeb0ef None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:42.008644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 648/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Aug 24 17:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:42.015021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc463e-b601-48a0-9e97-8166145bf279 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:42.119885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc463e-b601-48a0-9e97-8166145bf279 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:42.153940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86752e37-6002-4b5f-832c-3e7da95b24f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:42.154536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86752e37-6002-4b5f-832c-3e7da95b24f9 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:42.154815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86752e37-6002-4b5f-832c-3e7da95b24f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:42.155083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86752e37-6002-4b5f-832c-3e7da95b24f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:42.155799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86752e37-6002-4b5f-832c-3e7da95b24f9 None admin] RBAC: Adding query filter params (role.id=2dbeed762d0548c7b6b68d61ad7ddc4b, scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c, user.id=a698e566a46841cf83aa1711e83f8829) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:42.156104 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86752e37-6002-4b5f-832c-3e7da95b24f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:42.157547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86752e37-6002-4b5f-832c-3e7da95b24f9 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:42.163142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 639/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Aug 24 17:00:42 2022] GET /identity/v3/role_assignments?user.id=a698e566a46841cf83aa1711e83f8829&scope.project.id=ecf4f3d778a84980bb9b4bfdd2b26c3c&role.id=2dbeed762d0548c7b6b68d61ad7ddc4b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:44.123946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bba4f3-5680-4360-ab7a-81110bb19396 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:44.124505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bba4f3-5680-4360-ab7a-81110bb19396 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:44.124505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bba4f3-5680-4360-ab7a-81110bb19396 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:44.126042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 649/1288] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:00:44.131333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831b18-93d1-4667-8f63-214f015b9906 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:44.131833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831b18-93d1-4667-8f63-214f015b9906 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:44.131926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831b18-93d1-4667-8f63-214f015b9906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:44.150657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b3831b18-93d1-4667-8f63-214f015b9906 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:00:44.152874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b3831b18-93d1-4667-8f63-214f015b9906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:00:44.183680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:44.221255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 640/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:00:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:00:44.494567 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bba4f3-5680-4360-ab7a-81110bb19396 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:44.596313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bba4f3-5680-4360-ab7a-81110bb19396 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:44.607709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:44.631622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f681b0-80e1-486b-bd49-9fee240521e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:44.636340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f681b0-80e1-486b-bd49-9fee240521e4 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:44.636340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f681b0-80e1-486b-bd49-9fee240521e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:44.636340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f681b0-80e1-486b-bd49-9fee240521e4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:44.636340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f681b0-80e1-486b-bd49-9fee240521e4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:44.636340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f681b0-80e1-486b-bd49-9fee240521e4 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-d2f681b0-80e1-486b-bd49-9fee240521e4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:44.643523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:44.648669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:44.649719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 650/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Aug 24 17:00:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:44.650865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3831b18-93d1-4667-8f63-214f015b9906 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:44.755273 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3831b18-93d1-4667-8f63-214f015b9906 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:44.788278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcacfe-94d7-45e6-947f-3f5d84aedbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:44.793419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcacfe-94d7-45e6-947f-3f5d84aedbdc None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:44.793419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcacfe-94d7-45e6-947f-3f5d84aedbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:44.793419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcacfe-94d7-45e6-947f-3f5d84aedbdc None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:44.793419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcacfe-94d7-45e6-947f-3f5d84aedbdc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:44.793419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcacfe-94d7-45e6-947f-3f5d84aedbdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:44.793419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcacfe-94d7-45e6-947f-3f5d84aedbdc None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:44.797289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 641/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Aug 24 17:00:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:44.803289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f681b0-80e1-486b-bd49-9fee240521e4 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:44.908352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f681b0-80e1-486b-bd49-9fee240521e4 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:44.942340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9365f1-21fe-494d-82e1-33d4e11a4a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:44.942936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9365f1-21fe-494d-82e1-33d4e11a4a90 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:44.943210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9365f1-21fe-494d-82e1-33d4e11a4a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:44.943476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9365f1-21fe-494d-82e1-33d4e11a4a90 None admin] PATH_INFO: `/v3/services` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:44.944094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9365f1-21fe-494d-82e1-33d4e11a4a90 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:44.944422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9365f1-21fe-494d-82e1-33d4e11a4a90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:44.945782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9365f1-21fe-494d-82e1-33d4e11a4a90 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:44.950233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 651/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Aug 24 17:00:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:46.848862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1669cd-eddf-4791-b699-a0243795363d None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:46.849425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1669cd-eddf-4791-b699-a0243795363d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:46.849425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1669cd-eddf-4791-b699-a0243795363d None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:46.850729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 642/1293] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:00:46.856741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82aa12-90e6-41a1-9e45-5ce009d8741e None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:46.857130 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82aa12-90e6-41a1-9e45-5ce009d8741e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:46.857292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82aa12-90e6-41a1-9e45-5ce009d8741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:46.875693 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-2d82aa12-90e6-41a1-9e45-5ce009d8741e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:00:46.876928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2d82aa12-90e6-41a1-9e45-5ce009d8741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:00:46.906895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:46.944116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 652/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:00:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:00:47.214203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1669cd-eddf-4791-b699-a0243795363d None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:47.246433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:47.317042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1669cd-eddf-4791-b699-a0243795363d None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:47.351087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a077fbd-b6a2-4335-aae2-bc94309801c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:47.351690 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077fbd-b6a2-4335-aae2-bc94309801c6 None admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:47.351970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077fbd-b6a2-4335-aae2-bc94309801c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:47.352257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a077fbd-b6a2-4335-aae2-bc94309801c6 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:47.352956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a077fbd-b6a2-4335-aae2-bc94309801c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:47.355705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a077fbd-b6a2-4335-aae2-bc94309801c6 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:47.471241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 643/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Aug 24 17:00:47 2022] POST /identity/v3/services => generated 246 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:00:49.429465 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fe70e-0597-49d4-b424-0715cb6b9bb6 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:49.430043 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fe70e-0597-49d4-b424-0715cb6b9bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:49.430043 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fe70e-0597-49d4-b424-0715cb6b9bb6 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:49.431384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 653/1296] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:00:49.437485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65662a-1ed6-49d2-8bfe-ec6c1b051f77 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:49.443332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65662a-1ed6-49d2-8bfe-ec6c1b051f77 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:49.443332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65662a-1ed6-49d2-8bfe-ec6c1b051f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:49.457836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6c65662a-1ed6-49d2-8bfe-ec6c1b051f77 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:00:49.459042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6c65662a-1ed6-49d2-8bfe-ec6c1b051f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:00:49.531785 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 644/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:00:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:00:49.806205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fe70e-0597-49d4-b424-0715cb6b9bb6 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:49.909369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fe70e-0597-49d4-b424-0715cb6b9bb6 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:49.943972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70f910-7c7f-4259-aae6-4b08bc04f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:49.944644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70f910-7c7f-4259-aae6-4b08bc04f263 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:49.944927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70f910-7c7f-4259-aae6-4b08bc04f263 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:49.945203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70f910-7c7f-4259-aae6-4b08bc04f263 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:49.945797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70f910-7c7f-4259-aae6-4b08bc04f263 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:49.947172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70f910-7c7f-4259-aae6-4b08bc04f263 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-1c70f910-7c7f-4259-aae6-4b08bc04f263 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:49.956582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:49.957781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:49.958837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 654/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Aug 24 17:00:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:49.963995 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65662a-1ed6-49d2-8bfe-ec6c1b051f77 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:49.982628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:50.061774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65662a-1ed6-49d2-8bfe-ec6c1b051f77 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:50.095332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1a15f-1a21-43d2-bc4e-1223fc26bb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:50.095979 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1a15f-1a21-43d2-bc4e-1223fc26bb92 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:50.096285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1a15f-1a21-43d2-bc4e-1223fc26bb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:50.096557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1a15f-1a21-43d2-bc4e-1223fc26bb92 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:50.097186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1a15f-1a21-43d2-bc4e-1223fc26bb92 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:50.097488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1a15f-1a21-43d2-bc4e-1223fc26bb92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:50.101260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1a15f-1a21-43d2-bc4e-1223fc26bb92 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:50.104048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 645/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Aug 24 17:00:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:00:50.110662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70f910-7c7f-4259-aae6-4b08bc04f263 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:50.142573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:50.213268 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70f910-7c7f-4259-aae6-4b08bc04f263 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:50.247365 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03362bfc-594e-4dc0-8570-afac6973392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:50.247968 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03362bfc-594e-4dc0-8570-afac6973392d None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:50.248271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03362bfc-594e-4dc0-8570-afac6973392d None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:50.248546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03362bfc-594e-4dc0-8570-afac6973392d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:50.249238 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03362bfc-594e-4dc0-8570-afac6973392d None admin] RBAC: Adding query filter params (interface=public, service_id=da7ec223c95d4ed9bb0c41d69534f22d, region_id=RegionOne) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:50.249542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03362bfc-594e-4dc0-8570-afac6973392d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:50.251020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03362bfc-594e-4dc0-8570-afac6973392d None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:50.255966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 655/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Aug 24 17:00:50 2022] GET /identity/v3/endpoints?service_id=da7ec223c95d4ed9bb0c41d69534f22d&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:50.261940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1a15f-1a21-43d2-bc4e-1223fc26bb92 None admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:50.346642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:50.364421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1a15f-1a21-43d2-bc4e-1223fc26bb92 None admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:50.396473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed65dd-45ce-4fba-a2df-3d0b129d8c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:50.397099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed65dd-45ce-4fba-a2df-3d0b129d8c02 None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:50.397374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed65dd-45ce-4fba-a2df-3d0b129d8c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:50.397640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed65dd-45ce-4fba-a2df-3d0b129d8c02 None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:50.398231 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed65dd-45ce-4fba-a2df-3d0b129d8c02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:50.399634 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed65dd-45ce-4fba-a2df-3d0b129d8c02 None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:50.407071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 646/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Aug 24 17:00:50 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:00:52.346463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eabfa-5097-40e3-85a0-56cd0da44e9b None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:52.347046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eabfa-5097-40e3-85a0-56cd0da44e9b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:52.347046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395eabfa-5097-40e3-85a0-56cd0da44e9b None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:52.348364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 656/1302] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:00:52.353661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72e7e7-c4b2-4074-bc05-17febc5cd74f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:52.357082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72e7e7-c4b2-4074-bc05-17febc5cd74f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:52.357082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72e7e7-c4b2-4074-bc05-17febc5cd74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:52.373054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-fe72e7e7-c4b2-4074-bc05-17febc5cd74f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:00:52.374262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-fe72e7e7-c4b2-4074-bc05-17febc5cd74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:00:52.440438 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 647/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:00:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 17:00:52.714986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395eabfa-5097-40e3-85a0-56cd0da44e9b None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:52.810342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:52.816920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395eabfa-5097-40e3-85a0-56cd0da44e9b None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:52.850156 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef9ea7-200f-4319-8296-ba3f66857ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:52.850780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef9ea7-200f-4319-8296-ba3f66857ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:52.851057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef9ea7-200f-4319-8296-ba3f66857ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:52.851328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef9ea7-200f-4319-8296-ba3f66857ae8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:52.851907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef9ea7-200f-4319-8296-ba3f66857ae8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:52.853346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef9ea7-200f-4319-8296-ba3f66857ae8 None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application [None req-4eef9ea7-200f-4319-8296-ba3f66857ae8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 17:00:52.862114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 17:00:52.863384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application with Lock( Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self._enter() Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application return self.creator() Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application created_value = creator( Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: ERROR keystone.server.flask.application Aug 24 17:00:52.864569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 657/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Aug 24 17:00:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 17:00:52.869398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72e7e7-c4b2-4074-bc05-17febc5cd74f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:52.946791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:00:52.972091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72e7e7-c4b2-4074-bc05-17febc5cd74f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:53.004943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc89cd1-e6c6-4fde-914e-817663cc3a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:53.005571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc89cd1-e6c6-4fde-914e-817663cc3a9d None admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:53.005850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc89cd1-e6c6-4fde-914e-817663cc3a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:53.006126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc89cd1-e6c6-4fde-914e-817663cc3a9d None admin] PATH_INFO: `/v3/services` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:53.006747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc89cd1-e6c6-4fde-914e-817663cc3a9d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:00:53.007048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc89cd1-e6c6-4fde-914e-817663cc3a9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:53.008428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc89cd1-e6c6-4fde-914e-817663cc3a9d None admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:53.015154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 648/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Aug 24 17:00:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:00:53.021149 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef9ea7-200f-4319-8296-ba3f66857ae8 None admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:00:53.122672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef9ea7-200f-4319-8296-ba3f66857ae8 None admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:00:53.156372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5ad12f-01d1-4828-a2b5-5323fad3996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:00:53.156967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad12f-01d1-4828-a2b5-5323fad3996b None admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:00:53.157240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad12f-01d1-4828-a2b5-5323fad3996b None admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:00:53.157505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad12f-01d1-4828-a2b5-5323fad3996b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:00:53.158208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ad12f-01d1-4828-a2b5-5323fad3996b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:00:53.159554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5ad12f-01d1-4828-a2b5-5323fad3996b None admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:00:53.315683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 658/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:00:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:01:03.012746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=30 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:03.310660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:48.603379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5131ce-ee6b-4b32-be6c-9a5dd6017d47 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:48.603923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5131ce-ee6b-4b32-be6c-9a5dd6017d47 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:48.603923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5131ce-ee6b-4b32-be6c-9a5dd6017d47 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:48.605309 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 649/1307] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:07:48.611751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783f91-8ec7-47e4-917f-4d6257df0367 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:48.612291 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783f91-8ec7-47e4-917f-4d6257df0367 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:48.613282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee783f91-8ec7-47e4-917f-4d6257df0367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:48.728675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ee783f91-8ec7-47e4-917f-4d6257df0367 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:07:48.730128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ee783f91-8ec7-47e4-917f-4d6257df0367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:48.877259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 659/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:07:49.172097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdcba5-4223-48fc-921a-0e949672bc85 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:49.172690 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdcba5-4223-48fc-921a-0e949672bc85 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:49.173121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdcba5-4223-48fc-921a-0e949672bc85 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:49.175134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 650/1309] 10.222.0.20 () {54 vars in 965 bytes} [Wed Aug 24 17:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:07:49.183354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa47bb-8b52-4d9e-be86-05212dc76642 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:49.183899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa47bb-8b52-4d9e-be86-05212dc76642 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:49.184393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa47bb-8b52-4d9e-be86-05212dc76642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:49.326021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b2aa47bb-8b52-4d9e-be86-05212dc76642 None None] MFA Rules not processed for user `e303777e78b7499fbff457254d14d360`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:07:49.327714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b2aa47bb-8b52-4d9e-be86-05212dc76642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:49.361041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:49.431070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 660/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Aug 24 17:07:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:07:49.439509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdcba5-4223-48fc-921a-0e949672bc85 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:07:49.441321 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b6fdcba5-4223-48fc-921a-0e949672bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:49.582935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdcba5-4223-48fc-921a-0e949672bc85 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:07:49.685172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de783c5-8402-4ec1-9969-1bc5217102f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:07:49.686574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de783c5-8402-4ec1-9969-1bc5217102f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:49.687090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de783c5-8402-4ec1-9969-1bc5217102f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:49.687580 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de783c5-8402-4ec1-9969-1bc5217102f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:49.689981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4de783c5-8402-4ec1-9969-1bc5217102f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:49.754702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:49.819880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de783c5-8402-4ec1-9969-1bc5217102f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:07:49.821794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de783c5-8402-4ec1-9969-1bc5217102f3 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:07:49.844419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 651/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:07:52.125081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ff386-0852-4f41-808a-7ff18cb2a52b None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:52.125596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ff386-0852-4f41-808a-7ff18cb2a52b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:52.125692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ff386-0852-4f41-808a-7ff18cb2a52b None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:52.126949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 661/1312] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:07:52.132122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c34cc-da30-497b-8f0e-5ced809e9c5d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:52.132567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c34cc-da30-497b-8f0e-5ced809e9c5d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:52.132703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c34cc-da30-497b-8f0e-5ced809e9c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:52.216011 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-341c34cc-da30-497b-8f0e-5ced809e9c5d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:07:52.217177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-341c34cc-da30-497b-8f0e-5ced809e9c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:52.323384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 652/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:07:52.607133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ff386-0852-4f41-808a-7ff18cb2a52b None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:07:52.608716 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6e6ff386-0852-4f41-808a-7ff18cb2a52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:52.713524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ff386-0852-4f41-808a-7ff18cb2a52b None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:07:52.786351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:52.789232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae613c0-c734-4db6-8902-1812484c2d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:07:52.789841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae613c0-c734-4db6-8902-1812484c2d95 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:52.790119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae613c0-c734-4db6-8902-1812484c2d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:52.790390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae613c0-c734-4db6-8902-1812484c2d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:52.792065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-cae613c0-c734-4db6-8902-1812484c2d95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:52.904093 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae613c0-c734-4db6-8902-1812484c2d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:07:52.905536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae613c0-c734-4db6-8902-1812484c2d95 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:07:52.924178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 662/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:07:55.359723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469e78c-06f4-466a-a9fc-8a50cba15d6f None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:55.360378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469e78c-06f4-466a-a9fc-8a50cba15d6f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:55.360378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4469e78c-06f4-466a-a9fc-8a50cba15d6f None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:55.361641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 653/1315] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:07:55.366764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eca69-ecf2-45e6-83b3-5a77d26c971e None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:55.367175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eca69-ecf2-45e6-83b3-5a77d26c971e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:55.367312 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eca69-ecf2-45e6-83b3-5a77d26c971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:55.432620 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-646eca69-ecf2-45e6-83b3-5a77d26c971e None None] MFA Rules not processed for user `e79e9344a59f4e098f27e679467d3246`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:07:55.433813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-646eca69-ecf2-45e6-83b3-5a77d26c971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:55.486456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:55.530766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 663/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:07:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:07:55.816153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469e78c-06f4-466a-a9fc-8a50cba15d6f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:07:55.817847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4469e78c-06f4-466a-a9fc-8a50cba15d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:55.827650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:55.923787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4469e78c-06f4-466a-a9fc-8a50cba15d6f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:07:55.996698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ac773-8fd9-4363-8b1f-6e376acf9f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:07:55.997328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac773-8fd9-4363-8b1f-6e376acf9f4e service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:55.997682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac773-8fd9-4363-8b1f-6e376acf9f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:55.998174 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac773-8fd9-4363-8b1f-6e376acf9f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:55.999797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-374ac773-8fd9-4363-8b1f-6e376acf9f4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:56.071421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:56.118125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ac773-8fd9-4363-8b1f-6e376acf9f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:07:56.119548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ac773-8fd9-4363-8b1f-6e376acf9f4e service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:07:56.138013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 654/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:07:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:07:58.774675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3501b89-941b-4bd8-aaac-7417955d8f68 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:58.775245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3501b89-941b-4bd8-aaac-7417955d8f68 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:58.775410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3501b89-941b-4bd8-aaac-7417955d8f68 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:58.776837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 664/1318] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:07:58.782213 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de4ac2-624a-4b89-b295-7ebbf91c2a5f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:58.782633 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de4ac2-624a-4b89-b295-7ebbf91c2a5f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:58.782766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de4ac2-624a-4b89-b295-7ebbf91c2a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:58.849131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-14de4ac2-624a-4b89-b295-7ebbf91c2a5f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:07:58.850972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-14de4ac2-624a-4b89-b295-7ebbf91c2a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:58.947112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 655/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:07:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:07:59.231318 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3501b89-941b-4bd8-aaac-7417955d8f68 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:07:59.233013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e3501b89-941b-4bd8-aaac-7417955d8f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:59.336523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3501b89-941b-4bd8-aaac-7417955d8f68 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:07:59.410770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce45dad-cd2d-4df5-b63e-27353d40b9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:07:59.411379 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45dad-cd2d-4df5-b63e-27353d40b9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:07:59.411657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45dad-cd2d-4df5-b63e-27353d40b9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:07:59.411928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce45dad-cd2d-4df5-b63e-27353d40b9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:07:59.413842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0ce45dad-cd2d-4df5-b63e-27353d40b9b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:07:59.421395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:07:59.526902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce45dad-cd2d-4df5-b63e-27353d40b9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:07:59.528351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce45dad-cd2d-4df5-b63e-27353d40b9b3 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:07:59.546903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 665/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:07:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:02.504539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d64cd8-37af-4a83-a3fd-96867c6619f4 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:02.505122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d64cd8-37af-4a83-a3fd-96867c6619f4 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:02.505122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d64cd8-37af-4a83-a3fd-96867c6619f4 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:02.506442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 656/1321] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:02.511818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744970f-9450-4e5d-87dd-d80f9e7818fb None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:02.512324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744970f-9450-4e5d-87dd-d80f9e7818fb None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:02.512528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744970f-9450-4e5d-87dd-d80f9e7818fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:02.581392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0744970f-9450-4e5d-87dd-d80f9e7818fb None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:02.582534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0744970f-9450-4e5d-87dd-d80f9e7818fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:02.642931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:02.682835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 666/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:02.973234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d64cd8-37af-4a83-a3fd-96867c6619f4 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:02.974883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d6d64cd8-37af-4a83-a3fd-96867c6619f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:02.998136 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:03.090211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d64cd8-37af-4a83-a3fd-96867c6619f4 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:03.165377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5367d5-dc71-4cf3-8ac1-25385d36117e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:03.165981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5367d5-dc71-4cf3-8ac1-25385d36117e service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:03.166255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5367d5-dc71-4cf3-8ac1-25385d36117e service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:03.166523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5367d5-dc71-4cf3-8ac1-25385d36117e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:03.168129 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-fb5367d5-dc71-4cf3-8ac1-25385d36117e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:03.240060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:03.279108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5367d5-dc71-4cf3-8ac1-25385d36117e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:03.280653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5367d5-dc71-4cf3-8ac1-25385d36117e service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:03.305618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 657/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:05.302757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079ee1-f218-4eb8-86b0-f23cf87ad21b None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:05.303290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079ee1-f218-4eb8-86b0-f23cf87ad21b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:05.303290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079ee1-f218-4eb8-86b0-f23cf87ad21b None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:05.304676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 667/1324] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:05.310682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870aa5e-6a05-4668-8762-de3d8949fceb None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:05.311145 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870aa5e-6a05-4668-8762-de3d8949fceb None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:05.311262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870aa5e-6a05-4668-8762-de3d8949fceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:05.377205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e870aa5e-6a05-4668-8762-de3d8949fceb None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:05.378307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e870aa5e-6a05-4668-8762-de3d8949fceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:05.477190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 658/1325] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:05.758866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079ee1-f218-4eb8-86b0-f23cf87ad21b None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:05.760467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-96079ee1-f218-4eb8-86b0-f23cf87ad21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:05.872533 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079ee1-f218-4eb8-86b0-f23cf87ad21b None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:05.948821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1ebeb-66f1-48ac-a2da-53a9ef142203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:05.949343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1ebeb-66f1-48ac-a2da-53a9ef142203 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:05.949615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1ebeb-66f1-48ac-a2da-53a9ef142203 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:05.949879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1ebeb-66f1-48ac-a2da-53a9ef142203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:05.951998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-83c1ebeb-66f1-48ac-a2da-53a9ef142203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:05.977169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:06.077444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1ebeb-66f1-48ac-a2da-53a9ef142203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:06.078895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1ebeb-66f1-48ac-a2da-53a9ef142203 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:06.099652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 668/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:08.099116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc62c-634a-42ca-bbfe-faadfc0aa944 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:08.099653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc62c-634a-42ca-bbfe-faadfc0aa944 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:08.099653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917bc62c-634a-42ca-bbfe-faadfc0aa944 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:08.101046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 659/1327] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:08.106982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4924ef-5f8d-4b2c-8bfa-eabf12935457 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:08.107499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4924ef-5f8d-4b2c-8bfa-eabf12935457 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:08.107643 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4924ef-5f8d-4b2c-8bfa-eabf12935457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:08.180189 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-db4924ef-5f8d-4b2c-8bfa-eabf12935457 None None] MFA Rules not processed for user `e79e9344a59f4e098f27e679467d3246`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:08.181433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-db4924ef-5f8d-4b2c-8bfa-eabf12935457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:08.246965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:08.285024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 669/1328] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:08.565504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc62c-634a-42ca-bbfe-faadfc0aa944 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:08.567096 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-917bc62c-634a-42ca-bbfe-faadfc0aa944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:08.598017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:08.696791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917bc62c-634a-42ca-bbfe-faadfc0aa944 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:08.776317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4e21e-2c6f-43bd-8e94-04fadd936015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:08.776931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e21e-2c6f-43bd-8e94-04fadd936015 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:08.777212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e21e-2c6f-43bd-8e94-04fadd936015 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:08.777486 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4e21e-2c6f-43bd-8e94-04fadd936015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:08.779400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1fc4e21e-2c6f-43bd-8e94-04fadd936015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:08.858738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:08.893587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4e21e-2c6f-43bd-8e94-04fadd936015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:08.894969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc4e21e-2c6f-43bd-8e94-04fadd936015 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:08.914672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 660/1329] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:11.304777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2051e-48fd-4723-a4e4-3b3430730694 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:11.305262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2051e-48fd-4723-a4e4-3b3430730694 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:11.305391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2051e-48fd-4723-a4e4-3b3430730694 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:11.306665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 670/1330] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:11.312715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd9a9-17a4-4c2c-a44e-f199013bf90a None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:11.313167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd9a9-17a4-4c2c-a44e-f199013bf90a None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:11.313274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd9a9-17a4-4c2c-a44e-f199013bf90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:11.378727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-812bd9a9-17a4-4c2c-a44e-f199013bf90a None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:11.380001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-812bd9a9-17a4-4c2c-a44e-f199013bf90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:11.477593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 661/1331] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:11.764923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2051e-48fd-4723-a4e4-3b3430730694 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:11.766465 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3bf2051e-48fd-4723-a4e4-3b3430730694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:11.872904 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2051e-48fd-4723-a4e4-3b3430730694 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:11.948826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af5ce4-1f24-4eb7-81e9-b139e57e4607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:11.949480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af5ce4-1f24-4eb7-81e9-b139e57e4607 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:11.950694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af5ce4-1f24-4eb7-81e9-b139e57e4607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:11.950975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af5ce4-1f24-4eb7-81e9-b139e57e4607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:11.952625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f4af5ce4-1f24-4eb7-81e9-b139e57e4607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:11.979988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:12.061261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af5ce4-1f24-4eb7-81e9-b139e57e4607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:12.062599 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af5ce4-1f24-4eb7-81e9-b139e57e4607 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:12.081079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 671/1332] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:14.060125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9bef-84e1-4c5d-87e2-131ca251c5ec None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:14.060686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9bef-84e1-4c5d-87e2-131ca251c5ec None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:14.060686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f9bef-84e1-4c5d-87e2-131ca251c5ec None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:14.062087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 662/1333] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:14.067454 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc61a0-047e-47bc-8ba0-2a2798f4daa9 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:14.067860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc61a0-047e-47bc-8ba0-2a2798f4daa9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:14.068009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc61a0-047e-47bc-8ba0-2a2798f4daa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:14.133834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-76cc61a0-047e-47bc-8ba0-2a2798f4daa9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:14.135037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-76cc61a0-047e-47bc-8ba0-2a2798f4daa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:14.209562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:14.232078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 672/1334] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:14.526537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f9bef-84e1-4c5d-87e2-131ca251c5ec None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:14.528145 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0b0f9bef-84e1-4c5d-87e2-131ca251c5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:14.568630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:14.631875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f9bef-84e1-4c5d-87e2-131ca251c5ec None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:14.704698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2a32b-f1c2-4cec-aca4-0a7057e07af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:14.705295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2a32b-f1c2-4cec-aca4-0a7057e07af9 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:14.705568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2a32b-f1c2-4cec-aca4-0a7057e07af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:14.705842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2a32b-f1c2-4cec-aca4-0a7057e07af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:14.707439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-82a2a32b-f1c2-4cec-aca4-0a7057e07af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:14.790075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:14.816130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2a32b-f1c2-4cec-aca4-0a7057e07af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:14.817573 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2a32b-f1c2-4cec-aca4-0a7057e07af9 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:14.835660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 663/1335] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:17.319560 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e795b3-7b56-42c4-b355-61a7b8b79fa0 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:17.320092 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e795b3-7b56-42c4-b355-61a7b8b79fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:17.320092 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e795b3-7b56-42c4-b355-61a7b8b79fa0 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:17.321467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 673/1336] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:17.326634 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e2ba-8aa1-4767-a226-909212e3318b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:17.327038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e2ba-8aa1-4767-a226-909212e3318b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:17.327192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e2ba-8aa1-4767-a226-909212e3318b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:17.394720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4c94e2ba-8aa1-4767-a226-909212e3318b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:17.395978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4c94e2ba-8aa1-4767-a226-909212e3318b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:17.492779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 664/1337] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:08:17.793293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23702465-f206-445a-81da-8d74e5b3197b None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:17.793581 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23702465-f206-445a-81da-8d74e5b3197b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:17.793944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23702465-f206-445a-81da-8d74e5b3197b None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:17.795327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 674/1338] 10.222.0.20 () {54 vars in 965 bytes} [Wed Aug 24 17:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:17.801272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9cc9b-bf34-4ff9-8c54-ea742c06fbaa None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:17.801581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9cc9b-bf34-4ff9-8c54-ea742c06fbaa None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:17.801903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9cc9b-bf34-4ff9-8c54-ea742c06fbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:17.857171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:17.879300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-45b9cc9b-bf34-4ff9-8c54-ea742c06fbaa None None] MFA Rules not processed for user `e303777e78b7499fbff457254d14d360`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:17.880540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-45b9cc9b-bf34-4ff9-8c54-ea742c06fbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:17.963892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 665/1339] 10.222.0.20 () {58 vars in 1062 bytes} [Wed Aug 24 17:08:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:17.972947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23702465-f206-445a-81da-8d74e5b3197b None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:17.974509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-23702465-f206-445a-81da-8d74e5b3197b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:18.080310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23702465-f206-445a-81da-8d74e5b3197b None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:18.153751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefd388-150f-43ab-a441-8cc41f150a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:18.154362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefd388-150f-43ab-a441-8cc41f150a4c service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:18.154640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefd388-150f-43ab-a441-8cc41f150a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:18.154933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefd388-150f-43ab-a441-8cc41f150a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:18.156650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1fefd388-150f-43ab-a441-8cc41f150a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:18.193300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:18.267938 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefd388-150f-43ab-a441-8cc41f150a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:18.269471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefd388-150f-43ab-a441-8cc41f150a4c service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:18.290505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 675/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:23.143162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2397f-3d91-4d24-8e49-938dcebd4d40 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:23.143721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2397f-3d91-4d24-8e49-938dcebd4d40 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:23.143721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2397f-3d91-4d24-8e49-938dcebd4d40 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:23.145075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 666/1341] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:23.150681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ea5c6-3f84-465e-862e-2455c89a0c15 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:23.151145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ea5c6-3f84-465e-862e-2455c89a0c15 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:23.151241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ea5c6-3f84-465e-862e-2455c89a0c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:23.225056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-2d1ea5c6-3f84-465e-862e-2455c89a0c15 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:23.226302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2d1ea5c6-3f84-465e-862e-2455c89a0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:23.322869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:23.342412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 676/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:23.627375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2397f-3d91-4d24-8e49-938dcebd4d40 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:23.629093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-63a2397f-3d91-4d24-8e49-938dcebd4d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:23.738426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2397f-3d91-4d24-8e49-938dcebd4d40 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:23.778339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:23.816625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea47cc9-6002-4ac3-a334-fd98f7563623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:23.818788 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47cc9-6002-4ac3-a334-fd98f7563623 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:23.818788 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47cc9-6002-4ac3-a334-fd98f7563623 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:23.818788 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea47cc9-6002-4ac3-a334-fd98f7563623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:23.819408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7ea47cc9-6002-4ac3-a334-fd98f7563623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:23.940843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea47cc9-6002-4ac3-a334-fd98f7563623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:23.942197 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea47cc9-6002-4ac3-a334-fd98f7563623 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:23.962968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 667/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:26.938751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181e743-7a9f-43d2-ad02-2566554ec308 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:26.939289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181e743-7a9f-43d2-ad02-2566554ec308 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:26.939289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181e743-7a9f-43d2-ad02-2566554ec308 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:26.940668 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 677/1344] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:26.946082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182694f0-936a-4ae1-bb25-54ec88b5055b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:26.952301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182694f0-936a-4ae1-bb25-54ec88b5055b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:26.952301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182694f0-936a-4ae1-bb25-54ec88b5055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:27.014836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-182694f0-936a-4ae1-bb25-54ec88b5055b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:27.015968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-182694f0-936a-4ae1-bb25-54ec88b5055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:27.035746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:27.117239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 668/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:27.406192 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181e743-7a9f-43d2-ad02-2566554ec308 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:27.407783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b181e743-7a9f-43d2-ad02-2566554ec308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:27.522401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181e743-7a9f-43d2-ad02-2566554ec308 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:27.601774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a999474-6500-46f9-82ab-372a00693fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:27.602297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a999474-6500-46f9-82ab-372a00693fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:27.602577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a999474-6500-46f9-82ab-372a00693fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:27.602852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a999474-6500-46f9-82ab-372a00693fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:27.604514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1a999474-6500-46f9-82ab-372a00693fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:27.655993 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:27.726381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a999474-6500-46f9-82ab-372a00693fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:27.727853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a999474-6500-46f9-82ab-372a00693fb0 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:27.760302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 678/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:32.086684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591061e3-f765-4d81-94a9-1e84be7a9109 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:32.087256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591061e3-f765-4d81-94a9-1e84be7a9109 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:32.087256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591061e3-f765-4d81-94a9-1e84be7a9109 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:32.088613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 669/1347] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:32.094991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562695-b590-4afa-a2c7-f6c6e398479a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:32.095494 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562695-b590-4afa-a2c7-f6c6e398479a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:32.095606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45562695-b590-4afa-a2c7-f6c6e398479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:32.166300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-45562695-b590-4afa-a2c7-f6c6e398479a None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:32.167523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-45562695-b590-4afa-a2c7-f6c6e398479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:32.271769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:32.274400 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 679/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:32.561351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591061e3-f765-4d81-94a9-1e84be7a9109 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:32.562895 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-591061e3-f765-4d81-94a9-1e84be7a9109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:32.794255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591061e3-f765-4d81-94a9-1e84be7a9109 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:32.840934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:32.866745 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dfdc83-355c-4a12-b2da-351adade698b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:32.867346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdc83-355c-4a12-b2da-351adade698b service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:32.867624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdc83-355c-4a12-b2da-351adade698b service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:32.867893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfdc83-355c-4a12-b2da-351adade698b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:32.870241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-77dfdc83-355c-4a12-b2da-351adade698b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:32.979676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfdc83-355c-4a12-b2da-351adade698b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:32.981444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dfdc83-355c-4a12-b2da-351adade698b service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:33.000138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 670/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:38.231077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc302e5-4efb-40b1-b598-6acb0672a3f1 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:38.231077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc302e5-4efb-40b1-b598-6acb0672a3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:38.231077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc302e5-4efb-40b1-b598-6acb0672a3f1 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:38.231077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 680/1350] 10.222.0.20 () {54 vars in 921 bytes} [Wed Aug 24 17:08:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:38.237692 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d7067-89e6-44be-8420-90eb0aedac6a None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:38.238437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d7067-89e6-44be-8420-90eb0aedac6a None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:38.238870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d7067-89e6-44be-8420-90eb0aedac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:38.336034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6e3d7067-89e6-44be-8420-90eb0aedac6a None None] MFA Rules not processed for user `a698e566a46841cf83aa1711e83f8829`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:38.337575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6e3d7067-89e6-44be-8420-90eb0aedac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:38.357680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:38.463051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 671/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Aug 24 17:08:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:42.583283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad88b5-3d9d-482b-953b-98b590a987ea None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:42.583777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad88b5-3d9d-482b-953b-98b590a987ea None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:42.583777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad88b5-3d9d-482b-953b-98b590a987ea None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:42.585273 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 681/1352] 10.222.0.20 () {54 vars in 921 bytes} [Wed Aug 24 17:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:42.591334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9823b7-cec7-4ae3-88f0-dbade2314d60 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:42.591860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9823b7-cec7-4ae3-88f0-dbade2314d60 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:42.591860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9823b7-cec7-4ae3-88f0-dbade2314d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:42.673960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0b9823b7-cec7-4ae3-88f0-dbade2314d60 None None] MFA Rules not processed for user `a698e566a46841cf83aa1711e83f8829`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:42.675180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0b9823b7-cec7-4ae3-88f0-dbade2314d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:42.755119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:42.795336 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 672/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Aug 24 17:08:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:44.285242 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae552b83-9738-48db-8c99-0d4552676040 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:44.286743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae552b83-9738-48db-8c99-0d4552676040 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:44.287564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae552b83-9738-48db-8c99-0d4552676040 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:44.290041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 682/1354] 10.222.0.20 () {54 vars in 921 bytes} [Wed Aug 24 17:08:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:44.296484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df396ee3-df05-40df-8c6a-79ec4f83a198 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:44.297019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df396ee3-df05-40df-8c6a-79ec4f83a198 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:44.297019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df396ee3-df05-40df-8c6a-79ec4f83a198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:44.386781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-df396ee3-df05-40df-8c6a-79ec4f83a198 None None] MFA Rules not processed for user `a698e566a46841cf83aa1711e83f8829`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:44.388141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-df396ee3-df05-40df-8c6a-79ec4f83a198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:44.508857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 673/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Aug 24 17:08:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:47.963630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e06cb-79c7-4ad7-b98c-4c46352d0f6f None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:47.964892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e06cb-79c7-4ad7-b98c-4c46352d0f6f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:47.964892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e06cb-79c7-4ad7-b98c-4c46352d0f6f None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:47.966540 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 683/1356] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:47.971787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a80d58-61bf-4637-8438-a7a6f19aaf6d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:47.972358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a80d58-61bf-4637-8438-a7a6f19aaf6d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:47.972477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a80d58-61bf-4637-8438-a7a6f19aaf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:48.008524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:48.043715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-69a80d58-61bf-4637-8438-a7a6f19aaf6d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:48.047009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-69a80d58-61bf-4637-8438-a7a6f19aaf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:48.184565 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 674/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:08:48.508624 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a147555-c2fe-4c26-ada1-07060be2f886 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:48.509288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a147555-c2fe-4c26-ada1-07060be2f886 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:48.509791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a147555-c2fe-4c26-ada1-07060be2f886 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:48.511770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 684/1358] 10.222.0.20 () {54 vars in 962 bytes} [Wed Aug 24 17:08:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:48.526601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd048-312c-441f-b05a-82dc218e3eea None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:48.526805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd048-312c-441f-b05a-82dc218e3eea None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:48.527167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd048-312c-441f-b05a-82dc218e3eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:48.625749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-848bd048-312c-441f-b05a-82dc218e3eea None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:48.627253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-848bd048-312c-441f-b05a-82dc218e3eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:48.696204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:48.783553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 675/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Aug 24 17:08:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:48.793404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a147555-c2fe-4c26-ada1-07060be2f886 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:48.795684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8a147555-c2fe-4c26-ada1-07060be2f886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:48.969902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a147555-c2fe-4c26-ada1-07060be2f886 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:49.051800 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:49.096608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8597-08e0-47e3-8b9a-f55b65f35bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:49.097223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8597-08e0-47e3-8b9a-f55b65f35bb3 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:49.097502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8597-08e0-47e3-8b9a-f55b65f35bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:49.097775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8597-08e0-47e3-8b9a-f55b65f35bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:49.099418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-addf8597-08e0-47e3-8b9a-f55b65f35bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:49.196571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf8597-08e0-47e3-8b9a-f55b65f35bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:49.198280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf8597-08e0-47e3-8b9a-f55b65f35bb3 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:49.218356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 685/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:51.369994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9618c3-2d8b-4bf0-92a7-5ec4ac498ce0 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:51.370552 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9618c3-2d8b-4bf0-92a7-5ec4ac498ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:51.370552 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9618c3-2d8b-4bf0-92a7-5ec4ac498ce0 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:51.372207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 676/1361] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:51.377941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae364284-3b21-4f01-ac0a-03c6267eb0b0 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:51.378506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae364284-3b21-4f01-ac0a-03c6267eb0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:51.378506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae364284-3b21-4f01-ac0a-03c6267eb0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:51.459588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ae364284-3b21-4f01-ac0a-03c6267eb0b0 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:51.460885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ae364284-3b21-4f01-ac0a-03c6267eb0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:51.511404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:51.587631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 686/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:51.916686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9618c3-2d8b-4bf0-92a7-5ec4ac498ce0 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:51.918505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5b9618c3-2d8b-4bf0-92a7-5ec4ac498ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:52.091680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9618c3-2d8b-4bf0-92a7-5ec4ac498ce0 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:52.101557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:52.218624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55998f-69c3-43c8-a5fe-020f16083682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:52.219235 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55998f-69c3-43c8-a5fe-020f16083682 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:52.219574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55998f-69c3-43c8-a5fe-020f16083682 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:52.219851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55998f-69c3-43c8-a5fe-020f16083682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:52.221518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6f55998f-69c3-43c8-a5fe-020f16083682 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:52.336941 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55998f-69c3-43c8-a5fe-020f16083682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:52.338575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f55998f-69c3-43c8-a5fe-020f16083682 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:52.358670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 677/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:54.799013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bdb08-08f1-4650-87a4-db217d8e7884 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:54.799585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bdb08-08f1-4650-87a4-db217d8e7884 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:54.799585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bdb08-08f1-4650-87a4-db217d8e7884 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:54.800911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 687/1364] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:54.806674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36047f51-773d-4dc6-9d70-8c5e3ef505f4 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:54.807312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36047f51-773d-4dc6-9d70-8c5e3ef505f4 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:54.807437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36047f51-773d-4dc6-9d70-8c5e3ef505f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:54.833168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:54.895463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-36047f51-773d-4dc6-9d70-8c5e3ef505f4 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:54.896885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-36047f51-773d-4dc6-9d70-8c5e3ef505f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:55.008296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 678/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:55.304656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b31a8-be56-4a55-8324-7c291213d673 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:55.305270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b31a8-be56-4a55-8324-7c291213d673 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:55.305649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b31a8-be56-4a55-8324-7c291213d673 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:55.307351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 688/1366] 10.222.0.20 () {54 vars in 962 bytes} [Wed Aug 24 17:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:55.313095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d549de1-0ddb-454d-a8ae-fbe0a19d44fa None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:55.313480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d549de1-0ddb-454d-a8ae-fbe0a19d44fa None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:55.318452 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d549de1-0ddb-454d-a8ae-fbe0a19d44fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:55.402644 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-3d549de1-0ddb-454d-a8ae-fbe0a19d44fa None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:55.404074 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3d549de1-0ddb-454d-a8ae-fbe0a19d44fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:55.444151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:55.538133 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 679/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Aug 24 17:08:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:08:55.547444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b31a8-be56-4a55-8324-7c291213d673 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:55.549121 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-806b31a8-be56-4a55-8324-7c291213d673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:55.720449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b31a8-be56-4a55-8324-7c291213d673 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:55.742422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:55.848368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7f2f7-2adb-4f74-a448-662c7b149c8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:55.849020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7f2f7-2adb-4f74-a448-662c7b149c8a service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:55.849125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7f2f7-2adb-4f74-a448-662c7b149c8a service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:55.849385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7f2f7-2adb-4f74-a448-662c7b149c8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:55.851042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0bf7f2f7-2adb-4f74-a448-662c7b149c8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:55.948528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7f2f7-2adb-4f74-a448-662c7b149c8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:55.950181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7f2f7-2adb-4f74-a448-662c7b149c8a service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:55.970038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 689/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:56.439125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119a28e-d276-45c0-bcba-e6e5afb28b92 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:56.439640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119a28e-d276-45c0-bcba-e6e5afb28b92 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:56.439640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119a28e-d276-45c0-bcba-e6e5afb28b92 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:56.441006 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 680/1369] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:56.446484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb61f5-97f4-48c2-a13a-0cc7e4341a42 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:56.446914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb61f5-97f4-48c2-a13a-0cc7e4341a42 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:56.447229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb61f5-97f4-48c2-a13a-0cc7e4341a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:56.482773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:56.525155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c3fb61f5-97f4-48c2-a13a-0cc7e4341a42 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:56.526693 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c3fb61f5-97f4-48c2-a13a-0cc7e4341a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:56.635189 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 690/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:57.232359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534223f-074e-4939-b3ab-4c2b48fc9de8 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:57.232359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534223f-074e-4939-b3ab-4c2b48fc9de8 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:57.232359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534223f-074e-4939-b3ab-4c2b48fc9de8 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:57.232359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 681/1371] 10.222.0.20 () {54 vars in 964 bytes} [Wed Aug 24 17:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:57.238537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e38c65-63fb-4198-a6e1-35a1e7294521 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:57.238537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e38c65-63fb-4198-a6e1-35a1e7294521 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:57.238537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e38c65-63fb-4198-a6e1-35a1e7294521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:57.328130 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-52e38c65-63fb-4198-a6e1-35a1e7294521 None None] MFA Rules not processed for user `009e5ad7d256449495c74dad67741f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:57.328568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-52e38c65-63fb-4198-a6e1-35a1e7294521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:57.382266 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:57.415791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 691/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Wed Aug 24 17:08:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:08:57.424087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534223f-074e-4939-b3ab-4c2b48fc9de8 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:57.425666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4534223f-074e-4939-b3ab-4c2b48fc9de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:57.534908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534223f-074e-4939-b3ab-4c2b48fc9de8 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:57.577713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:57.615969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec1131-3cd0-43c5-85e2-36d443cb6edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:57.616617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec1131-3cd0-43c5-85e2-36d443cb6edd service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:57.616895 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec1131-3cd0-43c5-85e2-36d443cb6edd service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:57.617161 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec1131-3cd0-43c5-85e2-36d443cb6edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:57.618767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9cec1131-3cd0-43c5-85e2-36d443cb6edd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:57.742233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec1131-3cd0-43c5-85e2-36d443cb6edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:57.743942 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec1131-3cd0-43c5-85e2-36d443cb6edd service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:57.767039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 682/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:08:58.234689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a13e1-060d-4e8b-9ffd-59085c2f9ed4 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:58.234984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a13e1-060d-4e8b-9ffd-59085c2f9ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:58.235257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a13e1-060d-4e8b-9ffd-59085c2f9ed4 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:58.236634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 692/1374] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:58.241869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599a2dc-1e22-436e-b70b-dcb03df92128 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:58.242227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599a2dc-1e22-436e-b70b-dcb03df92128 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:58.242575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599a2dc-1e22-436e-b70b-dcb03df92128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:58.311981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e599a2dc-1e22-436e-b70b-dcb03df92128 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:58.313257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e599a2dc-1e22-436e-b70b-dcb03df92128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:58.334286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:58.412214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 683/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:58.703923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a13e1-060d-4e8b-9ffd-59085c2f9ed4 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:58.705658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0b1a13e1-060d-4e8b-9ffd-59085c2f9ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:58.854346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a13e1-060d-4e8b-9ffd-59085c2f9ed4 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:58.908454 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:58.972085 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab9b6f-9dfd-4549-82bd-18fba54840fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:58.972724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab9b6f-9dfd-4549-82bd-18fba54840fd service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:58.973002 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab9b6f-9dfd-4549-82bd-18fba54840fd service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:58.973268 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab9b6f-9dfd-4549-82bd-18fba54840fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:58.974871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d7ab9b6f-9dfd-4549-82bd-18fba54840fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:59.067238 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab9b6f-9dfd-4549-82bd-18fba54840fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:59.068877 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab9b6f-9dfd-4549-82bd-18fba54840fd service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:59.087572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 693/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:01.221488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faaa47-070f-4402-b76e-3d0af9528eb4 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:01.222026 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faaa47-070f-4402-b76e-3d0af9528eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:01.222026 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83faaa47-070f-4402-b76e-3d0af9528eb4 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:01.223379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 684/1377] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:01.229140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfce75b-25e2-4ded-abd5-039bd0510a23 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:01.230104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfce75b-25e2-4ded-abd5-039bd0510a23 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:01.230589 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfce75b-25e2-4ded-abd5-039bd0510a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:01.307214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-edfce75b-25e2-4ded-abd5-039bd0510a23 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:01.308735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-edfce75b-25e2-4ded-abd5-039bd0510a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:01.315453 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:01.423729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 694/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:01.742401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83faaa47-070f-4402-b76e-3d0af9528eb4 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:01.743973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-83faaa47-070f-4402-b76e-3d0af9528eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:01.911781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83faaa47-070f-4402-b76e-3d0af9528eb4 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:01.916820 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:02.038309 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f0f4b-6b3c-4ef3-8fe0-589e19fd0737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:02.038836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f0f4b-6b3c-4ef3-8fe0-589e19fd0737 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:02.039110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f0f4b-6b3c-4ef3-8fe0-589e19fd0737 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:02.039376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f0f4b-6b3c-4ef3-8fe0-589e19fd0737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:02.041700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6f0f0f4b-6b3c-4ef3-8fe0-589e19fd0737 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:02.139443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f0f4b-6b3c-4ef3-8fe0-589e19fd0737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:02.141123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f0f4b-6b3c-4ef3-8fe0-589e19fd0737 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:02.161704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 685/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:04.401870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0758fd-0dc2-464d-8d79-6768ff5c7aa6 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:04.402433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0758fd-0dc2-464d-8d79-6768ff5c7aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:04.402433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0758fd-0dc2-464d-8d79-6768ff5c7aa6 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:04.403681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 695/1380] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:04.410056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a46e48-d416-4c84-a25f-4fb992432a5a None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:04.410636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a46e48-d416-4c84-a25f-4fb992432a5a None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:04.410636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a46e48-d416-4c84-a25f-4fb992432a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:04.422977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:04.482582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-c4a46e48-d416-4c84-a25f-4fb992432a5a None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:04.483811 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c4a46e48-d416-4c84-a25f-4fb992432a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:04.590930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 686/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:04.881780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0758fd-0dc2-464d-8d79-6768ff5c7aa6 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:04.883301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4a0758fd-0dc2-464d-8d79-6768ff5c7aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:05.033142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:05.045636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0758fd-0dc2-464d-8d79-6768ff5c7aa6 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:05.174474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6785ff-2154-4d3a-92a6-953245d344f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:05.175008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6785ff-2154-4d3a-92a6-953245d344f9 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:05.175264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6785ff-2154-4d3a-92a6-953245d344f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:05.175629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6785ff-2154-4d3a-92a6-953245d344f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:05.177408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-dc6785ff-2154-4d3a-92a6-953245d344f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:05.275078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6785ff-2154-4d3a-92a6-953245d344f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:05.277565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6785ff-2154-4d3a-92a6-953245d344f9 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:05.292374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:05.297074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 696/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:07.453056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f9c1c-801c-4a86-bc5b-95a20bcd687f None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:07.453776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f9c1c-801c-4a86-bc5b-95a20bcd687f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:07.453776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f9c1c-801c-4a86-bc5b-95a20bcd687f None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:07.454891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 687/1383] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:07.461840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fa3c-9b04-4927-ad1b-b6df562fa6e7 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:07.462477 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fa3c-9b04-4927-ad1b-b6df562fa6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:07.463651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fa3c-9b04-4927-ad1b-b6df562fa6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:07.535410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-e332fa3c-9b04-4927-ad1b-b6df562fa6e7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:07.536941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e332fa3c-9b04-4927-ad1b-b6df562fa6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:07.639087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 697/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:09:07.942013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f9c1c-801c-4a86-bc5b-95a20bcd687f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:07.944164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-557f9c1c-801c-4a86-bc5b-95a20bcd687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:08.055426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:08.119686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f9c1c-801c-4a86-bc5b-95a20bcd687f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:08.238833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9a2ba-cfda-4fe8-ba50-d3c5f55adc95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:08.239459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9a2ba-cfda-4fe8-ba50-d3c5f55adc95 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:08.239729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9a2ba-cfda-4fe8-ba50-d3c5f55adc95 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:08.239993 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9a2ba-cfda-4fe8-ba50-d3c5f55adc95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:08.241606 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-09b9a2ba-cfda-4fe8-ba50-d3c5f55adc95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:08.301288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:08.344211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9a2ba-cfda-4fe8-ba50-d3c5f55adc95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:08.345831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9a2ba-cfda-4fe8-ba50-d3c5f55adc95 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:08.364002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 688/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:10.293997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c288fae-ca25-4563-94a2-6af2a9ddf737 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:10.294457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c288fae-ca25-4563-94a2-6af2a9ddf737 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:10.294579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c288fae-ca25-4563-94a2-6af2a9ddf737 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:10.295882 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 698/1386] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:10.302439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5f70-859a-429a-b236-ee77a0461401 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:10.302891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5f70-859a-429a-b236-ee77a0461401 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:10.303097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b5f70-859a-429a-b236-ee77a0461401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:10.372171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-9e3b5f70-859a-429a-b236-ee77a0461401 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:10.373438 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9e3b5f70-859a-429a-b236-ee77a0461401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:10.476802 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 689/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:10.781684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c288fae-ca25-4563-94a2-6af2a9ddf737 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:10.783300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8c288fae-ca25-4563-94a2-6af2a9ddf737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:10.872276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:10.946804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c288fae-ca25-4563-94a2-6af2a9ddf737 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:11.070626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1bf67-2e00-49c1-8443-dd97679573f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:11.071330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1bf67-2e00-49c1-8443-dd97679573f7 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:11.071591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1bf67-2e00-49c1-8443-dd97679573f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:11.071965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1bf67-2e00-49c1-8443-dd97679573f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:11.074645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-55c1bf67-2e00-49c1-8443-dd97679573f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:11.119413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:11.173606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1bf67-2e00-49c1-8443-dd97679573f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:11.175208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1bf67-2e00-49c1-8443-dd97679573f7 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:11.193802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 699/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:13.303907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f474c58-b9a1-455e-b353-2dfa7469d657 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:13.304465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f474c58-b9a1-455e-b353-2dfa7469d657 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:13.304578 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f474c58-b9a1-455e-b353-2dfa7469d657 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:13.305883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 690/1389] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:13.312570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff19a56-5701-4836-9ffc-df8488de5ac3 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:13.313048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff19a56-5701-4836-9ffc-df8488de5ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:13.313141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff19a56-5701-4836-9ffc-df8488de5ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:13.384169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-4ff19a56-5701-4836-9ffc-df8488de5ac3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:13.385724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4ff19a56-5701-4836-9ffc-df8488de5ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:13.503748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 700/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:13.729247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29496c6-be87-4a29-8a7e-330b43d2abb3 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:13.729655 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29496c6-be87-4a29-8a7e-330b43d2abb3 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:13.729906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29496c6-be87-4a29-8a7e-330b43d2abb3 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:13.731265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 691/1391] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:13.736641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56192-3d07-4795-b4d5-71d79ec0c5b9 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:13.736924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56192-3d07-4795-b4d5-71d79ec0c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:13.737223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee56192-3d07-4795-b4d5-71d79ec0c5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:13.753226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:13.806215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29496c6-be87-4a29-8a7e-330b43d2abb3 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:13.807543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-6ee56192-3d07-4795-b4d5-71d79ec0c5b9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:13.808389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e29496c6-be87-4a29-8a7e-330b43d2abb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:13.808789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6ee56192-3d07-4795-b4d5-71d79ec0c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:13.840249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:13.913714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 701/1392] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:13.967737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29496c6-be87-4a29-8a7e-330b43d2abb3 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:14.074558 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:14.086605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a1124-f66d-49b2-acc8-38c1d0656cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:14.087199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a1124-f66d-49b2-acc8-38c1d0656cdc service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:14.087984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a1124-f66d-49b2-acc8-38c1d0656cdc service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:14.088273 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a1124-f66d-49b2-acc8-38c1d0656cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:14.089968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2c4a1124-f66d-49b2-acc8-38c1d0656cdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:14.182390 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a1124-f66d-49b2-acc8-38c1d0656cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:14.184072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a1124-f66d-49b2-acc8-38c1d0656cdc service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:14.203594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 692/1393] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:09:14.224851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eea15-5bfa-44f1-9fc1-96629ac3e0a9 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:14.225087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eea15-5bfa-44f1-9fc1-96629ac3e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:14.225360 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eea15-5bfa-44f1-9fc1-96629ac3e0a9 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:14.226687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 702/1394] 10.222.0.20 () {54 vars in 967 bytes} [Wed Aug 24 17:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:14.232271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dc9e4-a428-4239-8887-3e7c04b5b973 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:14.232605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dc9e4-a428-4239-8887-3e7c04b5b973 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:14.232878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516dc9e4-a428-4239-8887-3e7c04b5b973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:14.316093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-516dc9e4-a428-4239-8887-3e7c04b5b973 None None] MFA Rules not processed for user `1684abe7e6aa44a0873e43dfc146c1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:14.317338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-516dc9e4-a428-4239-8887-3e7c04b5b973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:14.374926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:14.399139 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 693/1395] 10.222.0.20 () {58 vars in 1064 bytes} [Wed Aug 24 17:09:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:14.407360 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992eea15-5bfa-44f1-9fc1-96629ac3e0a9 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:14.408911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-992eea15-5bfa-44f1-9fc1-96629ac3e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:14.526635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:14.535265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992eea15-5bfa-44f1-9fc1-96629ac3e0a9 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:14.625729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2f4e9-0d7e-4998-95f7-10a013914264 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1684abe7e6aa44a0873e43dfc146c1b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:14.626257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f4e9-0d7e-4998-95f7-10a013914264 service glance] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:14.626536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f4e9-0d7e-4998-95f7-10a013914264 service glance] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:14.626810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2f4e9-0d7e-4998-95f7-10a013914264 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:14.628452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-acb2f4e9-0d7e-4998-95f7-10a013914264 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:14.748865 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2f4e9-0d7e-4998-95f7-10a013914264 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:14.750329 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2f4e9-0d7e-4998-95f7-10a013914264 service glance] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:14.772444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 703/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:15.695708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504aff6-80d5-4205-80d8-f00438df1c64 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:15.696187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504aff6-80d5-4205-80d8-f00438df1c64 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:15.696424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504aff6-80d5-4205-80d8-f00438df1c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:15.765725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8504aff6-80d5-4205-80d8-f00438df1c64 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:15.766951 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8504aff6-80d5-4205-80d8-f00438df1c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:15.857333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 694/1397] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:09:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:15.906980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026624e-f237-4094-8bb9-d7c8bdd4839e None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:15.907478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026624e-f237-4094-8bb9-d7c8bdd4839e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:15.907593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026624e-f237-4094-8bb9-d7c8bdd4839e None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:15.908900 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 704/1398] 10.222.0.20 () {54 vars in 943 bytes} [Wed Aug 24 17:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:15.915816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa78c38-36f3-46e1-8fc9-b97abd4842b1 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:15.916213 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa78c38-36f3-46e1-8fc9-b97abd4842b1 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:15.916522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa78c38-36f3-46e1-8fc9-b97abd4842b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:16.008722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-eaa78c38-36f3-46e1-8fc9-b97abd4842b1 None None] MFA Rules not processed for user `84368e89b0b34a54996def03671a1454`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:16.010846 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-eaa78c38-36f3-46e1-8fc9-b97abd4842b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:16.024582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:16.122784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 695/1399] 10.222.0.20 () {58 vars in 1040 bytes} [Wed Aug 24 17:09:15 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:09:16.131734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026624e-f237-4094-8bb9-d7c8bdd4839e None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:16.133338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2026624e-f237-4094-8bb9-d7c8bdd4839e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:16.158747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:16.273671 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026624e-f237-4094-8bb9-d7c8bdd4839e None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:16.377665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979aedba-ae75-4e17-bf4c-fa9d2a6b3a42 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:16.377855 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979aedba-ae75-4e17-bf4c-fa9d2a6b3a42 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:16.378126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979aedba-ae75-4e17-bf4c-fa9d2a6b3a42 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:16.379631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 696/1400] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:16.382020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13ca89-bda4-4bbb-8f3d-91b9e4a0215b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:16.382624 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13ca89-bda4-4bbb-8f3d-91b9e4a0215b service swift] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:16.382898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13ca89-bda4-4bbb-8f3d-91b9e4a0215b service swift] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:16.383165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13ca89-bda4-4bbb-8f3d-91b9e4a0215b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:16.385383 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5b13ca89-bda4-4bbb-8f3d-91b9e4a0215b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:16.385680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b524c-6df6-4a7c-ad83-16da15689a3f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:16.385782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b524c-6df6-4a7c-ad83-16da15689a3f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:16.386027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b524c-6df6-4a7c-ad83-16da15689a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:16.393349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:16.453446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a91b524c-6df6-4a7c-ad83-16da15689a3f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:16.454683 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a91b524c-6df6-4a7c-ad83-16da15689a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:16.471578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13ca89-bda4-4bbb-8f3d-91b9e4a0215b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:16.473201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13ca89-bda4-4bbb-8f3d-91b9e4a0215b service swift] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:16.482198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 705/1401] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:09:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:09:16.532647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:16.555623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 697/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:09:16.850425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13ca89-bda4-4bbb-8f3d-91b9e4a0215b service swift] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:16.851639 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5b13ca89-bda4-4bbb-8f3d-91b9e4a0215b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:16.962084 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13ca89-bda4-4bbb-8f3d-91b9e4a0215b service swift] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:17.022519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:17.087613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4667101-f1ff-4309-b782-2c105620c9c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:17.088456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667101-f1ff-4309-b782-2c105620c9c3 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:17.088739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667101-f1ff-4309-b782-2c105620c9c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:17.089008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4667101-f1ff-4309-b782-2c105620c9c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:17.090627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a4667101-f1ff-4309-b782-2c105620c9c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:17.190622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4667101-f1ff-4309-b782-2c105620c9c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:17.192322 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4667101-f1ff-4309-b782-2c105620c9c3 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:17.213078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 706/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:19.303187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1525d-cacd-4d48-a87a-f91028abe456 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:19.303779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1525d-cacd-4d48-a87a-f91028abe456 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:19.303779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f1525d-cacd-4d48-a87a-f91028abe456 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:19.305234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 698/1404] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:19.311126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f0d6-c463-48c0-996c-25a294f9445d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:19.311586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f0d6-c463-48c0-996c-25a294f9445d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:19.311691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23f0d6-c463-48c0-996c-25a294f9445d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:19.387659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-9c23f0d6-c463-48c0-996c-25a294f9445d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:19.388986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-9c23f0d6-c463-48c0-996c-25a294f9445d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:19.408149 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:19.504412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 707/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:19.847789 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1525d-cacd-4d48-a87a-f91028abe456 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:19.849359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-05f1525d-cacd-4d48-a87a-f91028abe456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:20.036369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f1525d-cacd-4d48-a87a-f91028abe456 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:20.105045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:20.167567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798c9f3-b7b5-4122-b255-033cffc29cb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:20.169770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798c9f3-b7b5-4122-b255-033cffc29cb0 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:20.169770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798c9f3-b7b5-4122-b255-033cffc29cb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:20.169770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798c9f3-b7b5-4122-b255-033cffc29cb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:20.171088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c798c9f3-b7b5-4122-b255-033cffc29cb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:20.276411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798c9f3-b7b5-4122-b255-033cffc29cb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:20.278678 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798c9f3-b7b5-4122-b255-033cffc29cb0 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:20.306979 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 699/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:22.484159 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3f499-fb9f-409e-b698-fc4b9704670e None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:22.487091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3f499-fb9f-409e-b698-fc4b9704670e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:22.487389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3f499-fb9f-409e-b698-fc4b9704670e None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:22.489466 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 708/1407] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:09:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:22.494518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb193-5ecd-4d5a-a531-35719edf2a90 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:22.495035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb193-5ecd-4d5a-a531-35719edf2a90 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:22.495035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152bb193-5ecd-4d5a-a531-35719edf2a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:22.564559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-152bb193-5ecd-4d5a-a531-35719edf2a90 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:22.566048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-152bb193-5ecd-4d5a-a531-35719edf2a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:22.586029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:22.677616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 700/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:22.966254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3f499-fb9f-409e-b698-fc4b9704670e None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:22.967905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a5c3f499-fb9f-409e-b698-fc4b9704670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:23.136839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:23.142523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3f499-fb9f-409e-b698-fc4b9704670e None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:23.276604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8520058-7578-4d09-9a75-cb72ad60939a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:23.277676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8520058-7578-4d09-9a75-cb72ad60939a service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:23.278154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8520058-7578-4d09-9a75-cb72ad60939a service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:23.278610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8520058-7578-4d09-9a75-cb72ad60939a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:23.280637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b8520058-7578-4d09-9a75-cb72ad60939a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:23.452253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8520058-7578-4d09-9a75-cb72ad60939a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:23.453899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8520058-7578-4d09-9a75-cb72ad60939a service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:23.479794 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 709/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:32.675562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=35 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:33.476313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:40.021888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edea41-50df-4416-9166-edf66d7a793d None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:40.022474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edea41-50df-4416-9166-edf66d7a793d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:40.022474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edea41-50df-4416-9166-edf66d7a793d None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:40.024517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 701/1410] 10.222.0.20 () {54 vars in 918 bytes} [Wed Aug 24 17:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:40.030887 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ef075-8d24-47ac-9337-c08201011f24 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:40.031450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ef075-8d24-47ac-9337-c08201011f24 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:40.031450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ef075-8d24-47ac-9337-c08201011f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:40.114312 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-6d6ef075-8d24-47ac-9337-c08201011f24 None None] MFA Rules not processed for user `a698e566a46841cf83aa1711e83f8829`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:40.115534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6d6ef075-8d24-47ac-9337-c08201011f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:40.223579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 710/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Aug 24 17:09:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:40.237932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5438-2d2e-46b0-9efb-adaae0854261 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:40.238143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5438-2d2e-46b0-9efb-adaae0854261 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:40.238408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5438-2d2e-46b0-9efb-adaae0854261 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:40.239733 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 702/1412] 10.222.0.20 () {54 vars in 918 bytes} [Wed Aug 24 17:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:40.244908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c14df-7f0f-4707-a134-802011e6ddbb None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:40.245210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c14df-7f0f-4707-a134-802011e6ddbb None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:40.245480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c14df-7f0f-4707-a134-802011e6ddbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:40.321986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:40.325228 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-d99c14df-7f0f-4707-a134-802011e6ddbb None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:40.326443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d99c14df-7f0f-4707-a134-802011e6ddbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:40.443286 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 711/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Aug 24 17:09:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:42.886980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f01c7-ba77-41a4-a6bd-c5255a6077f6 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:42.887528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f01c7-ba77-41a4-a6bd-c5255a6077f6 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:42.887528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f01c7-ba77-41a4-a6bd-c5255a6077f6 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:42.888915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:42.894583 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58b2bf-4629-48be-9deb-0add0e96d48e None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:42.895058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58b2bf-4629-48be-9deb-0add0e96d48e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:42.895233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58b2bf-4629-48be-9deb-0add0e96d48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:42.962390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-fb58b2bf-4629-48be-9deb-0add0e96d48e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:42.963612 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fb58b2bf-4629-48be-9deb-0add0e96d48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:43.021239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:43.066278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:43.368787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f01c7-ba77-41a4-a6bd-c5255a6077f6 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:43.370738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-909f01c7-ba77-41a4-a6bd-c5255a6077f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:43.551175 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f01c7-ba77-41a4-a6bd-c5255a6077f6 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:43.640295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:43.690045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2707868-1aa6-4566-bb8d-3f440ba70419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:43.690658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2707868-1aa6-4566-bb8d-3f440ba70419 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:43.690931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2707868-1aa6-4566-bb8d-3f440ba70419 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:43.691198 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2707868-1aa6-4566-bb8d-3f440ba70419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:43.693021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d2707868-1aa6-4566-bb8d-3f440ba70419 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:43.795100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2707868-1aa6-4566-bb8d-3f440ba70419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:43.796733 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2707868-1aa6-4566-bb8d-3f440ba70419 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:43.815327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 704/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:44.755577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd0fed-f4fc-4b27-b932-017fd3c251cb None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:44.756145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd0fed-f4fc-4b27-b932-017fd3c251cb None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:44.756145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd0fed-f4fc-4b27-b932-017fd3c251cb None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:44.757955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:44.763767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ee718-4019-4513-b7c7-ea2daf0a6b18 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:44.764434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ee718-4019-4513-b7c7-ea2daf0a6b18 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:44.764434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ee718-4019-4513-b7c7-ea2daf0a6b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:44.844883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-7d4ee718-4019-4513-b7c7-ea2daf0a6b18 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:44.846108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7d4ee718-4019-4513-b7c7-ea2daf0a6b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:44.874087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:44.954786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:45.106255 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd0fed-f4fc-4b27-b932-017fd3c251cb None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:45.107874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0cfd0fed-f4fc-4b27-b932-017fd3c251cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:45.261805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd0fed-f4fc-4b27-b932-017fd3c251cb None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:45.311245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:45.390053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4cc29-cd6d-42be-af70-82fff990d130 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:45.390564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4cc29-cd6d-42be-af70-82fff990d130 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:45.390839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4cc29-cd6d-42be-af70-82fff990d130 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:45.391111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4cc29-cd6d-42be-af70-82fff990d130 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:45.392776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-aef4cc29-cd6d-42be-af70-82fff990d130 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:45.486160 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4cc29-cd6d-42be-af70-82fff990d130 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:45.490413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4cc29-cd6d-42be-af70-82fff990d130 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:45.507341 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 714/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:46.424744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428012bd-5c6f-414f-b03d-f2dbe4eecf71 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:46.425443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428012bd-5c6f-414f-b03d-f2dbe4eecf71 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:46.425443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428012bd-5c6f-414f-b03d-f2dbe4eecf71 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:46.426824 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:46.434165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ffef4-5c17-4b6e-ae86-042009842a49 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:46.434745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ffef4-5c17-4b6e-ae86-042009842a49 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:46.434745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ffef4-5c17-4b6e-ae86-042009842a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:46.504988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:46.532667 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-bb6ffef4-5c17-4b6e-ae86-042009842a49 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:46.533925 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bb6ffef4-5c17-4b6e-ae86-042009842a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:46.669195 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:46.845376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428012bd-5c6f-414f-b03d-f2dbe4eecf71 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:46.848162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-428012bd-5c6f-414f-b03d-f2dbe4eecf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:47.044251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428012bd-5c6f-414f-b03d-f2dbe4eecf71 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:47.059159 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:47.199308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e60cc-15d1-4bc2-a5f5-7d2ee9007087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:47.199928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e60cc-15d1-4bc2-a5f5-7d2ee9007087 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:47.200216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e60cc-15d1-4bc2-a5f5-7d2ee9007087 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:47.200526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e60cc-15d1-4bc2-a5f5-7d2ee9007087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:47.202196 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0d4e60cc-15d1-4bc2-a5f5-7d2ee9007087 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:47.325708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e60cc-15d1-4bc2-a5f5-7d2ee9007087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:47.327306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e60cc-15d1-4bc2-a5f5-7d2ee9007087 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:47.347729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 707/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:09:48.294535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604f1b-a566-473b-a2ab-d2b8cd99ed9f None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:48.295030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604f1b-a566-473b-a2ab-d2b8cd99ed9f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:48.295192 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df604f1b-a566-473b-a2ab-d2b8cd99ed9f None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:48.296517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:09:48.302026 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e605c-1a39-4dfd-b713-1e947f79758c None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:48.302534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e605c-1a39-4dfd-b713-1e947f79758c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:48.302649 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e605c-1a39-4dfd-b713-1e947f79758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:48.325236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:48.390703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-2b1e605c-1a39-4dfd-b713-1e947f79758c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:48.391972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2b1e605c-1a39-4dfd-b713-1e947f79758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:48.501724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:48.774516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604f1b-a566-473b-a2ab-d2b8cd99ed9f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:48.776297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-df604f1b-a566-473b-a2ab-d2b8cd99ed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:48.928776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:48.972075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df604f1b-a566-473b-a2ab-d2b8cd99ed9f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:49.099303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540c79c-3238-49ad-acae-46d955fbc2ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:49.099922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540c79c-3238-49ad-acae-46d955fbc2ad service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:49.100202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540c79c-3238-49ad-acae-46d955fbc2ad service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:49.100509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540c79c-3238-49ad-acae-46d955fbc2ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:49.103104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3540c79c-3238-49ad-acae-46d955fbc2ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:49.209882 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:49.224454 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540c79c-3238-49ad-acae-46d955fbc2ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:49.226087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540c79c-3238-49ad-acae-46d955fbc2ad service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:49.247226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 717/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:50.185889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b0f4c-1da4-47ff-9c24-74caacb49cc3 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:50.186451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b0f4c-1da4-47ff-9c24-74caacb49cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:50.186451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b0f4c-1da4-47ff-9c24-74caacb49cc3 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:50.187713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:50.192819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca875a2e-5c73-492d-8b86-905391492dfb None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:50.193240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca875a2e-5c73-492d-8b86-905391492dfb None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:50.193347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca875a2e-5c73-492d-8b86-905391492dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:50.274708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ca875a2e-5c73-492d-8b86-905391492dfb None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:50.275971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ca875a2e-5c73-492d-8b86-905391492dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:50.379374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:50.537422 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b0f4c-1da4-47ff-9c24-74caacb49cc3 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:50.539120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a28b0f4c-1da4-47ff-9c24-74caacb49cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:50.631861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:50.698176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b0f4c-1da4-47ff-9c24-74caacb49cc3 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:50.817083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e11fce-86da-4e3f-a8fa-1f7f23ee9529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:50.817607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e11fce-86da-4e3f-a8fa-1f7f23ee9529 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:50.817886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e11fce-86da-4e3f-a8fa-1f7f23ee9529 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:50.818158 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e11fce-86da-4e3f-a8fa-1f7f23ee9529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:50.819852 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b3e11fce-86da-4e3f-a8fa-1f7f23ee9529 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:50.874760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:50.925354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e11fce-86da-4e3f-a8fa-1f7f23ee9529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:50.926948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e11fce-86da-4e3f-a8fa-1f7f23ee9529 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:50.947194 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 710/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:51.824164 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f0a61-5e36-498d-94cd-1a88ec8b5302 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:51.824763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f0a61-5e36-498d-94cd-1a88ec8b5302 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:51.824763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f0a61-5e36-498d-94cd-1a88ec8b5302 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:51.826103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:51.831431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be677f0-d850-49f4-a5f4-1673d535f22f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:51.831951 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be677f0-d850-49f4-a5f4-1673d535f22f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:51.832053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be677f0-d850-49f4-a5f4-1673d535f22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:51.911047 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4be677f0-d850-49f4-a5f4-1673d535f22f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:51.912320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4be677f0-d850-49f4-a5f4-1673d535f22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:52.011101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:52.168504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f0a61-5e36-498d-94cd-1a88ec8b5302 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:52.171190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b56f0a61-5e36-498d-94cd-1a88ec8b5302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:52.221524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:52.323447 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f0a61-5e36-498d-94cd-1a88ec8b5302 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:52.440929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093f3db-9966-4c12-9f0e-ac584ec2d55b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:52.441458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093f3db-9966-4c12-9f0e-ac584ec2d55b service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:52.441739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093f3db-9966-4c12-9f0e-ac584ec2d55b service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:52.442016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093f3db-9966-4c12-9f0e-ac584ec2d55b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:52.443628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6093f3db-9966-4c12-9f0e-ac584ec2d55b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:52.451307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:52.535404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093f3db-9966-4c12-9f0e-ac584ec2d55b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:52.537038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093f3db-9966-4c12-9f0e-ac584ec2d55b service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:52.554998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 720/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:53.497830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d20cc-9ec5-4f5d-b5fe-6543dd97c3f1 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:53.498421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d20cc-9ec5-4f5d-b5fe-6543dd97c3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:53.498421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d20cc-9ec5-4f5d-b5fe-6543dd97c3f1 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:53.499732 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:53.504968 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2e8d-682d-475d-82a6-13f2eaed8d73 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:53.505464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2e8d-682d-475d-82a6-13f2eaed8d73 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:53.505617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc2e8d-682d-475d-82a6-13f2eaed8d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:53.590476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0dbc2e8d-682d-475d-82a6-13f2eaed8d73 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:53.591615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0dbc2e8d-682d-475d-82a6-13f2eaed8d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:53.662975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:53.694347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:53.849326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d20cc-9ec5-4f5d-b5fe-6543dd97c3f1 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:53.850773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-476d20cc-9ec5-4f5d-b5fe-6543dd97c3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:53.869125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:54.007146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d20cc-9ec5-4f5d-b5fe-6543dd97c3f1 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:54.097481 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:54.125986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cfd95-a5b8-45cc-8622-27ef81969b55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:54.126501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cfd95-a5b8-45cc-8622-27ef81969b55 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:54.126777 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cfd95-a5b8-45cc-8622-27ef81969b55 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:54.127044 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cfd95-a5b8-45cc-8622-27ef81969b55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:54.128697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-cd5cfd95-a5b8-45cc-8622-27ef81969b55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:54.221626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cfd95-a5b8-45cc-8622-27ef81969b55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:54.223236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cfd95-a5b8-45cc-8622-27ef81969b55 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:54.242817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 713/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:55.121054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c7b9e-c534-4653-92d3-263b306b66c3 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:55.121719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c7b9e-c534-4653-92d3-263b306b66c3 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:55.121719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c7b9e-c534-4653-92d3-263b306b66c3 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:55.122919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:55.127826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581255-2a42-47cb-83c2-816e44006115 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:55.128310 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581255-2a42-47cb-83c2-816e44006115 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:55.128419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6581255-2a42-47cb-83c2-816e44006115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:55.206253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-d6581255-2a42-47cb-83c2-816e44006115 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:55.207484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d6581255-2a42-47cb-83c2-816e44006115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:55.252188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:55.311371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:55.464513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c7b9e-c534-4653-92d3-263b306b66c3 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:55.465954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-376c7b9e-c534-4653-92d3-263b306b66c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:55.618191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c7b9e-c534-4653-92d3-263b306b66c3 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:55.675008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:55.735046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec68b649-f4a4-4869-bf87-54a26ada6230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:55.735662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68b649-f4a4-4869-bf87-54a26ada6230 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:55.735943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68b649-f4a4-4869-bf87-54a26ada6230 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:55.736218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec68b649-f4a4-4869-bf87-54a26ada6230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:55.737868 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ec68b649-f4a4-4869-bf87-54a26ada6230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:55.830100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68b649-f4a4-4869-bf87-54a26ada6230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:55.831706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec68b649-f4a4-4869-bf87-54a26ada6230 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:55.849738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 723/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:56.716030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adc4dc-185f-410a-9236-e3b4d331b4a9 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:56.716605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adc4dc-185f-410a-9236-e3b4d331b4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:56.716605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adc4dc-185f-410a-9236-e3b4d331b4a9 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:56.717922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:56.723323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96a67-bb98-44ba-b625-47460d3a979d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:56.723758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96a67-bb98-44ba-b625-47460d3a979d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:56.723901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96a67-bb98-44ba-b625-47460d3a979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:56.805238 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-03b96a67-bb98-44ba-b625-47460d3a979d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:56.806512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-03b96a67-bb98-44ba-b625-47460d3a979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:56.808639 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:56.909205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:57.061549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adc4dc-185f-410a-9236-e3b4d331b4a9 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:57.063101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-14adc4dc-185f-410a-9236-e3b4d331b4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:57.210162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adc4dc-185f-410a-9236-e3b4d331b4a9 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:57.237476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:57.327927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6d34-f3aa-4d5b-ba74-2cbe2e775fd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:57.328499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6d34-f3aa-4d5b-ba74-2cbe2e775fd5 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:57.328778 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6d34-f3aa-4d5b-ba74-2cbe2e775fd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:57.329049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6d34-f3aa-4d5b-ba74-2cbe2e775fd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:57.330775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e93f6d34-f3aa-4d5b-ba74-2cbe2e775fd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:57.424975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f6d34-f3aa-4d5b-ba74-2cbe2e775fd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:09:57.426571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f6d34-f3aa-4d5b-ba74-2cbe2e775fd5 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:09:57.445336 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 716/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:59.282835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74c62a-b609-44b1-a56d-553c61a26e52 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:59.283415 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74c62a-b609-44b1-a56d-553c61a26e52 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:59.283415 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74c62a-b609-44b1-a56d-553c61a26e52 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:59.285189 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:09:59.293086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1d64e-6acd-4aed-9272-a092f3a77e40 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:59.293086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1d64e-6acd-4aed-9272-a092f3a77e40 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:59.293086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd1d64e-6acd-4aed-9272-a092f3a77e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:59.340320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:59.368490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1cd1d64e-6acd-4aed-9272-a092f3a77e40 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:09:59.369749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1cd1d64e-6acd-4aed-9272-a092f3a77e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:59.479588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:09:59.775054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74c62a-b609-44b1-a56d-553c61a26e52 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:09:59.776618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0e74c62a-b609-44b1-a56d-553c61a26e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:09:59.883455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74c62a-b609-44b1-a56d-553c61a26e52 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:09:59.918360 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:59.963593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e2946-a706-45e3-9af0-09e91bb308c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:09:59.964212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2946-a706-45e3-9af0-09e91bb308c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:09:59.964594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2946-a706-45e3-9af0-09e91bb308c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:09:59.964800 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e2946-a706-45e3-9af0-09e91bb308c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:09:59.966519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e29e2946-a706-45e3-9af0-09e91bb308c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:00.090288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2946-a706-45e3-9af0-09e91bb308c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:00.091657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e2946-a706-45e3-9af0-09e91bb308c6 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:00.111487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 726/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:10:02.236886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc929771-f39d-4329-88e7-344088c47b28 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:02.237474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc929771-f39d-4329-88e7-344088c47b28 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:02.237474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc929771-f39d-4329-88e7-344088c47b28 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:02.238953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:02.244669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6822d-9818-46cd-8535-650b17103fc2 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:02.245141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6822d-9818-46cd-8535-650b17103fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:02.245236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6822d-9818-46cd-8535-650b17103fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:02.318857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-53e6822d-9818-46cd-8535-650b17103fc2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:02.320690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-53e6822d-9818-46cd-8535-650b17103fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:02.334074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:02.424039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:02.718149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc929771-f39d-4329-88e7-344088c47b28 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:02.719758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-fc929771-f39d-4329-88e7-344088c47b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:02.831237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc929771-f39d-4329-88e7-344088c47b28 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:02.843913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:02.910746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b39bd-c0dd-40c8-bf35-62a1b46c53c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:02.911353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b39bd-c0dd-40c8-bf35-62a1b46c53c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:02.911632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b39bd-c0dd-40c8-bf35-62a1b46c53c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:02.911905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b39bd-c0dd-40c8-bf35-62a1b46c53c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:02.914073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-eb5b39bd-c0dd-40c8-bf35-62a1b46c53c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:03.023460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b39bd-c0dd-40c8-bf35-62a1b46c53c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:03.024922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b39bd-c0dd-40c8-bf35-62a1b46c53c1 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:03.044123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 719/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:05.448290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975b07-52f6-4d01-a097-eea5379da9f6 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:05.448825 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975b07-52f6-4d01-a097-eea5379da9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:05.448936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d975b07-52f6-4d01-a097-eea5379da9f6 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:05.450206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:05.456063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e66e-b2d1-4e8f-8062-722a8f14b4f6 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:05.456540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e66e-b2d1-4e8f-8062-722a8f14b4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:05.456648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e66e-b2d1-4e8f-8062-722a8f14b4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:05.506420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:05.526508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8734e66e-b2d1-4e8f-8062-722a8f14b4f6 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:05.527754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8734e66e-b2d1-4e8f-8062-722a8f14b4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:05.626755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:05.924665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d975b07-52f6-4d01-a097-eea5379da9f6 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:05.926388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8d975b07-52f6-4d01-a097-eea5379da9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:06.032254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d975b07-52f6-4d01-a097-eea5379da9f6 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:06.075764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:06.110484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6bbe4-8def-4c26-b9f1-15d560c341b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:06.111099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6bbe4-8def-4c26-b9f1-15d560c341b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:06.111380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6bbe4-8def-4c26-b9f1-15d560c341b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:06.111650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6bbe4-8def-4c26-b9f1-15d560c341b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:06.113408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d3c6bbe4-8def-4c26-b9f1-15d560c341b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:06.223259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6bbe4-8def-4c26-b9f1-15d560c341b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:06.224704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6bbe4-8def-4c26-b9f1-15d560c341b8 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:06.246868 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 729/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:08.362946 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d734a-5f9d-4510-bdc6-eb60cfe9e8c5 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:08.363406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d734a-5f9d-4510-bdc6-eb60cfe9e8c5 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:08.363524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d734a-5f9d-4510-bdc6-eb60cfe9e8c5 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:08.364905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:10:08.371272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb4ef-954a-474f-8abb-18e174e9c206 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:08.371720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb4ef-954a-474f-8abb-18e174e9c206 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:08.371826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb4ef-954a-474f-8abb-18e174e9c206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:08.439480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b8bdb4ef-954a-474f-8abb-18e174e9c206 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:08.440725 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b8bdb4ef-954a-474f-8abb-18e174e9c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:08.461768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:08.545608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:08.831592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d734a-5f9d-4510-bdc6-eb60cfe9e8c5 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:08.833253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-859d734a-5f9d-4510-bdc6-eb60cfe9e8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:08.938991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d734a-5f9d-4510-bdc6-eb60cfe9e8c5 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:08.959722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:09.017438 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb689409-6485-44b6-989e-e4dcb6f434a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:09.018048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb689409-6485-44b6-989e-e4dcb6f434a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:09.018325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb689409-6485-44b6-989e-e4dcb6f434a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:09.018593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb689409-6485-44b6-989e-e4dcb6f434a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:09.020206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-cb689409-6485-44b6-989e-e4dcb6f434a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:09.130253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb689409-6485-44b6-989e-e4dcb6f434a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:09.131704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb689409-6485-44b6-989e-e4dcb6f434a6 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:09.150256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 722/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:11.130312 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0891f5-2f86-4019-afcf-95c8ed493185 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:11.130889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0891f5-2f86-4019-afcf-95c8ed493185 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:11.130889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0891f5-2f86-4019-afcf-95c8ed493185 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:11.132960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:10:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:11.138491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74d50-f460-4175-a021-94aa415bfd30 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:11.138931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74d50-f460-4175-a021-94aa415bfd30 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:11.139072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74d50-f460-4175-a021-94aa415bfd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:11.203932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:11.207033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-d7e74d50-f460-4175-a021-94aa415bfd30 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:11.208330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d7e74d50-f460-4175-a021-94aa415bfd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:11.320474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:11.604153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0891f5-2f86-4019-afcf-95c8ed493185 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:11.605708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ca0891f5-2f86-4019-afcf-95c8ed493185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:11.714213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0891f5-2f86-4019-afcf-95c8ed493185 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:11.765646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:11.792188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe2f30-698a-4de9-87cf-f90c45baacec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:11.792826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe2f30-698a-4de9-87cf-f90c45baacec service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:11.793103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe2f30-698a-4de9-87cf-f90c45baacec service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:11.793435 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe2f30-698a-4de9-87cf-f90c45baacec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:11.794983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8fbe2f30-698a-4de9-87cf-f90c45baacec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:11.910224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe2f30-698a-4de9-87cf-f90c45baacec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:11.911590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe2f30-698a-4de9-87cf-f90c45baacec service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:11.931544 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 732/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:13.963101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfddd2-53b7-4946-b78d-a71e9aee71d4 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:13.963676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfddd2-53b7-4946-b78d-a71e9aee71d4 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:13.963676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfddd2-53b7-4946-b78d-a71e9aee71d4 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:13.965025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:13.970597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1b209-15df-43b6-9311-4fd23735631f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:13.971056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1b209-15df-43b6-9311-4fd23735631f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:13.971162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1b209-15df-43b6-9311-4fd23735631f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:14.040498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b1b1b209-15df-43b6-9311-4fd23735631f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:14.041735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b1b1b209-15df-43b6-9311-4fd23735631f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:14.071701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:14.141181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:14.427927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfddd2-53b7-4946-b78d-a71e9aee71d4 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:14.430584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-96dfddd2-53b7-4946-b78d-a71e9aee71d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:14.535775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dfddd2-53b7-4946-b78d-a71e9aee71d4 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:14.565064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:14.612426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806bf26-a1fc-4c91-be60-dfbee45ca649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:14.613046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806bf26-a1fc-4c91-be60-dfbee45ca649 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:14.613326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806bf26-a1fc-4c91-be60-dfbee45ca649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:14.613601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806bf26-a1fc-4c91-be60-dfbee45ca649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:14.615238 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f806bf26-a1fc-4c91-be60-dfbee45ca649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:14.726772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806bf26-a1fc-4c91-be60-dfbee45ca649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:14.728216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806bf26-a1fc-4c91-be60-dfbee45ca649 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:14.747102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 725/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:16.852142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463a09-6452-4125-8930-5ad49ecb7614 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:16.852805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463a09-6452-4125-8930-5ad49ecb7614 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:16.852805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463a09-6452-4125-8930-5ad49ecb7614 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:16.854275 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:10:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:16.860435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116014b9-0a04-400e-8d02-e1db435eabb2 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:16.860930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116014b9-0a04-400e-8d02-e1db435eabb2 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:16.861038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116014b9-0a04-400e-8d02-e1db435eabb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:16.929980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-116014b9-0a04-400e-8d02-e1db435eabb2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:16.931204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-116014b9-0a04-400e-8d02-e1db435eabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:16.940324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:17.040635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:17.325594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463a09-6452-4125-8930-5ad49ecb7614 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:17.371531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d2463a09-6452-4125-8930-5ad49ecb7614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:17.447035 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463a09-6452-4125-8930-5ad49ecb7614 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:17.505257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:17.527081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dd827-853a-4632-9ec6-701d43010010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:17.527711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd827-853a-4632-9ec6-701d43010010 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:17.527992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd827-853a-4632-9ec6-701d43010010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:17.528296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dd827-853a-4632-9ec6-701d43010010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:17.530000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5f7dd827-853a-4632-9ec6-701d43010010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:17.653211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd827-853a-4632-9ec6-701d43010010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:17.654590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dd827-853a-4632-9ec6-701d43010010 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:17.674155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 735/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:19.668972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4bae-73e7-429a-a4c0-ba4129803f98 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:19.669505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4bae-73e7-429a-a4c0-ba4129803f98 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:19.669650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b4bae-73e7-429a-a4c0-ba4129803f98 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:19.671015 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:19.678838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6117c6-9240-4abe-a5c0-8bf2df38c268 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:19.679355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6117c6-9240-4abe-a5c0-8bf2df38c268 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:19.679455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6117c6-9240-4abe-a5c0-8bf2df38c268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:19.747300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-dc6117c6-9240-4abe-a5c0-8bf2df38c268 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:19.748564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-dc6117c6-9240-4abe-a5c0-8bf2df38c268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:19.789492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:19.850231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:20.140923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b4bae-73e7-429a-a4c0-ba4129803f98 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:20.142466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b36b4bae-73e7-429a-a4c0-ba4129803f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:20.247553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b4bae-73e7-429a-a4c0-ba4129803f98 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:20.288330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:20.324100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94788ecd-6334-4656-bdb8-faac83c06f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:20.324768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94788ecd-6334-4656-bdb8-faac83c06f3e service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:20.325046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94788ecd-6334-4656-bdb8-faac83c06f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:20.325316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94788ecd-6334-4656-bdb8-faac83c06f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:20.326927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-94788ecd-6334-4656-bdb8-faac83c06f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:20.450105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94788ecd-6334-4656-bdb8-faac83c06f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:20.451570 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94788ecd-6334-4656-bdb8-faac83c06f3e service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:20.472286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 728/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:22.468336 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01003f5-0bc8-4073-8583-a0f9437f7fe0 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:22.469208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01003f5-0bc8-4073-8583-a0f9437f7fe0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:22.469208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01003f5-0bc8-4073-8583-a0f9437f7fe0 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:22.470734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:10:22.477668 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641045d-9d43-4c78-a16c-2192771da9c9 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:22.478220 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641045d-9d43-4c78-a16c-2192771da9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:22.478382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641045d-9d43-4c78-a16c-2192771da9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:22.579265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0641045d-9d43-4c78-a16c-2192771da9c9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:22.581229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0641045d-9d43-4c78-a16c-2192771da9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:22.616767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:22.707322 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:10:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:10:22.997718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01003f5-0bc8-4073-8583-a0f9437f7fe0 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:22.999336 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c01003f5-0bc8-4073-8583-a0f9437f7fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:23.114194 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01003f5-0bc8-4073-8583-a0f9437f7fe0 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:23.186569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:23.195146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7dee7-9d02-4bd8-9e34-530c400aed0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:23.200387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7dee7-9d02-4bd8-9e34-530c400aed0f service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:23.200387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7dee7-9d02-4bd8-9e34-530c400aed0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:23.200387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7dee7-9d02-4bd8-9e34-530c400aed0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:23.200387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8dc7dee7-9d02-4bd8-9e34-530c400aed0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:23.332997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7dee7-9d02-4bd8-9e34-530c400aed0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:23.335014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7dee7-9d02-4bd8-9e34-530c400aed0f service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:23.366759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 738/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:25.359775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf6e86-5d23-408f-89b5-e4ac80b17ced None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.360630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf6e86-5d23-408f-89b5-e4ac80b17ced None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.360630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf6e86-5d23-408f-89b5-e4ac80b17ced None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.361744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:10:25.368502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5fde3-a115-4238-9c19-b277d5d12ed5 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.369065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5fde3-a115-4238-9c19-b277d5d12ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.369065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5fde3-a115-4238-9c19-b277d5d12ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.447595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-bdc5fde3-a115-4238-9c19-b277d5d12ed5 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:25.448861 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bdc5fde3-a115-4238-9c19-b277d5d12ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:25.503507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:25.594483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:10:25.845508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf6e86-5d23-408f-89b5-e4ac80b17ced None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.847009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-35cf6e86-5d23-408f-89b5-e4ac80b17ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:25.964590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf6e86-5d23-408f-89b5-e4ac80b17ced None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.018957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:26.046978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb5a4-b65b-4385-899d-98497fe9a525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.047610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb5a4-b65b-4385-899d-98497fe9a525 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.047883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb5a4-b65b-4385-899d-98497fe9a525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.048148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb5a4-b65b-4385-899d-98497fe9a525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.049761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-451fb5a4-b65b-4385-899d-98497fe9a525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:26.166597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fb5a4-b65b-4385-899d-98497fe9a525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.167968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fb5a4-b65b-4385-899d-98497fe9a525 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.186710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 731/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:35.636627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=22 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:36.184488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=66 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:48.346292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699e8ef-db0e-4f95-a44e-5cd50d3869ec None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.352550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699e8ef-db0e-4f95-a44e-5cd50d3869ec None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.352550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699e8ef-db0e-4f95-a44e-5cd50d3869ec None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:48.352550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 740/1471] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:48.358543 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b1890-c833-4164-9ca5-4119977b13d6 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.359519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b1890-c833-4164-9ca5-4119977b13d6 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.359694 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b1890-c833-4164-9ca5-4119977b13d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:48.465388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-c45b1890-c833-4164-9ca5-4119977b13d6 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:48.466796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c45b1890-c833-4164-9ca5-4119977b13d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:48.596254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 732/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:48.909081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca13f-4f00-426d-8a5b-3d198086b1c8 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.909542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca13f-4f00-426d-8a5b-3d198086b1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.909929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeca13f-4f00-426d-8a5b-3d198086b1c8 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:48.912502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 741/1473] 10.222.0.20 () {54 vars in 967 bytes} [Wed Aug 24 17:10:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:48.919579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f054e-400f-463f-97cb-8ab972c24e69 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.920314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f054e-400f-463f-97cb-8ab972c24e69 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.920845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f054e-400f-463f-97cb-8ab972c24e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:49.017860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a69f054e-400f-463f-97cb-8ab972c24e69 None None] MFA Rules not processed for user `1684abe7e6aa44a0873e43dfc146c1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:49.019144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a69f054e-400f-463f-97cb-8ab972c24e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:49.046623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:49.117246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 733/1474] 10.222.0.20 () {58 vars in 1064 bytes} [Wed Aug 24 17:10:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:49.125336 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca13f-4f00-426d-8a5b-3d198086b1c8 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:49.127294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-aaeca13f-4f00-426d-8a5b-3d198086b1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:49.260730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeca13f-4f00-426d-8a5b-3d198086b1c8 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:49.361463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686e6bf-1703-4b16-8c48-055c6761ea0a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1684abe7e6aa44a0873e43dfc146c1b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:49.362587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686e6bf-1703-4b16-8c48-055c6761ea0a service glance] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:49.362871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686e6bf-1703-4b16-8c48-055c6761ea0a service glance] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:49.363245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686e6bf-1703-4b16-8c48-055c6761ea0a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:49.366001 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0686e6bf-1703-4b16-8c48-055c6761ea0a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:49.438175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:49.516842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686e6bf-1703-4b16-8c48-055c6761ea0a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:49.518246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686e6bf-1703-4b16-8c48-055c6761ea0a service glance] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:49.541753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 742/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:10:51.709033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95628f39-95cf-49e6-82c9-b31efca7bc45 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:51.709579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95628f39-95cf-49e6-82c9-b31efca7bc45 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:51.709579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95628f39-95cf-49e6-82c9-b31efca7bc45 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:51.710935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 734/1476] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:10:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:10:51.717398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f703-501b-4d4a-a1e6-a7171f083eba None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:51.717980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f703-501b-4d4a-a1e6-a7171f083eba None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:51.717980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f703-501b-4d4a-a1e6-a7171f083eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:51.794949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-fca1f703-501b-4d4a-a1e6-a7171f083eba None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:51.796217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fca1f703-501b-4d4a-a1e6-a7171f083eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:51.908986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 743/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:52.190336 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95628f39-95cf-49e6-82c9-b31efca7bc45 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:52.192035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-95628f39-95cf-49e6-82c9-b31efca7bc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:52.352928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95628f39-95cf-49e6-82c9-b31efca7bc45 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:52.412775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:52.468562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7142b-ca2c-4ce6-8404-6f6cc364253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:52.469118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7142b-ca2c-4ce6-8404-6f6cc364253a admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:52.469393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7142b-ca2c-4ce6-8404-6f6cc364253a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:52.469661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7142b-ca2c-4ce6-8404-6f6cc364253a admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:52.470359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7142b-ca2c-4ce6-8404-6f6cc364253a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:52.472160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: WARNING py.warnings [None req-9be7142b-ca2c-4ce6-8404-6f6cc364253a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:10:52.472160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: warnings.warn(msg) Aug 24 17:10:52.472160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: Aug 24 17:10:52.473874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7142b-ca2c-4ce6-8404-6f6cc364253a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:52.497299 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 735/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Aug 24 17:10:52 2022] GET /identity/v3/projects => generated 2553 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:54.579447 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fbb70-68c1-4556-a523-c42e217b0c9e None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:54.580158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fbb70-68c1-4556-a523-c42e217b0c9e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:54.580158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fbb70-68c1-4556-a523-c42e217b0c9e None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:54.581673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 744/1479] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:54.588401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2619ca-f2a5-4f17-9aae-46afeb63818f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:54.588991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2619ca-f2a5-4f17-9aae-46afeb63818f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:54.588991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2619ca-f2a5-4f17-9aae-46afeb63818f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:54.671911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5e2619ca-f2a5-4f17-9aae-46afeb63818f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:54.673379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5e2619ca-f2a5-4f17-9aae-46afeb63818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:54.797546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 736/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:55.105889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fbb70-68c1-4556-a523-c42e217b0c9e None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:55.107469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0f4fbb70-68c1-4556-a523-c42e217b0c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:55.119465 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:55.334009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fbb70-68c1-4556-a523-c42e217b0c9e None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:55.462781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:55.520771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307951bf-81ae-433c-8b75-141fc95ffa89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:55.521629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307951bf-81ae-433c-8b75-141fc95ffa89 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:55.522021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307951bf-81ae-433c-8b75-141fc95ffa89 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:55.522412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307951bf-81ae-433c-8b75-141fc95ffa89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:55.524296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-307951bf-81ae-433c-8b75-141fc95ffa89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:55.759918 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307951bf-81ae-433c-8b75-141fc95ffa89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:55.761614 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307951bf-81ae-433c-8b75-141fc95ffa89 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:55.784107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 745/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:58.093520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca8ea-0e55-4273-957a-425e5a4c4cf6 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:58.094256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca8ea-0e55-4273-957a-425e5a4c4cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:58.094256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca8ea-0e55-4273-957a-425e5a4c4cf6 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:58.095701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 737/1482] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:58.103386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871d410-93e2-4044-bdfe-f44f7b540acd None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:58.104007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871d410-93e2-4044-bdfe-f44f7b540acd None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:58.104493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871d410-93e2-4044-bdfe-f44f7b540acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:58.206810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b871d410-93e2-4044-bdfe-f44f7b540acd None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:58.208124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b871d410-93e2-4044-bdfe-f44f7b540acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:58.267737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:58.337871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 746/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:58.643690 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dca8ea-0e55-4273-957a-425e5a4c4cf6 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:58.645686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-07dca8ea-0e55-4273-957a-425e5a4c4cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:58.676352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:58.782116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dca8ea-0e55-4273-957a-425e5a4c4cf6 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:58.880431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc457-4e72-4645-a4be-9bfbc245ace3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:58.881057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc457-4e72-4645-a4be-9bfbc245ace3 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:58.881364 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc457-4e72-4645-a4be-9bfbc245ace3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:58.881635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc457-4e72-4645-a4be-9bfbc245ace3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:58.883532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-431cc457-4e72-4645-a4be-9bfbc245ace3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:58.978996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:59.021144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cc457-4e72-4645-a4be-9bfbc245ace3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:59.022823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cc457-4e72-4645-a4be-9bfbc245ace3 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:59.045733 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 738/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:01.345576 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8666e-ddd7-4b79-a765-b551c4f2e367 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:01.346281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8666e-ddd7-4b79-a765-b551c4f2e367 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:01.346430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8666e-ddd7-4b79-a765-b551c4f2e367 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:01.347998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 747/1485] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:11:01.355537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926cdfa-6ebb-499d-a9bb-aa67efb877b6 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:01.356315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926cdfa-6ebb-499d-a9bb-aa67efb877b6 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:01.356556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926cdfa-6ebb-499d-a9bb-aa67efb877b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:01.473053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1926cdfa-6ebb-499d-a9bb-aa67efb877b6 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:01.474241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1926cdfa-6ebb-499d-a9bb-aa67efb877b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:01.599712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 739/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:01.914144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8666e-ddd7-4b79-a765-b551c4f2e367 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:01.916012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2bb8666e-ddd7-4b79-a765-b551c4f2e367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:02.062409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8666e-ddd7-4b79-a765-b551c4f2e367 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:02.155364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:02.158109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c57c4-4c17-443c-bc2e-6123b3f0ac0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:02.158783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c57c4-4c17-443c-bc2e-6123b3f0ac0f service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:02.159223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c57c4-4c17-443c-bc2e-6123b3f0ac0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:02.159587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c57c4-4c17-443c-bc2e-6123b3f0ac0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:02.162313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e21c57c4-4c17-443c-bc2e-6123b3f0ac0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:02.304525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c57c4-4c17-443c-bc2e-6123b3f0ac0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:02.306226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c57c4-4c17-443c-bc2e-6123b3f0ac0f service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:02.328757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 748/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:11:04.582472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8941-0d07-4d6a-a453-a014f7b90d15 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:04.583661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8941-0d07-4d6a-a453-a014f7b90d15 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:04.584068 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8941-0d07-4d6a-a453-a014f7b90d15 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:04.585706 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 740/1488] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:11:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:11:04.594514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff493d8-b6e4-4b8b-8a0f-c797f9e2ed51 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:04.595354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff493d8-b6e4-4b8b-8a0f-c797f9e2ed51 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:04.595354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff493d8-b6e4-4b8b-8a0f-c797f9e2ed51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:04.703970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0ff493d8-b6e4-4b8b-8a0f-c797f9e2ed51 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:04.705304 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0ff493d8-b6e4-4b8b-8a0f-c797f9e2ed51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:04.782004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:04.837454 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 749/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:05.162376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b8941-0d07-4d6a-a453-a014f7b90d15 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:05.164070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-442b8941-0d07-4d6a-a453-a014f7b90d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:05.209166 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:05.302292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b8941-0d07-4d6a-a453-a014f7b90d15 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:05.421546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b605898-3d2d-418c-9630-19cabbc002de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:05.422070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b605898-3d2d-418c-9630-19cabbc002de service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:05.422349 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b605898-3d2d-418c-9630-19cabbc002de service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:05.422621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b605898-3d2d-418c-9630-19cabbc002de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:05.424368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2b605898-3d2d-418c-9630-19cabbc002de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:05.516903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:05.551728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b605898-3d2d-418c-9630-19cabbc002de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:05.553277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b605898-3d2d-418c-9630-19cabbc002de service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:05.574773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 741/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:08.125754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35750b-0a3f-4900-9865-783828ca7762 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:08.126352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35750b-0a3f-4900-9865-783828ca7762 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:08.126352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35750b-0a3f-4900-9865-783828ca7762 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:08.127807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 750/1491] 10.222.0.20 () {54 vars in 927 bytes} [Wed Aug 24 17:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:11:08.134896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd0321-6a6a-4452-9621-2e4d83e4b867 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:08.135964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd0321-6a6a-4452-9621-2e4d83e4b867 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:08.135964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd0321-6a6a-4452-9621-2e4d83e4b867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:08.217502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-cfdd0321-6a6a-4452-9621-2e4d83e4b867 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:08.218767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-cfdd0321-6a6a-4452-9621-2e4d83e4b867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:08.387046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 742/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Wed Aug 24 17:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:08.693091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35750b-0a3f-4900-9865-783828ca7762 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:08.694656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7e35750b-0a3f-4900-9865-783828ca7762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:08.825571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35750b-0a3f-4900-9865-783828ca7762 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:08.917486 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e48ee-7dfc-4564-a33d-baca7bb91540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:08.918121 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e48ee-7dfc-4564-a33d-baca7bb91540 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:08.918438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e48ee-7dfc-4564-a33d-baca7bb91540 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:08.918713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e48ee-7dfc-4564-a33d-baca7bb91540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:08.920530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-192e48ee-7dfc-4564-a33d-baca7bb91540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:08.932455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:09.057551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e48ee-7dfc-4564-a33d-baca7bb91540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:09.059046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e48ee-7dfc-4564-a33d-baca7bb91540 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:09.080888 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 751/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:18.382784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=82 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:19.078256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=50 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:52.150417 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99115-01d7-4ccc-b1a0-f5bf9bfcdbcd None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:52.151100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99115-01d7-4ccc-b1a0-f5bf9bfcdbcd None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:52.151671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de99115-01d7-4ccc-b1a0-f5bf9bfcdbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:52.273372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6de99115-01d7-4ccc-b1a0-f5bf9bfcdbcd None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:52.274840 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6de99115-01d7-4ccc-b1a0-f5bf9bfcdbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:52.410988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 743/1494] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:52.419546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142bf36-1588-410e-8f78-040e80270514 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:52.420173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142bf36-1588-410e-8f78-040e80270514 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:52.420173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142bf36-1588-410e-8f78-040e80270514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:52.445456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-8142bf36-1588-410e-8f78-040e80270514 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:52.446708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8142bf36-1588-410e-8f78-040e80270514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:52.457062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 752/1495] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:52.462095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de99115-01d7-4ccc-b1a0-f5bf9bfcdbcd None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:52.474109 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de99115-01d7-4ccc-b1a0-f5bf9bfcdbcd None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:52.481853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd25265-4d26-42c1-94c7-bc5927781590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:52.482821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25265-4d26-42c1-94c7-bc5927781590 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:52.483333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25265-4d26-42c1-94c7-bc5927781590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:52.485056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd25265-4d26-42c1-94c7-bc5927781590 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:52.486217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd25265-4d26-42c1-94c7-bc5927781590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:52.486706 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd25265-4d26-42c1-94c7-bc5927781590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:52.488420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: WARNING py.warnings [None req-9fd25265-4d26-42c1-94c7-bc5927781590 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:12:52.488420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: warnings.warn(msg) Aug 24 17:12:52.488420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: Aug 24 17:12:52.489971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd25265-4d26-42c1-94c7-bc5927781590 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:52.512337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 744/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:12:52.521779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142bf36-1588-410e-8f78-040e80270514 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:52.533947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142bf36-1588-410e-8f78-040e80270514 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:52.539542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5de366-d259-45a0-8a00-90986cbcf329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:52.540212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5de366-d259-45a0-8a00-90986cbcf329 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:52.540711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5de366-d259-45a0-8a00-90986cbcf329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:52.541065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5de366-d259-45a0-8a00-90986cbcf329 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:52.542099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5de366-d259-45a0-8a00-90986cbcf329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:52.544052 dv-cinder-851640-4-smb devstack@keystone.service[81947]: WARNING py.warnings [None req-bb5de366-d259-45a0-8a00-90986cbcf329 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:12:52.544052 dv-cinder-851640-4-smb devstack@keystone.service[81947]: warnings.warn(msg) Aug 24 17:12:52.544052 dv-cinder-851640-4-smb devstack@keystone.service[81947]: Aug 24 17:12:52.545288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5de366-d259-45a0-8a00-90986cbcf329 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:52.694751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 753/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:52 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:52.700795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd25265-4d26-42c1-94c7-bc5927781590 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:52.712134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd25265-4d26-42c1-94c7-bc5927781590 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:52.774784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:52.784105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320797d-503a-4691-a20e-2f5c2ca712b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:52.789287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320797d-503a-4691-a20e-2f5c2ca712b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:52.789287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320797d-503a-4691-a20e-2f5c2ca712b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:52.789287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320797d-503a-4691-a20e-2f5c2ca712b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:52.789287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320797d-503a-4691-a20e-2f5c2ca712b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:52.789287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: WARNING py.warnings [None req-f320797d-503a-4691-a20e-2f5c2ca712b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:12:52.789287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: warnings.warn(msg) Aug 24 17:12:52.789287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: Aug 24 17:12:52.790205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320797d-503a-4691-a20e-2f5c2ca712b3 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:52.882423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 745/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:52 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:52.887022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5de366-d259-45a0-8a00-90986cbcf329 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:52.899579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5de366-d259-45a0-8a00-90986cbcf329 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:52.905017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e3735-d73b-41b9-bbe9-bbe98ca4e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:52.906370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e3735-d73b-41b9-bbe9-bbe98ca4e7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:52.906703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e3735-d73b-41b9-bbe9-bbe98ca4e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:52.907049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e3735-d73b-41b9-bbe9-bbe98ca4e7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:52.907761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e3735-d73b-41b9-bbe9-bbe98ca4e7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:52.908990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: WARNING py.warnings [None req-a52e3735-d73b-41b9-bbe9-bbe98ca4e7bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:12:52.908990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: warnings.warn(msg) Aug 24 17:12:52.908990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: Aug 24 17:12:52.910080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e3735-d73b-41b9-bbe9-bbe98ca4e7bc admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:52.925706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 754/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:52.932460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320797d-503a-4691-a20e-2f5c2ca712b3 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:52.951484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320797d-503a-4691-a20e-2f5c2ca712b3 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:52.960959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58b598-5103-4d4b-9d63-f9cfe0d07371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:52.962019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b598-5103-4d4b-9d63-f9cfe0d07371 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:52.962506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b598-5103-4d4b-9d63-f9cfe0d07371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:52.962999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b598-5103-4d4b-9d63-f9cfe0d07371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:52.964187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58b598-5103-4d4b-9d63-f9cfe0d07371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:52.966142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: WARNING py.warnings [None req-9e58b598-5103-4d4b-9d63-f9cfe0d07371 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:12:52.966142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: warnings.warn(msg) Aug 24 17:12:52.966142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: Aug 24 17:12:52.967999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58b598-5103-4d4b-9d63-f9cfe0d07371 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:52.997784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 746/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:53.002935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e3735-d73b-41b9-bbe9-bbe98ca4e7bc admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:53.020820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e3735-d73b-41b9-bbe9-bbe98ca4e7bc admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:53.028737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccccd0f-11af-4bc6-98ca-26974b274202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:53.029796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccccd0f-11af-4bc6-98ca-26974b274202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:53.030203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccccd0f-11af-4bc6-98ca-26974b274202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:53.030721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccccd0f-11af-4bc6-98ca-26974b274202 admin admin] PATH_INFO: `/v3/projects/0e2acee60d764076b328b6a4f24a2466/users/727f2321a1de46ba8f61e57394338ab1/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:53.058049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccccd0f-11af-4bc6-98ca-26974b274202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e2acee60d764076b328b6a4f24a2466, user_id=727f2321a1de46ba8f61e57394338ab1, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:53.060037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: WARNING py.warnings [None req-7ccccd0f-11af-4bc6-98ca-26974b274202 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:12:53.060037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: warnings.warn(msg) Aug 24 17:12:53.060037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: Aug 24 17:12:53.064684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccccd0f-11af-4bc6-98ca-26974b274202 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:53.150692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 755/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:53 2022] PUT /identity/v3/projects/0e2acee60d764076b328b6a4f24a2466/users/727f2321a1de46ba8f61e57394338ab1/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:53.167036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7827e-7819-4d57-8c11-c0fbc8000d2e None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:53.167703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7827e-7819-4d57-8c11-c0fbc8000d2e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:53.167703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7827e-7819-4d57-8c11-c0fbc8000d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:53.201779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a3e7827e-7819-4d57-8c11-c0fbc8000d2e None None] MFA Rules not processed for user `727f2321a1de46ba8f61e57394338ab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:53.204064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a3e7827e-7819-4d57-8c11-c0fbc8000d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:53.283905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 747/1502] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:12:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:53.306258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11887b-7a3f-432d-9428-9e7852f0e56f None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:53.306746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11887b-7a3f-432d-9428-9e7852f0e56f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:53.307192 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11887b-7a3f-432d-9428-9e7852f0e56f None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:53.309673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 756/1503] 10.222.0.20 () {54 vars in 964 bytes} [Wed Aug 24 17:12:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:12:53.316363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a4c6b-78c5-45e0-b523-596ac1a33cd7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:53.316702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a4c6b-78c5-45e0-b523-596ac1a33cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:53.317019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a4c6b-78c5-45e0-b523-596ac1a33cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:53.391184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-874a4c6b-78c5-45e0-b523-596ac1a33cd7 None None] MFA Rules not processed for user `009e5ad7d256449495c74dad67741f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:53.392471 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-874a4c6b-78c5-45e0-b523-596ac1a33cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:53.487197 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 748/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Wed Aug 24 17:12:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:53.496161 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11887b-7a3f-432d-9428-9e7852f0e56f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:53.509431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11887b-7a3f-432d-9428-9e7852f0e56f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:53.513306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e811c-a5d1-4d24-bc03-aca8de0e461c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:53.513929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e811c-a5d1-4d24-bc03-aca8de0e461c service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:53.514399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e811c-a5d1-4d24-bc03-aca8de0e461c service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:53.514785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e811c-a5d1-4d24-bc03-aca8de0e461c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:53.526399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e811c-a5d1-4d24-bc03-aca8de0e461c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:53.528063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e811c-a5d1-4d24-bc03-aca8de0e461c service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:53.539563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 757/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:53.599222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a4099-448e-489a-b73b-29a3444bcba1 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:53.599527 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a4099-448e-489a-b73b-29a3444bcba1 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:53.599767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a4099-448e-489a-b73b-29a3444bcba1 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:53.601162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 749/1506] 10.222.0.20 () {52 vars in 830 bytes} [Wed Aug 24 17:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:12:53.605867 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e811c-a5d1-4d24-bc03-aca8de0e461c service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:53.687367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e811c-a5d1-4d24-bc03-aca8de0e461c service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:53.693172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:53.693890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:53.694311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:53.694690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] PATH_INFO: `/v3/users/727f2321a1de46ba8f61e57394338ab1` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:53.695967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] RBAC: Authorizing `identity:delete_user(user_id=727f2321a1de46ba8f61e57394338ab1)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:53.697123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: WARNING py.warnings [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:12:53.697123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: warnings.warn(msg) Aug 24 17:12:53.697123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: Aug 24 17:12:53.698545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:54.025518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727f2321a1de46ba8f61e57394338ab1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:54.026510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727f2321a1de46ba8f61e57394338ab1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:54.042706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727f2321a1de46ba8f61e57394338ab1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:54.043675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727f2321a1de46ba8f61e57394338ab1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:54.073014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727f2321a1de46ba8f61e57394338ab1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:54.077681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:54.295053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 758/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:53 2022] DELETE /identity/v3/users/727f2321a1de46ba8f61e57394338ab1 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:54.305988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e076e1-8500-4828-aae9-10996a5bba69 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:54.305988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e076e1-8500-4828-aae9-10996a5bba69 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:54.305988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e076e1-8500-4828-aae9-10996a5bba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:54.321863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e3e076e1-8500-4828-aae9-10996a5bba69 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:54.323164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e3e076e1-8500-4828-aae9-10996a5bba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:54.332960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:54.384465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 750/1508] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:54.394546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:54.399935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:54.480277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c723050-40d6-4b99-b7d5-0b936822e75a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:54.483919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6693007-24d6-432b-9705-74be32c111d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:54.484642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693007-24d6-432b-9705-74be32c111d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:54.484924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693007-24d6-432b-9705-74be32c111d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:54.485221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6693007-24d6-432b-9705-74be32c111d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:54.494139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6693007-24d6-432b-9705-74be32c111d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:54.495599 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6693007-24d6-432b-9705-74be32c111d9 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:54.505392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 759/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:55.169036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e076e1-8500-4828-aae9-10996a5bba69 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:55.170720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e3e076e1-8500-4828-aae9-10996a5bba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:55.187984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e076e1-8500-4828-aae9-10996a5bba69 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:55.197402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:55.197402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:55.197402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:55.197402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] PATH_INFO: `/v3/projects/0e2acee60d764076b328b6a4f24a2466` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:55.198331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e2acee60d764076b328b6a4f24a2466)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:55.200111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: WARNING py.warnings [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:12:55.200111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: warnings.warn(msg) Aug 24 17:12:55.200111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: Aug 24 17:12:55.202744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:55.368919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e2acee60d764076b328b6a4f24a2466', 'request_id': 'req-10252e01-4ecb-4985-9677-66615d3f7a8d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:55.487444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e2acee60d764076b328b6a4f24a2466', 'request_id': 'req-10252e01-4ecb-4985-9677-66615d3f7a8d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:55.504075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e2acee60d764076b328b6a4f24a2466', 'request_id': 'req-10252e01-4ecb-4985-9677-66615d3f7a8d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:55.516658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] The token cache is being invalidate because project 0e2acee60d764076b328b6a4f24a2466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:55.516952 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:55.517771 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-10252e01-4ecb-4985-9677-66615d3f7a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:55.519343 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 751/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:55 2022] DELETE /identity/v3/projects/0e2acee60d764076b328b6a4f24a2466 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:13:04.538510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:05.513003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:14:30.181382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb8cc-13e8-46ba-a46b-3f073258df7b None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:30.181999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb8cc-13e8-46ba-a46b-3f073258df7b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:30.181999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfb8cc-13e8-46ba-a46b-3f073258df7b None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:30.183259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:14:30.188713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b42f7b-73fd-4362-a75b-0d16fa917e79 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:30.189263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b42f7b-73fd-4362-a75b-0d16fa917e79 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:30.189444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b42f7b-73fd-4362-a75b-0d16fa917e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:30.210371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-42b42f7b-73fd-4362-a75b-0d16fa917e79 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:30.211762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-42b42f7b-73fd-4362-a75b-0d16fa917e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:30.275273 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:14:30.432990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfb8cc-13e8-46ba-a46b-3f073258df7b None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:30.434906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bfcfb8cc-13e8-46ba-a46b-3f073258df7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:30.550594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfb8cc-13e8-46ba-a46b-3f073258df7b None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:30.556040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee8a5f-1414-42f2-a31d-8413010c8713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:30.556684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8a5f-1414-42f2-a31d-8413010c8713 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:30.556961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8a5f-1414-42f2-a31d-8413010c8713 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:30.557229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8a5f-1414-42f2-a31d-8413010c8713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:30.565888 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee8a5f-1414-42f2-a31d-8413010c8713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:30.567495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee8a5f-1414-42f2-a31d-8413010c8713 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:30.577518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 761/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:14:31.419540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c166b7-d515-48d7-bd6c-5c1b3838f157 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:31.420120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c166b7-d515-48d7-bd6c-5c1b3838f157 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:31.420120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c166b7-d515-48d7-bd6c-5c1b3838f157 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:31.421562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:14:31.427935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7127b-b688-4b38-94c2-3cca1646c852 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:31.428469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7127b-b688-4b38-94c2-3cca1646c852 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:31.428575 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7127b-b688-4b38-94c2-3cca1646c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:31.450960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b3e7127b-b688-4b38-94c2-3cca1646c852 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:31.452261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b3e7127b-b688-4b38-94c2-3cca1646c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:31.461696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:31.614381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c166b7-d515-48d7-bd6c-5c1b3838f157 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:31.629435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c166b7-d515-48d7-bd6c-5c1b3838f157 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:31.635058 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c140401-284d-4bf6-aaf9-59998cc72697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:31.635683 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140401-284d-4bf6-aaf9-59998cc72697 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:31.635958 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140401-284d-4bf6-aaf9-59998cc72697 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:31.636247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c140401-284d-4bf6-aaf9-59998cc72697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:31.645513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c140401-284d-4bf6-aaf9-59998cc72697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:31.647375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c140401-284d-4bf6-aaf9-59998cc72697 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:31.657718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 754/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:14:31.999933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec0f0-6465-45bc-93e9-a4b86e6e9b7e None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:32.000208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec0f0-6465-45bc-93e9-a4b86e6e9b7e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:32.000528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adec0f0-6465-45bc-93e9-a4b86e6e9b7e None None] PATH_INFO: `/v3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:32.002550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 763/1517] 10.222.0.30 () {54 vars in 925 bytes} [Wed Aug 24 17:14:31 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:14:32.009509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a87c-a725-4a68-ac15-6f6eb132c827 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:32.009827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a87c-a725-4a68-ac15-6f6eb132c827 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:32.010233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a87c-a725-4a68-ac15-6f6eb132c827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:32.073474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-d365a87c-a725-4a68-ac15-6f6eb132c827 None None] MFA Rules not processed for user `a698e566a46841cf83aa1711e83f8829`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:32.075105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d365a87c-a725-4a68-ac15-6f6eb132c827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:32.149817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 755/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Aug 24 17:14:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:36.309831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed4b66-fd6f-4a7d-97ad-ddbbf5e936e8 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:36.310344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed4b66-fd6f-4a7d-97ad-ddbbf5e936e8 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:36.310344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed4b66-fd6f-4a7d-97ad-ddbbf5e936e8 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:36.311689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 764/1519] 10.222.0.20 () {54 vars in 961 bytes} [Wed Aug 24 17:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:14:36.317384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6567-887a-408f-a9c3-ce202a9e1d49 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:36.317843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6567-887a-408f-a9c3-ce202a9e1d49 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:36.317943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f6567-887a-408f-a9c3-ce202a9e1d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:36.338641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8b1f6567-887a-408f-a9c3-ce202a9e1d49 None None] MFA Rules not processed for user `a698e566a46841cf83aa1711e83f8829`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:36.339917 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8b1f6567-887a-408f-a9c3-ce202a9e1d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:36.348935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 756/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Aug 24 17:14:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:36.356488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed4b66-fd6f-4a7d-97ad-ddbbf5e936e8 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:36.370034 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed4b66-fd6f-4a7d-97ad-ddbbf5e936e8 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:36.375075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f0db2-eddc-4e81-87f0-b90d2d4630ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a698e566a46841cf83aa1711e83f8829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:36.375686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0db2-eddc-4e81-87f0-b90d2d4630ad service placement] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:36.375964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0db2-eddc-4e81-87f0-b90d2d4630ad service placement] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:36.376811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f0db2-eddc-4e81-87f0-b90d2d4630ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:36.387221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f0db2-eddc-4e81-87f0-b90d2d4630ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:36.388843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f0db2-eddc-4e81-87f0-b90d2d4630ad service placement] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:36.399649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 765/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:14:42.913325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b4129-fc27-4c8b-820f-b76cce52de0b None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:42.914823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b4129-fc27-4c8b-820f-b76cce52de0b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:42.915118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b4129-fc27-4c8b-820f-b76cce52de0b None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:42.916562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:14:42.921844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c561be-d3fd-467a-9f3a-122b70b799d2 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:42.922353 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c561be-d3fd-467a-9f3a-122b70b799d2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:42.922459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c561be-d3fd-467a-9f3a-122b70b799d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:42.943330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-29c561be-d3fd-467a-9f3a-122b70b799d2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:42.944602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-29c561be-d3fd-467a-9f3a-122b70b799d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:42.952537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:43.107877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b4129-fc27-4c8b-820f-b76cce52de0b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:43.123376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b4129-fc27-4c8b-820f-b76cce52de0b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:43.129101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b532ea1-f3c8-497b-8231-29608199fee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:43.129756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532ea1-f3c8-497b-8231-29608199fee7 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:43.130051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532ea1-f3c8-497b-8231-29608199fee7 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:43.130365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b532ea1-f3c8-497b-8231-29608199fee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:43.139202 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b532ea1-f3c8-497b-8231-29608199fee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:43.140829 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b532ea1-f3c8-497b-8231-29608199fee7 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:43.151772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 758/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:14:43.996892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f6a13-821f-45a5-89f4-97fc0c2bc0b2 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:43.997505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f6a13-821f-45a5-89f4-97fc0c2bc0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:43.997505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f6a13-821f-45a5-89f4-97fc0c2bc0b2 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:43.998873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:14:44.004514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9563-d8a8-4027-a004-81ad9aef435d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:44.005033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9563-d8a8-4027-a004-81ad9aef435d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:44.005033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9563-d8a8-4027-a004-81ad9aef435d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:44.027776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-476a9563-d8a8-4027-a004-81ad9aef435d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:44.029115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-476a9563-d8a8-4027-a004-81ad9aef435d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:44.037977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:44.193714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f6a13-821f-45a5-89f4-97fc0c2bc0b2 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:44.210062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f6a13-821f-45a5-89f4-97fc0c2bc0b2 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:44.216637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ead4fa-218a-46ce-906d-2a606a4a6a63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:44.217369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead4fa-218a-46ce-906d-2a606a4a6a63 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:44.217767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead4fa-218a-46ce-906d-2a606a4a6a63 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:44.218163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ead4fa-218a-46ce-906d-2a606a4a6a63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:44.228196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ead4fa-218a-46ce-906d-2a606a4a6a63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:44.229815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ead4fa-218a-46ce-906d-2a606a4a6a63 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:44.240435 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 768/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:14:48.220199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03253f-fd16-4368-8a03-f3b4952e3b36 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:48.221371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03253f-fd16-4368-8a03-f3b4952e3b36 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:48.221535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03253f-fd16-4368-8a03-f3b4952e3b36 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:48.223204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:14:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:14:48.228704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91969d55-8319-43e1-af91-72bf8dff5ddc None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:48.229165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91969d55-8319-43e1-af91-72bf8dff5ddc None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:48.229270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91969d55-8319-43e1-af91-72bf8dff5ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:48.248671 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-91969d55-8319-43e1-af91-72bf8dff5ddc None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:48.249864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-91969d55-8319-43e1-af91-72bf8dff5ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:48.258146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:48.546809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03253f-fd16-4368-8a03-f3b4952e3b36 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:48.548692 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1e03253f-fd16-4368-8a03-f3b4952e3b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:48.578567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:14:48.609669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03253f-fd16-4368-8a03-f3b4952e3b36 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:48.613533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0434c6d-6665-467c-9afc-066370aea41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:48.614165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0434c6d-6665-467c-9afc-066370aea41a service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:48.614446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0434c6d-6665-467c-9afc-066370aea41a service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:48.614715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0434c6d-6665-467c-9afc-066370aea41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:48.623965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0434c6d-6665-467c-9afc-066370aea41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:48.625555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0434c6d-6665-467c-9afc-066370aea41a service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:48.636108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 761/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:14:50.541772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06132ead-df75-4db6-9ac3-f1dff965871f None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:50.542175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06132ead-df75-4db6-9ac3-f1dff965871f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:50.542317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06132ead-df75-4db6-9ac3-f1dff965871f None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:50.543665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:14:50.549468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3790f-fcc8-4ee1-81e8-d07aacb30478 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:50.549917 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3790f-fcc8-4ee1-81e8-d07aacb30478 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:50.550024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3790f-fcc8-4ee1-81e8-d07aacb30478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:50.570131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-d2a3790f-fcc8-4ee1-81e8-d07aacb30478 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:50.572027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d2a3790f-fcc8-4ee1-81e8-d07aacb30478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:50.579810 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:50.867707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06132ead-df75-4db6-9ac3-f1dff965871f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:50.879086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06132ead-df75-4db6-9ac3-f1dff965871f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:50.882659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ce590-c787-465e-9182-14eb871a9df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:50.883260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ce590-c787-465e-9182-14eb871a9df2 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:50.883536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ce590-c787-465e-9182-14eb871a9df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:50.883804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ce590-c787-465e-9182-14eb871a9df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:50.893431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ce590-c787-465e-9182-14eb871a9df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:50.894869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ce590-c787-465e-9182-14eb871a9df2 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:50.904564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 771/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:14:54.413269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71edce-12d4-4752-8803-2c401ad65812 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:54.413807 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71edce-12d4-4752-8803-2c401ad65812 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:54.413807 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71edce-12d4-4752-8803-2c401ad65812 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:54.415138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:14:54.420833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2875-ee91-4916-ae62-00c7482954d3 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:54.421288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2875-ee91-4916-ae62-00c7482954d3 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:54.421390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2875-ee91-4916-ae62-00c7482954d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:54.441060 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-2acb2875-ee91-4916-ae62-00c7482954d3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:54.442288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2acb2875-ee91-4916-ae62-00c7482954d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:54.450034 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:14:55.017379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71edce-12d4-4752-8803-2c401ad65812 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:55.019077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ca71edce-12d4-4752-8803-2c401ad65812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:55.078143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71edce-12d4-4752-8803-2c401ad65812 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:55.081665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5721d-36be-49d1-b2c1-5e646a2a8ce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:55.082267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5721d-36be-49d1-b2c1-5e646a2a8ce1 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:55.082546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5721d-36be-49d1-b2c1-5e646a2a8ce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:55.082819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5721d-36be-49d1-b2c1-5e646a2a8ce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:55.091599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5721d-36be-49d1-b2c1-5e646a2a8ce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:55.093028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5721d-36be-49d1-b2c1-5e646a2a8ce1 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:55.103022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 764/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:14:57.053728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457555be-babc-44c8-b29e-89adfd5b56df None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:57.054305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457555be-babc-44c8-b29e-89adfd5b56df None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:57.054305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457555be-babc-44c8-b29e-89adfd5b56df None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:57.055589 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:14:57.061022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f6947-8690-4e5e-9761-81ec9f0d8597 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:57.061463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f6947-8690-4e5e-9761-81ec9f0d8597 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:57.061578 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f6947-8690-4e5e-9761-81ec9f0d8597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:57.081826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-916f6947-8690-4e5e-9761-81ec9f0d8597 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:57.083037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-916f6947-8690-4e5e-9761-81ec9f0d8597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:57.091093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:57.664598 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457555be-babc-44c8-b29e-89adfd5b56df None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:57.666465 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-457555be-babc-44c8-b29e-89adfd5b56df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:57.675752 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=77 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:14:57.681904 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457555be-babc-44c8-b29e-89adfd5b56df None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:57.685400 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d0038-d2c3-427d-8fbd-80be4eb2640c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:57.685992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0038-d2c3-427d-8fbd-80be4eb2640c service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:57.686267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0038-d2c3-427d-8fbd-80be4eb2640c service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:57.686534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d0038-d2c3-427d-8fbd-80be4eb2640c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:57.696614 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d0038-d2c3-427d-8fbd-80be4eb2640c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:57.698090 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d0038-d2c3-427d-8fbd-80be4eb2640c service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:57.708388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 774/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:15:07.076022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=47 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:07.706998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=5 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:36.008025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ea84-4d78-475c-b7cb-225db30022e6 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.009859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ea84-4d78-475c-b7cb-225db30022e6 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.009859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ea84-4d78-475c-b7cb-225db30022e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.043063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-2bc2ea84-4d78-475c-b7cb-225db30022e6 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.044644 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2bc2ea84-4d78-475c-b7cb-225db30022e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.058240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 766/1540] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.070408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b984c27-b4c0-4488-a9cc-f52f10fad95f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.071013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b984c27-b4c0-4488-a9cc-f52f10fad95f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.071013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b984c27-b4c0-4488-a9cc-f52f10fad95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.088300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387fe12-1efe-4477-9473-8d32675d2356 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.088672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387fe12-1efe-4477-9473-8d32675d2356 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.088859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387fe12-1efe-4477-9473-8d32675d2356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.101929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-1b984c27-b4c0-4488-a9cc-f52f10fad95f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.103354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1b984c27-b4c0-4488-a9cc-f52f10fad95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.121695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8387fe12-1efe-4477-9473-8d32675d2356 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.122086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 775/1541] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.123096 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8387fe12-1efe-4477-9473-8d32675d2356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.136344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 767/1542] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 17:16:36.144089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b984c27-b4c0-4488-a9cc-f52f10fad95f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:36.146453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb2bb-4fc8-4dfb-93c3-f658195ee169 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.146832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb2bb-4fc8-4dfb-93c3-f658195ee169 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.147019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb2bb-4fc8-4dfb-93c3-f658195ee169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.160476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b984c27-b4c0-4488-a9cc-f52f10fad95f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:36.172294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c26bf-ef58-4e0b-8186-0a29fa06808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:36.173001 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c26bf-ef58-4e0b-8186-0a29fa06808b admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.173283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c26bf-ef58-4e0b-8186-0a29fa06808b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.173557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c26bf-ef58-4e0b-8186-0a29fa06808b admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.175272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c26bf-ef58-4e0b-8186-0a29fa06808b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:36.175888 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c26bf-ef58-4e0b-8186-0a29fa06808b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:36.176770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: WARNING py.warnings [None req-978c26bf-ef58-4e0b-8186-0a29fa06808b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:16:36.176770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: warnings.warn(msg) Aug 24 17:16:36.176770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: Aug 24 17:16:36.177663 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c26bf-ef58-4e0b-8186-0a29fa06808b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:36.181449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-c91bb2bb-4fc8-4dfb-93c3-f658195ee169 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.182710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c91bb2bb-4fc8-4dfb-93c3-f658195ee169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.200099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 776/1543] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:36.201517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b719415-2e98-498b-a2c0-f4b1722f6744 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.201806 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b719415-2e98-498b-a2c0-f4b1722f6744 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.202083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b719415-2e98-498b-a2c0-f4b1722f6744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.205502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 768/1544] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:16:36.215118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bb2bb-4fc8-4dfb-93c3-f658195ee169 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:36.230591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bb2bb-4fc8-4dfb-93c3-f658195ee169 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:36.236188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0b719415-2e98-498b-a2c0-f4b1722f6744 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.242258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0b719415-2e98-498b-a2c0-f4b1722f6744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.259019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 777/1545] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.260054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b719415-2e98-498b-a2c0-f4b1722f6744 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:36.265033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca00bfe-12d0-4669-b99a-bedb08c6d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:36.265667 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00bfe-12d0-4669-b99a-bedb08c6d7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.265941 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00bfe-12d0-4669-b99a-bedb08c6d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.266455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca00bfe-12d0-4669-b99a-bedb08c6d7b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.267239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca00bfe-12d0-4669-b99a-bedb08c6d7b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:36.267528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca00bfe-12d0-4669-b99a-bedb08c6d7b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:36.269334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca00bfe-12d0-4669-b99a-bedb08c6d7b5 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:36.274637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b719415-2e98-498b-a2c0-f4b1722f6744 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:36.290515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e51399-ff19-450a-a76c-4266f4fc7edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:36.290959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 769/1546] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:36.291155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e51399-ff19-450a-a76c-4266f4fc7edd admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.294694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e51399-ff19-450a-a76c-4266f4fc7edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.294843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0490674-fb8b-43ec-94f8-31251bd61cec None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.294936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e51399-ff19-450a-a76c-4266f4fc7edd admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.295025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0490674-fb8b-43ec-94f8-31251bd61cec None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.295025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0490674-fb8b-43ec-94f8-31251bd61cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.295242 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e51399-ff19-450a-a76c-4266f4fc7edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:36.295242 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e51399-ff19-450a-a76c-4266f4fc7edd admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:36.336824 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b0490674-fb8b-43ec-94f8-31251bd61cec None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.345842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b0490674-fb8b-43ec-94f8-31251bd61cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.359346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 770/1547] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.359959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0490674-fb8b-43ec-94f8-31251bd61cec None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:36.374548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0490674-fb8b-43ec-94f8-31251bd61cec None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:36.380519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad6d45-d9aa-4a08-9541-b0696fb22ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:36.381213 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad6d45-d9aa-4a08-9541-b0696fb22ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.381493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad6d45-d9aa-4a08-9541-b0696fb22ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.381761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad6d45-d9aa-4a08-9541-b0696fb22ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.382404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad6d45-d9aa-4a08-9541-b0696fb22ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:36.383433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: WARNING py.warnings [None req-4bad6d45-d9aa-4a08-9541-b0696fb22ae8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:16:36.383433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: warnings.warn(msg) Aug 24 17:16:36.383433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: Aug 24 17:16:36.384703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad6d45-d9aa-4a08-9541-b0696fb22ae8 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:36.418058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 778/1548] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:36.418875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e51399-ff19-450a-a76c-4266f4fc7edd admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:36.482992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 771/1549] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:36.484385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bc717-3dad-46f7-900a-6ff0ec0c8f4b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.484676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bc717-3dad-46f7-900a-6ff0ec0c8f4b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.484987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bc717-3dad-46f7-900a-6ff0ec0c8f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.508474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-369bc717-3dad-46f7-900a-6ff0ec0c8f4b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.509324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e51399-ff19-450a-a76c-4266f4fc7edd admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:36.509772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-369bc717-3dad-46f7-900a-6ff0ec0c8f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.569779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6276ac-be62-4193-96a6-47dacaf3db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:36.570527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6276ac-be62-4193-96a6-47dacaf3db1c admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.570809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6276ac-be62-4193-96a6-47dacaf3db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.571087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6276ac-be62-4193-96a6-47dacaf3db1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.571772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6276ac-be62-4193-96a6-47dacaf3db1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:36.572080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6276ac-be62-4193-96a6-47dacaf3db1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:36.573739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6276ac-be62-4193-96a6-47dacaf3db1c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:36.574557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 772/1550] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.575393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bc717-3dad-46f7-900a-6ff0ec0c8f4b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:36.585899 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369bc717-3dad-46f7-900a-6ff0ec0c8f4b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:36.590107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 779/1551] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:36.591031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61a9f6-0826-4d95-a50c-fd1e3eee6ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:36.591633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895a965-a979-4a8b-8844-77f121d28e73 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.591912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61a9f6-0826-4d95-a50c-fd1e3eee6ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.592039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895a965-a979-4a8b-8844-77f121d28e73 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.592133 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61a9f6-0826-4d95-a50c-fd1e3eee6ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.592211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895a965-a979-4a8b-8844-77f121d28e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.592467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61a9f6-0826-4d95-a50c-fd1e3eee6ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.593093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61a9f6-0826-4d95-a50c-fd1e3eee6ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:36.595000 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61a9f6-0826-4d95-a50c-fd1e3eee6ea9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:36.614702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-4895a965-a979-4a8b-8844-77f121d28e73 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.615942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4895a965-a979-4a8b-8844-77f121d28e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.624174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 780/1552] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.625484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece433-5a30-4ca1-9d33-f757cfff7c9d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.625807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece433-5a30-4ca1-9d33-f757cfff7c9d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.626040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ece433-5a30-4ca1-9d33-f757cfff7c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.647493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-a1ece433-5a30-4ca1-9d33-f757cfff7c9d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.648759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a1ece433-5a30-4ca1-9d33-f757cfff7c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.658730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 781/1553] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.660321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6230ccf-c687-4632-8f90-043bb09b9962 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.660604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6230ccf-c687-4632-8f90-043bb09b9962 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.660955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6230ccf-c687-4632-8f90-043bb09b9962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.682218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c6230ccf-c687-4632-8f90-043bb09b9962 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.683338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c6230ccf-c687-4632-8f90-043bb09b9962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.693313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 782/1554] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.694984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85032c79-b0b7-4079-af56-d2d1b3a8eb40 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.695496 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85032c79-b0b7-4079-af56-d2d1b3a8eb40 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.695622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 773/1555] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:36.696172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85032c79-b0b7-4079-af56-d2d1b3a8eb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.696454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61a9f6-0826-4d95-a50c-fd1e3eee6ea9 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:36.707844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61a9f6-0826-4d95-a50c-fd1e3eee6ea9 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:36.712868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22b5ae-8bb2-412a-a6c4-12c502aefde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:36.713496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b5ae-8bb2-412a-a6c4-12c502aefde6 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.713771 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b5ae-8bb2-412a-a6c4-12c502aefde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.714044 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b5ae-8bb2-412a-a6c4-12c502aefde6 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.714709 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22b5ae-8bb2-412a-a6c4-12c502aefde6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:36.716705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22b5ae-8bb2-412a-a6c4-12c502aefde6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:36.719732 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-85032c79-b0b7-4079-af56-d2d1b3a8eb40 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.721545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-85032c79-b0b7-4079-af56-d2d1b3a8eb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.730188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 783/1556] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.731509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4cb00-80b4-4173-9886-f786e400b1df None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.731783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4cb00-80b4-4173-9886-f786e400b1df None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.732053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4cb00-80b4-4173-9886-f786e400b1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.753682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0ff4cb00-80b4-4173-9886-f786e400b1df None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.757324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0ff4cb00-80b4-4173-9886-f786e400b1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.762790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 784/1557] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.763602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4cb00-80b4-4173-9886-f786e400b1df None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:36.773678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4cb00-80b4-4173-9886-f786e400b1df None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:36.778305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc18979-e372-4603-bfc8-166e8d126d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:36.778914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18979-e372-4603-bfc8-166e8d126d21 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.779185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18979-e372-4603-bfc8-166e8d126d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.779448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc18979-e372-4603-bfc8-166e8d126d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.780096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc18979-e372-4603-bfc8-166e8d126d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:36.782040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc18979-e372-4603-bfc8-166e8d126d21 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:36.852867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 774/1558] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:36.854275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515e175-bc3d-4c03-9348-bbf328c48022 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.854557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515e175-bc3d-4c03-9348-bbf328c48022 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.854961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515e175-bc3d-4c03-9348-bbf328c48022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.875629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-9515e175-bc3d-4c03-9348-bbf328c48022 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.876955 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9515e175-bc3d-4c03-9348-bbf328c48022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.886250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 775/1559] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.887660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ecc08-d73f-4870-a597-0264920ac40b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.887948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ecc08-d73f-4870-a597-0264920ac40b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.888220 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ecc08-d73f-4870-a597-0264920ac40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.908822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-f39ecc08-d73f-4870-a597-0264920ac40b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.910240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f39ecc08-d73f-4870-a597-0264920ac40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.918406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 776/1560] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:36.919179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ecc08-d73f-4870-a597-0264920ac40b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:36.929752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ecc08-d73f-4870-a597-0264920ac40b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:36.934817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8b636-d7f5-467b-852f-6e55cb64fb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:36.935375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8b636-d7f5-467b-852f-6e55cb64fb3d admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.935684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8b636-d7f5-467b-852f-6e55cb64fb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.935957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8b636-d7f5-467b-852f-6e55cb64fb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.936673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8b636-d7f5-467b-852f-6e55cb64fb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:36.938331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8b636-d7f5-467b-852f-6e55cb64fb3d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:36.949828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 777/1561] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:36.951100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba2369-02c4-4f08-aee8-e026b41c683e None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.951385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba2369-02c4-4f08-aee8-e026b41c683e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.951656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba2369-02c4-4f08-aee8-e026b41c683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.955889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:36.964121 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 785/1562] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:36.966627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e12c-a79c-46ab-acec-2987078ece12 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:36.966627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e12c-a79c-46ab-acec-2987078ece12 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:36.966627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23e12c-a79c-46ab-acec-2987078ece12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:36.974389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e6ba2369-02c4-4f08-aee8-e026b41c683e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.975609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e6ba2369-02c4-4f08-aee8-e026b41c683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:36.986875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-fb23e12c-a79c-46ab-acec-2987078ece12 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:36.988754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fb23e12c-a79c-46ab-acec-2987078ece12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:37.014161 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:37.042084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 778/1563] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:37.042937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba2369-02c4-4f08-aee8-e026b41c683e None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.053076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba2369-02c4-4f08-aee8-e026b41c683e None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.054323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 786/1564] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:37.064155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23e12c-a79c-46ab-acec-2987078ece12 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.065165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0401d-7c7f-4f8e-8d26-f82e248cf245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.065165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0401d-7c7f-4f8e-8d26-f82e248cf245 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.065165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0401d-7c7f-4f8e-8d26-f82e248cf245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.065165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0401d-7c7f-4f8e-8d26-f82e248cf245 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.065513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0401d-7c7f-4f8e-8d26-f82e248cf245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:37.065513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0401d-7c7f-4f8e-8d26-f82e248cf245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.065513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0401d-7c7f-4f8e-8d26-f82e248cf245 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.065759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23e12c-a79c-46ab-acec-2987078ece12 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.070193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5feda-bad9-4d53-8aea-d21aa9a19ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.070789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5feda-bad9-4d53-8aea-d21aa9a19ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.071377 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5feda-bad9-4d53-8aea-d21aa9a19ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.071377 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5feda-bad9-4d53-8aea-d21aa9a19ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.071957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5feda-bad9-4d53-8aea-d21aa9a19ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.073769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5feda-bad9-4d53-8aea-d21aa9a19ae2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.074529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 779/1565] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:37.075436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0401d-7c7f-4f8e-8d26-f82e248cf245 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.085331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0401d-7c7f-4f8e-8d26-f82e248cf245 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.090049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284138f0-9039-4dc3-bd95-963382831770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.090682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284138f0-9039-4dc3-bd95-963382831770 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.091005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284138f0-9039-4dc3-bd95-963382831770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.091553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284138f0-9039-4dc3-bd95-963382831770 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.094630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 787/1566] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:37.094630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5feda-bad9-4d53-8aea-d21aa9a19ae2 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.094884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284138f0-9039-4dc3-bd95-963382831770 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:37.094884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284138f0-9039-4dc3-bd95-963382831770 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.095253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284138f0-9039-4dc3-bd95-963382831770 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.102978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5feda-bad9-4d53-8aea-d21aa9a19ae2 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.116243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 780/1567] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:37.118200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acab1a-f102-4aa3-ae5c-a74974cfec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.118346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284138f0-9039-4dc3-bd95-963382831770 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.118458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acab1a-f102-4aa3-ae5c-a74974cfec2d admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.118458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acab1a-f102-4aa3-ae5c-a74974cfec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.118458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57acab1a-f102-4aa3-ae5c-a74974cfec2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.118458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acab1a-f102-4aa3-ae5c-a74974cfec2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:37.118458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acab1a-f102-4aa3-ae5c-a74974cfec2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.118458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57acab1a-f102-4aa3-ae5c-a74974cfec2d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.121555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284138f0-9039-4dc3-bd95-963382831770 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.125548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 788/1568] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:37.126362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acab1a-f102-4aa3-ae5c-a74974cfec2d admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.126467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cfe16-6b43-4d10-8873-341bb1a5a7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.127018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cfe16-6b43-4d10-8873-341bb1a5a7ba admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.127307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cfe16-6b43-4d10-8873-341bb1a5a7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.127687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cfe16-6b43-4d10-8873-341bb1a5a7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.128385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cfe16-6b43-4d10-8873-341bb1a5a7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.129983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cfe16-6b43-4d10-8873-341bb1a5a7ba admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.136862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57acab1a-f102-4aa3-ae5c-a74974cfec2d admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.140761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 781/1569] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:37.141704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cfe16-6b43-4d10-8873-341bb1a5a7ba admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.141836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd69e0-6810-4fee-a0b3-5eba0bbeba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.142553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd69e0-6810-4fee-a0b3-5eba0bbeba52 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.142833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd69e0-6810-4fee-a0b3-5eba0bbeba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.143106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd69e0-6810-4fee-a0b3-5eba0bbeba52 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.143792 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd69e0-6810-4fee-a0b3-5eba0bbeba52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.144902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: WARNING py.warnings [None req-d7bd69e0-6810-4fee-a0b3-5eba0bbeba52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:16:37.144902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: warnings.warn(msg) Aug 24 17:16:37.144902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: Aug 24 17:16:37.146101 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd69e0-6810-4fee-a0b3-5eba0bbeba52 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.151746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cfe16-6b43-4d10-8873-341bb1a5a7ba admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.157477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b2d32-1560-4a26-ab9a-cc0a5e8d93fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.158164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b2d32-1560-4a26-ab9a-cc0a5e8d93fa admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.158359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b2d32-1560-4a26-ab9a-cc0a5e8d93fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.159151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b2d32-1560-4a26-ab9a-cc0a5e8d93fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.160028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b2d32-1560-4a26-ab9a-cc0a5e8d93fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:37.160358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b2d32-1560-4a26-ab9a-cc0a5e8d93fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.162051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b2d32-1560-4a26-ab9a-cc0a5e8d93fa admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.173955 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 782/1570] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:37.175442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b2d32-1560-4a26-ab9a-cc0a5e8d93fa admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.185115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b2d32-1560-4a26-ab9a-cc0a5e8d93fa admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.189584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f296a4-dbf8-4c54-8e97-1643b4a8f264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.190290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f296a4-dbf8-4c54-8e97-1643b4a8f264 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.190568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f296a4-dbf8-4c54-8e97-1643b4a8f264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.190835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f296a4-dbf8-4c54-8e97-1643b4a8f264 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.191463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f296a4-dbf8-4c54-8e97-1643b4a8f264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:37.191758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f296a4-dbf8-4c54-8e97-1643b4a8f264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.193348 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f296a4-dbf8-4c54-8e97-1643b4a8f264 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.205010 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 783/1571] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:37.205842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f296a4-dbf8-4c54-8e97-1643b4a8f264 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.215061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f296a4-dbf8-4c54-8e97-1643b4a8f264 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.219585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbd0bd-2b80-44ca-b1ea-783eedd12c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.220157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd0bd-2b80-44ca-b1ea-783eedd12c6b admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.220460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd0bd-2b80-44ca-b1ea-783eedd12c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.220750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbd0bd-2b80-44ca-b1ea-783eedd12c6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.222018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbd0bd-2b80-44ca-b1ea-783eedd12c6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.223875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fbd0bd-2b80-44ca-b1ea-783eedd12c6b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.247758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 789/1572] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:37 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:37.248745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd69e0-6810-4fee-a0b3-5eba0bbeba52 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.258744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd69e0-6810-4fee-a0b3-5eba0bbeba52 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.263780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda4cfe-8d5d-469f-a75a-384305134949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.264433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4cfe-8d5d-469f-a75a-384305134949 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.264712 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4cfe-8d5d-469f-a75a-384305134949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.264981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4cfe-8d5d-469f-a75a-384305134949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.265625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda4cfe-8d5d-469f-a75a-384305134949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.267521 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda4cfe-8d5d-469f-a75a-384305134949 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.278183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 790/1573] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:37.278938 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda4cfe-8d5d-469f-a75a-384305134949 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.293520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda4cfe-8d5d-469f-a75a-384305134949 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.298221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e9b7f-dd56-4497-b3e3-e18a4197b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.302812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e9b7f-dd56-4497-b3e3-e18a4197b302 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.302812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e9b7f-dd56-4497-b3e3-e18a4197b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.302812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e9b7f-dd56-4497-b3e3-e18a4197b302 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.302812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e9b7f-dd56-4497-b3e3-e18a4197b302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.302812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e9b7f-dd56-4497-b3e3-e18a4197b302 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.327747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 784/1574] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:37 2022] POST /identity/v3/projects => generated 363 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:37.331429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbd0bd-2b80-44ca-b1ea-783eedd12c6b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.398603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 791/1575] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:37 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:37.398603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e9b7f-dd56-4497-b3e3-e18a4197b302 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.401414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbd0bd-2b80-44ca-b1ea-783eedd12c6b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.465744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e9b7f-dd56-4497-b3e3-e18a4197b302 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.466196 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea6e9-5262-40fa-91b5-091141d93be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.466806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea6e9-5262-40fa-91b5-091141d93be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.467087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea6e9-5262-40fa-91b5-091141d93be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.467451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ea6e9-5262-40fa-91b5-091141d93be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.468108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ea6e9-5262-40fa-91b5-091141d93be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.470091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ea6e9-5262-40fa-91b5-091141d93be9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.470594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5a052-217d-4566-acee-7fc587a1808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.471924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5a052-217d-4566-acee-7fc587a1808e admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.472210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5a052-217d-4566-acee-7fc587a1808e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.472559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5a052-217d-4566-acee-7fc587a1808e admin admin] PATH_INFO: `/v3/projects/8dff65fdd6d24ddd943c7f120449d917/users/faa05352b7c54c6a88b88a6ce9613aa0/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.476476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:37.489254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5a052-217d-4566-acee-7fc587a1808e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dff65fdd6d24ddd943c7f120449d917, user_id=faa05352b7c54c6a88b88a6ce9613aa0, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.492147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5a052-217d-4566-acee-7fc587a1808e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.562554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 785/1576] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:37 2022] POST /identity/v3/projects => generated 389 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:37.563503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea6e9-5262-40fa-91b5-091141d93be9 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.574208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 792/1577] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:37 2022] PUT /identity/v3/projects/8dff65fdd6d24ddd943c7f120449d917/users/faa05352b7c54c6a88b88a6ce9613aa0/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:37.581761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5a052-217d-4566-acee-7fc587a1808e admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.584866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:37.629457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ea6e9-5262-40fa-91b5-091141d93be9 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.634135 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356de79-43cc-4817-839b-d38dc4689f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.634749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356de79-43cc-4817-839b-d38dc4689f24 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.635029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356de79-43cc-4817-839b-d38dc4689f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.635299 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356de79-43cc-4817-839b-d38dc4689f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.635932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356de79-43cc-4817-839b-d38dc4689f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.637717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5a052-217d-4566-acee-7fc587a1808e admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.637882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356de79-43cc-4817-839b-d38dc4689f24 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.642653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46353d9e-eb4b-4c8a-a415-325fdd51245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.643779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46353d9e-eb4b-4c8a-a415-325fdd51245b admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.644057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46353d9e-eb4b-4c8a-a415-325fdd51245b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.644362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46353d9e-eb4b-4c8a-a415-325fdd51245b admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.645059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46353d9e-eb4b-4c8a-a415-325fdd51245b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.646963 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46353d9e-eb4b-4c8a-a415-325fdd51245b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.769969 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 793/1578] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:37 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:37.770899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46353d9e-eb4b-4c8a-a415-325fdd51245b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.773645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 786/1579] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:37 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:37.774342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356de79-43cc-4817-839b-d38dc4689f24 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.849298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356de79-43cc-4817-839b-d38dc4689f24 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.852503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46353d9e-eb4b-4c8a-a415-325fdd51245b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.853915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aa6c0-62dd-42ba-8473-a93ceea7d331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.854718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aa6c0-62dd-42ba-8473-a93ceea7d331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.854997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aa6c0-62dd-42ba-8473-a93ceea7d331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.855269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312aa6c0-62dd-42ba-8473-a93ceea7d331 admin admin] PATH_INFO: `/v3/projects/450f1824b50f4d99acf0aa424efb0922/users/751a93746a5248cb9ec450b315282f60/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.857679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b39869-be45-4121-8d97-2717d9d68ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.858341 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b39869-be45-4121-8d97-2717d9d68ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.858621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b39869-be45-4121-8d97-2717d9d68ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.858947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b39869-be45-4121-8d97-2717d9d68ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.859578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b39869-be45-4121-8d97-2717d9d68ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.861327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b39869-be45-4121-8d97-2717d9d68ea5 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.876554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 794/1580] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:37.876554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b39869-be45-4121-8d97-2717d9d68ea5 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:37.881175 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312aa6c0-62dd-42ba-8473-a93ceea7d331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=450f1824b50f4d99acf0aa424efb0922, user_id=751a93746a5248cb9ec450b315282f60, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.882226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: WARNING py.warnings [None req-312aa6c0-62dd-42ba-8473-a93ceea7d331 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:16:37.882226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: warnings.warn(msg) Aug 24 17:16:37.882226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: Aug 24 17:16:37.884168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312aa6c0-62dd-42ba-8473-a93ceea7d331 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.884911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b39869-be45-4121-8d97-2717d9d68ea5 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:37.889966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bacfa1-ae25-478b-8634-ecb3120b9c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:37.890562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bacfa1-ae25-478b-8634-ecb3120b9c2a admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:37.890839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bacfa1-ae25-478b-8634-ecb3120b9c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:37.891110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bacfa1-ae25-478b-8634-ecb3120b9c2a admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:37.892005 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bacfa1-ae25-478b-8634-ecb3120b9c2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:37.894679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bacfa1-ae25-478b-8634-ecb3120b9c2a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:37.972713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 787/1581] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:37 2022] PUT /identity/v3/projects/450f1824b50f4d99acf0aa424efb0922/users/751a93746a5248cb9ec450b315282f60/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:37.973536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aa6c0-62dd-42ba-8473-a93ceea7d331 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.008828 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 795/1582] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:37 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:38.008828 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bacfa1-ae25-478b-8634-ecb3120b9c2a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.019829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bacfa1-ae25-478b-8634-ecb3120b9c2a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.032544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:38.037968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312aa6c0-62dd-42ba-8473-a93ceea7d331 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.042828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb77f8-1024-43bd-9db4-956b130ac005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.043437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb77f8-1024-43bd-9db4-956b130ac005 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.043717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb77f8-1024-43bd-9db4-956b130ac005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.043987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb77f8-1024-43bd-9db4-956b130ac005 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.044679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb77f8-1024-43bd-9db4-956b130ac005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.046597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb77f8-1024-43bd-9db4-956b130ac005 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.077808 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892074f1-098e-46f6-84ac-7c72cf57be45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.078426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892074f1-098e-46f6-84ac-7c72cf57be45 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.078742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892074f1-098e-46f6-84ac-7c72cf57be45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.079032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892074f1-098e-46f6-84ac-7c72cf57be45 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.079661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892074f1-098e-46f6-84ac-7c72cf57be45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.082218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892074f1-098e-46f6-84ac-7c72cf57be45 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.171848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 788/1583] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:37 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:38.173331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfff6f8-cba6-4fd4-888d-ecdb89030919 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.173619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfff6f8-cba6-4fd4-888d-ecdb89030919 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.173893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfff6f8-cba6-4fd4-888d-ecdb89030919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.202201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:38.203438 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1bfff6f8-cba6-4fd4-888d-ecdb89030919 None None] MFA Rules not processed for user `faa05352b7c54c6a88b88a6ce9613aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:38.204769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1bfff6f8-cba6-4fd4-888d-ecdb89030919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:38.210870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 796/1584] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:38 2022] POST /identity/v3/users => generated 295 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:38.210870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892074f1-098e-46f6-84ac-7c72cf57be45 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.221214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892074f1-098e-46f6-84ac-7c72cf57be45 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.225979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3e951-d211-4b7d-b077-61e348293836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.226673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3e951-d211-4b7d-b077-61e348293836 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.226914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3e951-d211-4b7d-b077-61e348293836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.227187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3e951-d211-4b7d-b077-61e348293836 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.227864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3e951-d211-4b7d-b077-61e348293836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.229859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3e951-d211-4b7d-b077-61e348293836 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.272904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 789/1585] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:38.273827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfff6f8-cba6-4fd4-888d-ecdb89030919 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.286341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfff6f8-cba6-4fd4-888d-ecdb89030919 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.290714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f44445-3515-4cdf-bd57-962758155a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.291341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f44445-3515-4cdf-bd57-962758155a0d admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.291764 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f44445-3515-4cdf-bd57-962758155a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.292053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f44445-3515-4cdf-bd57-962758155a0d admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.292749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f44445-3515-4cdf-bd57-962758155a0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.294832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f44445-3515-4cdf-bd57-962758155a0d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.334158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 797/1586] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:38 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:38.335132 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3e951-d211-4b7d-b077-61e348293836 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.345684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3e951-d211-4b7d-b077-61e348293836 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.350590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fac6e5-eb3a-48ec-9848-61b839c3a58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.351212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac6e5-eb3a-48ec-9848-61b839c3a58f admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.351489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac6e5-eb3a-48ec-9848-61b839c3a58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.351759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fac6e5-eb3a-48ec-9848-61b839c3a58f admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.352441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fac6e5-eb3a-48ec-9848-61b839c3a58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.354099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fac6e5-eb3a-48ec-9848-61b839c3a58f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.365561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 798/1587] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:38.367059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086809e-c977-48ab-953e-8675f1464059 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.367378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086809e-c977-48ab-953e-8675f1464059 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.367651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086809e-c977-48ab-953e-8675f1464059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.388932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b086809e-c977-48ab-953e-8675f1464059 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:38.397487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b086809e-c977-48ab-953e-8675f1464059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:38.398972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 799/1588] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:38.399791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086809e-c977-48ab-953e-8675f1464059 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.410304 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086809e-c977-48ab-953e-8675f1464059 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.415667 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23d91-15b6-49bb-9021-cce968692920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.416398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23d91-15b6-49bb-9021-cce968692920 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.416607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23d91-15b6-49bb-9021-cce968692920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.416848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b23d91-15b6-49bb-9021-cce968692920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.417495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b23d91-15b6-49bb-9021-cce968692920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.419107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b23d91-15b6-49bb-9021-cce968692920 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.426991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 790/1589] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:38 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:38.428514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f44445-3515-4cdf-bd57-962758155a0d admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.433113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 800/1590] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:38.434270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23d91-15b6-49bb-9021-cce968692920 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.443787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f44445-3515-4cdf-bd57-962758155a0d admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.445843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b23d91-15b6-49bb-9021-cce968692920 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.448965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0111b69-3d85-411f-8c0d-18017a68a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.449597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0111b69-3d85-411f-8c0d-18017a68a2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.449870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0111b69-3d85-411f-8c0d-18017a68a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.450145 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0111b69-3d85-411f-8c0d-18017a68a2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.450730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e0c61-7f07-476d-bc6e-826b85fc4432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.450871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0111b69-3d85-411f-8c0d-18017a68a2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.451354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0c61-7f07-476d-bc6e-826b85fc4432 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.451664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0c61-7f07-476d-bc6e-826b85fc4432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.451897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0c61-7f07-476d-bc6e-826b85fc4432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.452482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0111b69-3d85-411f-8c0d-18017a68a2a7 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.452630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e0c61-7f07-476d-bc6e-826b85fc4432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.454269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e0c61-7f07-476d-bc6e-826b85fc4432 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.464243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 791/1591] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:38.465488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 801/1592] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:38.465745 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5673f4-8a0d-49a9-af57-88dd696d8498 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.466017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5673f4-8a0d-49a9-af57-88dd696d8498 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.466253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5673f4-8a0d-49a9-af57-88dd696d8498 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.466444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e0c61-7f07-476d-bc6e-826b85fc4432 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.467736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 792/1593] 10.222.0.20 () {54 vars in 962 bytes} [Wed Aug 24 17:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:16:38.468597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5673f4-8a0d-49a9-af57-88dd696d8498 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.478508 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e0c61-7f07-476d-bc6e-826b85fc4432 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.483284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5673f4-8a0d-49a9-af57-88dd696d8498 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.483919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765243d-19bd-491e-af5f-a109a026811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.484539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765243d-19bd-491e-af5f-a109a026811c admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.484876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765243d-19bd-491e-af5f-a109a026811c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.485086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765243d-19bd-491e-af5f-a109a026811c admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.485785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765243d-19bd-491e-af5f-a109a026811c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.488115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765243d-19bd-491e-af5f-a109a026811c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.489134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b5e5a-673c-4edd-b88c-38fbfbc9c04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.489844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b5e5a-673c-4edd-b88c-38fbfbc9c04c admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.490124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b5e5a-673c-4edd-b88c-38fbfbc9c04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.490399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b5e5a-673c-4edd-b88c-38fbfbc9c04c admin admin] PATH_INFO: `/v3/projects/b1d209138fbe471593b9b7957de49963/users/4c65575beb3549889b00102f95780716/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.501041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 802/1594] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:38.501922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765243d-19bd-491e-af5f-a109a026811c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.508506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b5e5a-673c-4edd-b88c-38fbfbc9c04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d209138fbe471593b9b7957de49963, user_id=4c65575beb3549889b00102f95780716, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.511278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b5e5a-673c-4edd-b88c-38fbfbc9c04c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.570989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765243d-19bd-491e-af5f-a109a026811c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.574548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecc3ee-cb16-4b71-b1ab-2c86b55a5183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.575209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc3ee-cb16-4b71-b1ab-2c86b55a5183 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.575448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc3ee-cb16-4b71-b1ab-2c86b55a5183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.575717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc3ee-cb16-4b71-b1ab-2c86b55a5183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.584880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 793/1595] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:38 2022] PUT /identity/v3/projects/b1d209138fbe471593b9b7957de49963/users/4c65575beb3549889b00102f95780716/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:38.585905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b5e5a-673c-4edd-b88c-38fbfbc9c04c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.599099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecc3ee-cb16-4b71-b1ab-2c86b55a5183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.600934 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecc3ee-cb16-4b71-b1ab-2c86b55a5183 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.612623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 803/1596] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:38.613611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecc3ee-cb16-4b71-b1ab-2c86b55a5183 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.623903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecc3ee-cb16-4b71-b1ab-2c86b55a5183 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.661729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b5e5a-673c-4edd-b88c-38fbfbc9c04c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.666876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd9c4-f30c-446e-b328-2c19c2c5aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.667572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd9c4-f30c-446e-b328-2c19c2c5aa12 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.667853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd9c4-f30c-446e-b328-2c19c2c5aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.668125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdd9c4-f30c-446e-b328-2c19c2c5aa12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.668817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdd9c4-f30c-446e-b328-2c19c2c5aa12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.670572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdd9c4-f30c-446e-b328-2c19c2c5aa12 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.686195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 794/1597] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:38.686195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd9c4-f30c-446e-b328-2c19c2c5aa12 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.694021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149d17d-4436-4c26-a3b9-f433417f5269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.699003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149d17d-4436-4c26-a3b9-f433417f5269 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.699003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149d17d-4436-4c26-a3b9-f433417f5269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.699003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c149d17d-4436-4c26-a3b9-f433417f5269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.699003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149d17d-4436-4c26-a3b9-f433417f5269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.699003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c149d17d-4436-4c26-a3b9-f433417f5269 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.700103 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdd9c4-f30c-446e-b328-2c19c2c5aa12 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.705069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93a80b-a359-4c14-8b22-596c6880ca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.705769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a80b-a359-4c14-8b22-596c6880ca24 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.706409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a80b-a359-4c14-8b22-596c6880ca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.706409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93a80b-a359-4c14-8b22-596c6880ca24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.707008 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93a80b-a359-4c14-8b22-596c6880ca24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.716845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93a80b-a359-4c14-8b22-596c6880ca24 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.717095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 804/1598] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:38.717095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149d17d-4436-4c26-a3b9-f433417f5269 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.725324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c149d17d-4436-4c26-a3b9-f433417f5269 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.731355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 795/1599] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:38.732727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6016f-b2c8-4908-b018-9d8b6d463ef3 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.733073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6016f-b2c8-4908-b018-9d8b6d463ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.733354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6016f-b2c8-4908-b018-9d8b6d463ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.738207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753c2cb-71af-4a06-ac92-c14c4b3e8322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.738207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753c2cb-71af-4a06-ac92-c14c4b3e8322 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.738207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753c2cb-71af-4a06-ac92-c14c4b3e8322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.738207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753c2cb-71af-4a06-ac92-c14c4b3e8322 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.738656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753c2cb-71af-4a06-ac92-c14c4b3e8322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.739836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753c2cb-71af-4a06-ac92-c14c4b3e8322 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.748547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:38.753442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 805/1600] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:38.754587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753c2cb-71af-4a06-ac92-c14c4b3e8322 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.765117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753c2cb-71af-4a06-ac92-c14c4b3e8322 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.770118 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28228d-fb96-4ce7-b87d-a40dd5a2fbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.770727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28228d-fb96-4ce7-b87d-a40dd5a2fbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.771003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28228d-fb96-4ce7-b87d-a40dd5a2fbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.771281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28228d-fb96-4ce7-b87d-a40dd5a2fbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.771919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28228d-fb96-4ce7-b87d-a40dd5a2fbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.773683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a28228d-fb96-4ce7-b87d-a40dd5a2fbd0 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.775462 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-9ac6016f-b2c8-4908-b018-9d8b6d463ef3 None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:38.776738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9ac6016f-b2c8-4908-b018-9d8b6d463ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:38.786874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 806/1601] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:38.790724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720aa53-9bcf-4d14-8618-4dc3588aa3c7 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.790724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720aa53-9bcf-4d14-8618-4dc3588aa3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.790724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720aa53-9bcf-4d14-8618-4dc3588aa3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.811722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:38.823367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b720aa53-9bcf-4d14-8618-4dc3588aa3c7 None None] MFA Rules not processed for user `4c65575beb3549889b00102f95780716`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:38.824676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b720aa53-9bcf-4d14-8618-4dc3588aa3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:38.859198 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 796/1602] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Aug 24 17:16:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:38.859992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6016f-b2c8-4908-b018-9d8b6d463ef3 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.871290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6016f-b2c8-4908-b018-9d8b6d463ef3 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.876612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ea7fa-8ab1-4b64-b753-8638922e6a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.877300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea7fa-8ab1-4b64-b753-8638922e6a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.877696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea7fa-8ab1-4b64-b753-8638922e6a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.877967 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea7fa-8ab1-4b64-b753-8638922e6a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.878632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ea7fa-8ab1-4b64-b753-8638922e6a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.880334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ea7fa-8ab1-4b64-b753-8638922e6a02 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.896611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 797/1603] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:38.896611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ea7fa-8ab1-4b64-b753-8638922e6a02 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.904888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ea7fa-8ab1-4b64-b753-8638922e6a02 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.910234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3cdab-416a-45cc-8a51-e2b3980fe3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.910915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3cdab-416a-45cc-8a51-e2b3980fe3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.911193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3cdab-416a-45cc-8a51-e2b3980fe3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.911464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3cdab-416a-45cc-8a51-e2b3980fe3f0 admin admin] PATH_INFO: `/v3/projects/469e0578aca44e278c68e772614ca1e9/users/42eb1f636e62490e905afa042dd4c2bf/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.915057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 807/1604] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:38.922684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720aa53-9bcf-4d14-8618-4dc3588aa3c7 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:38.929002 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720aa53-9bcf-4d14-8618-4dc3588aa3c7 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:38.932109 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3cdab-416a-45cc-8a51-e2b3980fe3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469e0578aca44e278c68e772614ca1e9, user_id=42eb1f636e62490e905afa042dd4c2bf, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.934932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3cdab-416a-45cc-8a51-e2b3980fe3f0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:38.935102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c16929-5924-4e9f-9b00-886f9b8a116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:38.935926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c16929-5924-4e9f-9b00-886f9b8a116f admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:38.936306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c16929-5924-4e9f-9b00-886f9b8a116f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:38.936692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c16929-5924-4e9f-9b00-886f9b8a116f admin admin] PATH_INFO: `/v3/projects/469be12962204784857322668505a18b/users/a0ad0c892c464a7ab40a683ca588963a/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:38.954490 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c16929-5924-4e9f-9b00-886f9b8a116f admin admin] RBAC: Authorizing `identity:create_grant(project_id=469be12962204784857322668505a18b, user_id=a0ad0c892c464a7ab40a683ca588963a, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:38.958011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c16929-5924-4e9f-9b00-886f9b8a116f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:39.003938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 798/1605] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:38 2022] PUT /identity/v3/projects/469e0578aca44e278c68e772614ca1e9/users/42eb1f636e62490e905afa042dd4c2bf/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:39.003938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3cdab-416a-45cc-8a51-e2b3980fe3f0 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:39.031243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 808/1606] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:38 2022] PUT /identity/v3/projects/469be12962204784857322668505a18b/users/a0ad0c892c464a7ab40a683ca588963a/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:39.032213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c16929-5924-4e9f-9b00-886f9b8a116f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:39.102531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3cdab-416a-45cc-8a51-e2b3980fe3f0 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:39.107250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2ce2e-4988-472b-ab42-d0ef8705d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:39.107923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2ce2e-4988-472b-ab42-d0ef8705d712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.108203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2ce2e-4988-472b-ab42-d0ef8705d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.108499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2ce2e-4988-472b-ab42-d0ef8705d712 admin admin] PATH_INFO: `/v3/projects/16c251eb5c6d424b96c53cf3ae3a4256/users/60efa77075d94402a0cb8e9e427772cc/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.110302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c16929-5924-4e9f-9b00-886f9b8a116f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:39.115685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3abb7c-d242-4ea5-ac34-f7862399f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:39.116390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3abb7c-d242-4ea5-ac34-f7862399f973 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.116673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3abb7c-d242-4ea5-ac34-f7862399f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.116945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3abb7c-d242-4ea5-ac34-f7862399f973 admin admin] PATH_INFO: `/v3/projects/220d1a241b9842d09eed73372999a5c2/users/9a395f2e142643d7a8a22adf7355f960/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.124607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2ce2e-4988-472b-ab42-d0ef8705d712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c251eb5c6d424b96c53cf3ae3a4256, user_id=60efa77075d94402a0cb8e9e427772cc, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:39.128435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2ce2e-4988-472b-ab42-d0ef8705d712 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:39.132521 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3abb7c-d242-4ea5-ac34-f7862399f973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220d1a241b9842d09eed73372999a5c2, user_id=9a395f2e142643d7a8a22adf7355f960, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:39.135191 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3abb7c-d242-4ea5-ac34-f7862399f973 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:39.237584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 799/1607] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:39 2022] PUT /identity/v3/projects/16c251eb5c6d424b96c53cf3ae3a4256/users/60efa77075d94402a0cb8e9e427772cc/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:39.242326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2ce2e-4988-472b-ab42-d0ef8705d712 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:39.265285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 809/1608] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:39 2022] PUT /identity/v3/projects/220d1a241b9842d09eed73372999a5c2/users/9a395f2e142643d7a8a22adf7355f960/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:39.267585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3abb7c-d242-4ea5-ac34-f7862399f973 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:39.304859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:39.351615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2ce2e-4988-472b-ab42-d0ef8705d712 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:39.361041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:39.371418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3abb7c-d242-4ea5-ac34-f7862399f973 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:39.381155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87f898-a8c1-469b-be3a-1f1f9df51bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:39.381897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f898-a8c1-469b-be3a-1f1f9df51bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.382241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f898-a8c1-469b-be3a-1f1f9df51bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.382592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f898-a8c1-469b-be3a-1f1f9df51bd5 admin admin] PATH_INFO: `/v3/projects/a607ed86a17a409797f0e22b3d919c43/users/9b22f661cc524dd2a58a499badb8e661/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.400761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87f898-a8c1-469b-be3a-1f1f9df51bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a607ed86a17a409797f0e22b3d919c43, user_id=9b22f661cc524dd2a58a499badb8e661, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:39.403652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87f898-a8c1-469b-be3a-1f1f9df51bd5 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:39.425364 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb96b4d-fd2e-4dc9-8dcf-d40098b4fc2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:39.426787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96b4d-fd2e-4dc9-8dcf-d40098b4fc2f service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.426787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96b4d-fd2e-4dc9-8dcf-d40098b4fc2f service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.426787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96b4d-fd2e-4dc9-8dcf-d40098b4fc2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.494297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb96b4d-fd2e-4dc9-8dcf-d40098b4fc2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:39.496021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb96b4d-fd2e-4dc9-8dcf-d40098b4fc2f service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:39.504363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 810/1609] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:39 2022] PUT /identity/v3/projects/a607ed86a17a409797f0e22b3d919c43/users/9b22f661cc524dd2a58a499badb8e661/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:39.504363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad30dd2-fd8f-4f49-b457-89ac17e088ef None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.504363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad30dd2-fd8f-4f49-b457-89ac17e088ef None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.504363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad30dd2-fd8f-4f49-b457-89ac17e088ef None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.505571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 811/1610] 10.222.0.20 () {54 vars in 962 bytes} [Wed Aug 24 17:16:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:16:39.506844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 800/1611] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:39.508098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a4959-abc8-4b58-9667-a91f7a0f4e7f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.508482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a4959-abc8-4b58-9667-a91f7a0f4e7f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.508760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a4959-abc8-4b58-9667-a91f7a0f4e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.519366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aae9e-e554-4431-82ef-05a7082f96af None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.519755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aae9e-e554-4431-82ef-05a7082f96af None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.519979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2aae9e-e554-4431-82ef-05a7082f96af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.530505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-3e2a4959-abc8-4b58-9667-a91f7a0f4e7f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:39.533170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3e2a4959-abc8-4b58-9667-a91f7a0f4e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:39.568902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-de2aae9e-e554-4431-82ef-05a7082f96af None None] MFA Rules not processed for user `42eb1f636e62490e905afa042dd4c2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:39.570330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-de2aae9e-e554-4431-82ef-05a7082f96af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:39.633528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 801/1612] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:39.635923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91e81-80a8-496d-b432-7e28ba4457b5 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.637254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91e81-80a8-496d-b432-7e28ba4457b5 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.637716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91e81-80a8-496d-b432-7e28ba4457b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.657421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 812/1613] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:39.659217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f2115-6bcb-43b1-b190-736364850559 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.659648 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f2115-6bcb-43b1-b190-736364850559 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.660026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f2115-6bcb-43b1-b190-736364850559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.667123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-cab91e81-80a8-496d-b432-7e28ba4457b5 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:39.669006 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-cab91e81-80a8-496d-b432-7e28ba4457b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:39.684835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 802/1614] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:39.685818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-192f2115-6bcb-43b1-b190-736364850559 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:39.686290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4ce8e-0df7-44eb-9726-06987110c78f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.686579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4ce8e-0df7-44eb-9726-06987110c78f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.686856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4ce8e-0df7-44eb-9726-06987110c78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.687391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-192f2115-6bcb-43b1-b190-736364850559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:39.698597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:39.707817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 813/1615] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:39.712417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692392a1-bfd2-4c4a-8dd9-344ce5fce98b None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.712417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692392a1-bfd2-4c4a-8dd9-344ce5fce98b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.712417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692392a1-bfd2-4c4a-8dd9-344ce5fce98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.714423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b1d4ce8e-0df7-44eb-9726-06987110c78f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:39.716199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b1d4ce8e-0df7-44eb-9726-06987110c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:39.729187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 803/1616] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:39.731310 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4ce8e-0df7-44eb-9726-06987110c78f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:39.732839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b1d4ce8e-0df7-44eb-9726-06987110c78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:39.760633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-692392a1-bfd2-4c4a-8dd9-344ce5fce98b None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:39.762676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-692392a1-bfd2-4c4a-8dd9-344ce5fce98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:39.814340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4ce8e-0df7-44eb-9726-06987110c78f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:39.819400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc54667-56f0-4bec-bab3-9dcd1fc40a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:39.820010 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc54667-56f0-4bec-bab3-9dcd1fc40a42 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.820318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc54667-56f0-4bec-bab3-9dcd1fc40a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.820595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc54667-56f0-4bec-bab3-9dcd1fc40a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.830407 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc54667-56f0-4bec-bab3-9dcd1fc40a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:39.832484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc54667-56f0-4bec-bab3-9dcd1fc40a42 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:39.837389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 814/1617] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Aug 24 17:16:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:39.838228 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692392a1-bfd2-4c4a-8dd9-344ce5fce98b None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:39.842812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 804/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:39.843795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc54667-56f0-4bec-bab3-9dcd1fc40a42 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:39.848755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692392a1-bfd2-4c4a-8dd9-344ce5fce98b None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:39.853630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc54667-56f0-4bec-bab3-9dcd1fc40a42 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:39.853782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238061e-c9a9-41ac-9dcf-0f7c91bb14fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:39.854320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238061e-c9a9-41ac-9dcf-0f7c91bb14fa admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.854661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238061e-c9a9-41ac-9dcf-0f7c91bb14fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.854866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238061e-c9a9-41ac-9dcf-0f7c91bb14fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.855634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238061e-c9a9-41ac-9dcf-0f7c91bb14fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:39.857586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238061e-c9a9-41ac-9dcf-0f7c91bb14fa admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:39.862776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b485e-7569-4167-9ef2-810a5be1c229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:39.863414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b485e-7569-4167-9ef2-810a5be1c229 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.863696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b485e-7569-4167-9ef2-810a5be1c229 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.863970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b485e-7569-4167-9ef2-810a5be1c229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.880929 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b485e-7569-4167-9ef2-810a5be1c229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:39.882287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b485e-7569-4167-9ef2-810a5be1c229 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:39.892516 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 805/1619] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:39.893563 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b485e-7569-4167-9ef2-810a5be1c229 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:39.902528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b485e-7569-4167-9ef2-810a5be1c229 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:39.906177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbd561-c7a8-4062-9b4a-ca7bdab6f8fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:39.906856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbd561-c7a8-4062-9b4a-ca7bdab6f8fd service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.907141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbd561-c7a8-4062-9b4a-ca7bdab6f8fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.907415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbd561-c7a8-4062-9b4a-ca7bdab6f8fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.917340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbd561-c7a8-4062-9b4a-ca7bdab6f8fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:39.918896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbd561-c7a8-4062-9b4a-ca7bdab6f8fd service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:39.935046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 806/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:39.935983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbd561-c7a8-4062-9b4a-ca7bdab6f8fd service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:39.954774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbd561-c7a8-4062-9b4a-ca7bdab6f8fd service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:39.959182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a63ad-ac5f-46e0-a5f7-2f1de0a00c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:39.959972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a63ad-ac5f-46e0-a5f7-2f1de0a00c42 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.960308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a63ad-ac5f-46e0-a5f7-2f1de0a00c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.960593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a63ad-ac5f-46e0-a5f7-2f1de0a00c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.976143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a63ad-ac5f-46e0-a5f7-2f1de0a00c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:39.982578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 815/1621] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:39 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:39.982578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2988-d941-4391-8697-22482e707411 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:39.982578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2988-d941-4391-8697-22482e707411 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:39.982977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f2988-d941-4391-8697-22482e707411 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:39.985337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a63ad-ac5f-46e0-a5f7-2f1de0a00c42 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:39.987901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 816/1622] 10.222.0.20 () {54 vars in 912 bytes} [Wed Aug 24 17:16:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:16:39.989017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f2988-d941-4391-8697-22482e707411 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:40.007139 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 807/1623] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:40.012440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a63ad-ac5f-46e0-a5f7-2f1de0a00c42 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:40.031732 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a63ad-ac5f-46e0-a5f7-2f1de0a00c42 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:40.041019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:40.119974 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f2988-d941-4391-8697-22482e707411 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:40.125091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec3768-eedd-4d1c-983b-011274e5135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:40.126419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec3768-eedd-4d1c-983b-011274e5135b admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.133523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec3768-eedd-4d1c-983b-011274e5135b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.133679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6e1b-715e-4810-b978-059409ae5034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:40.133935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec3768-eedd-4d1c-983b-011274e5135b admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.133935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec3768-eedd-4d1c-983b-011274e5135b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:40.134124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6e1b-715e-4810-b978-059409ae5034 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.134124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6e1b-715e-4810-b978-059409ae5034 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.134124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6e1b-715e-4810-b978-059409ae5034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.134378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec3768-eedd-4d1c-983b-011274e5135b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:40.199676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6e1b-715e-4810-b978-059409ae5034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:40.201339 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6e1b-715e-4810-b978-059409ae5034 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:40.211677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 817/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:40.213162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3171-a202-4ec0-a05b-1741717a71e9 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.213450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3171-a202-4ec0-a05b-1741717a71e9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.213729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3171-a202-4ec0-a05b-1741717a71e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.250441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-1fae3171-a202-4ec0-a05b-1741717a71e9 None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:40.253053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1fae3171-a202-4ec0-a05b-1741717a71e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:40.269229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 818/1625] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:16:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:40.291691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 808/1626] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:40 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:40.292441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae3171-a202-4ec0-a05b-1741717a71e9 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:40.292558 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec3768-eedd-4d1c-983b-011274e5135b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:40.316549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae3171-a202-4ec0-a05b-1741717a71e9 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:40.324218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da0cc3-7602-477d-b554-8c66590395d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:40.325008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da0cc3-7602-477d-b554-8c66590395d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.325331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da0cc3-7602-477d-b554-8c66590395d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.325950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da0cc3-7602-477d-b554-8c66590395d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.327470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da0cc3-7602-477d-b554-8c66590395d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:40.329264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da0cc3-7602-477d-b554-8c66590395d9 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:40.348058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 819/1627] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:40.353389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da0cc3-7602-477d-b554-8c66590395d9 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:40.371574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da0cc3-7602-477d-b554-8c66590395d9 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:40.379791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f4e1a-fe1f-48b3-a811-72a37ef0b2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:40.380741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f4e1a-fe1f-48b3-a811-72a37ef0b2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.381088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f4e1a-fe1f-48b3-a811-72a37ef0b2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.381591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f4e1a-fe1f-48b3-a811-72a37ef0b2b7 admin admin] PATH_INFO: `/v3/projects/641fff9658c34229b258bf7ea6bd8f41/users/38a761838a7f47d1a75ff465a17f1995/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.406285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:40.406285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec3768-eedd-4d1c-983b-011274e5135b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:40.417947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d63b1-12d8-4583-89f1-44da56cf9306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:40.418589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d63b1-12d8-4583-89f1-44da56cf9306 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.418874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d63b1-12d8-4583-89f1-44da56cf9306 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.419150 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d63b1-12d8-4583-89f1-44da56cf9306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.422874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f4e1a-fe1f-48b3-a811-72a37ef0b2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=641fff9658c34229b258bf7ea6bd8f41, user_id=38a761838a7f47d1a75ff465a17f1995, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:40.429044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f4e1a-fe1f-48b3-a811-72a37ef0b2b7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:40.444184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d63b1-12d8-4583-89f1-44da56cf9306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:40.446010 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d63b1-12d8-4583-89f1-44da56cf9306 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:40.466557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 809/1628] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:40.551153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a188be-dc84-4da4-9623-3d1611126ee0 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.551477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a188be-dc84-4da4-9623-3d1611126ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.551728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a188be-dc84-4da4-9623-3d1611126ee0 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.553312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 810/1629] 10.222.0.20 () {54 vars in 912 bytes} [Wed Aug 24 17:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:16:40.559087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a0f2-8f86-4d82-87b4-71aab97fde56 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.559378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a0f2-8f86-4d82-87b4-71aab97fde56 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.559642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a0f2-8f86-4d82-87b4-71aab97fde56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.597347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 820/1630] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:40 2022] PUT /identity/v3/projects/641fff9658c34229b258bf7ea6bd8f41/users/38a761838a7f47d1a75ff465a17f1995/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:40.599362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f4e1a-fe1f-48b3-a811-72a37ef0b2b7 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:40.609174 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1304a0f2-8f86-4d82-87b4-71aab97fde56 None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:40.610455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1304a0f2-8f86-4d82-87b4-71aab97fde56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:40.708195 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f4e1a-fe1f-48b3-a811-72a37ef0b2b7 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:40.716036 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de80e-05c4-4a1f-9dc9-19acef1df235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:40.718549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de80e-05c4-4a1f-9dc9-19acef1df235 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.718549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de80e-05c4-4a1f-9dc9-19acef1df235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.718549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494de80e-05c4-4a1f-9dc9-19acef1df235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.719111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494de80e-05c4-4a1f-9dc9-19acef1df235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:40.720837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494de80e-05c4-4a1f-9dc9-19acef1df235 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:40.741059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 821/1631] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:40.742440 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de80e-05c4-4a1f-9dc9-19acef1df235 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:40.758008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494de80e-05c4-4a1f-9dc9-19acef1df235 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:40.764668 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec696b1a-bf26-4a90-8d5e-19e94dd2223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:40.765442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec696b1a-bf26-4a90-8d5e-19e94dd2223d admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.765725 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec696b1a-bf26-4a90-8d5e-19e94dd2223d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.766411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec696b1a-bf26-4a90-8d5e-19e94dd2223d admin admin] PATH_INFO: `/v3/projects/641fff9658c34229b258bf7ea6bd8f41/users/38a761838a7f47d1a75ff465a17f1995/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.770592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec696b1a-bf26-4a90-8d5e-19e94dd2223d admin admin] RBAC: Authorizing `identity:create_grant(project_id=641fff9658c34229b258bf7ea6bd8f41, user_id=38a761838a7f47d1a75ff465a17f1995, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:40.777038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec696b1a-bf26-4a90-8d5e-19e94dd2223d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:40.791226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 811/1632] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:16:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:16:40.808209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a0f2-8f86-4d82-87b4-71aab97fde56 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:40.824027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 822/1633] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:40 2022] PUT /identity/v3/projects/641fff9658c34229b258bf7ea6bd8f41/users/38a761838a7f47d1a75ff465a17f1995/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:40.830906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2091b97-71d9-4673-8702-b6f9233af114 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.830906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2091b97-71d9-4673-8702-b6f9233af114 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.830906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2091b97-71d9-4673-8702-b6f9233af114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.868615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:40.888282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-f2091b97-71d9-4673-8702-b6f9233af114 None None] MFA Rules not processed for user `38a761838a7f47d1a75ff465a17f1995`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:40.889980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f2091b97-71d9-4673-8702-b6f9233af114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:40.923512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a0f2-8f86-4d82-87b4-71aab97fde56 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:40.996165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438063db-7669-48f0-8f81-45b01c2f414b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:40.997060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438063db-7669-48f0-8f81-45b01c2f414b service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.997459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438063db-7669-48f0-8f81-45b01c2f414b service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.997914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438063db-7669-48f0-8f81-45b01c2f414b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:41.046395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 823/1634] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:41.106753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:41.132750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438063db-7669-48f0-8f81-45b01c2f414b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:41.134934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438063db-7669-48f0-8f81-45b01c2f414b service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:41.184427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 812/1635] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:41.816539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2091b97-71d9-4673-8702-b6f9233af114 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:41.816539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2091b97-71d9-4673-8702-b6f9233af114 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:41.816539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c214bb4-b655-4b3c-8ee7-d3bb94485c72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:41.816539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214bb4-b655-4b3c-8ee7-d3bb94485c72 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:41.823834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214bb4-b655-4b3c-8ee7-d3bb94485c72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:41.823834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c214bb4-b655-4b3c-8ee7-d3bb94485c72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:41.823834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c214bb4-b655-4b3c-8ee7-d3bb94485c72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:41.823834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c214bb4-b655-4b3c-8ee7-d3bb94485c72 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:41.823834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 824/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:41.957546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438063db-7669-48f0-8f81-45b01c2f414b service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:42.010226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c214bb4-b655-4b3c-8ee7-d3bb94485c72 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:42.025274 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c214bb4-b655-4b3c-8ee7-d3bb94485c72 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:42.037897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4476e82-8587-473c-ab43-21e2e96b7c2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:42.058356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4476e82-8587-473c-ab43-21e2e96b7c2f service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:42.058356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4476e82-8587-473c-ab43-21e2e96b7c2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:42.058356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4476e82-8587-473c-ab43-21e2e96b7c2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:42.085722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438063db-7669-48f0-8f81-45b01c2f414b service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:42.094539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:42.095430 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:42.095541 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:42.095736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] PATH_INFO: `/v3/users/4c65575beb3549889b00102f95780716` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:42.097227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c65575beb3549889b00102f95780716)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:42.098659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: WARNING py.warnings [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:16:42.098659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: warnings.warn(msg) Aug 24 17:16:42.098659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: Aug 24 17:16:42.101348 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:42.147030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4476e82-8587-473c-ab43-21e2e96b7c2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:42.149167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4476e82-8587-473c-ab43-21e2e96b7c2f service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:42.177109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 825/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:42.433960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c65575beb3549889b00102f95780716'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:42.435381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c65575beb3549889b00102f95780716'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:42.436291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c65575beb3549889b00102f95780716'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:42.509034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c65575beb3549889b00102f95780716'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:42.592535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c65575beb3549889b00102f95780716'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:42.661399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 813/1638] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:16:41 2022] DELETE /identity/v3/users/4c65575beb3549889b00102f95780716 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:42.666330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9493d-6b97-4cc0-a275-e6a3f510d6a7 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:42.666630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9493d-6b97-4cc0-a275-e6a3f510d6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:42.667438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9493d-6b97-4cc0-a275-e6a3f510d6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:42.706802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-cef9493d-6b97-4cc0-a275-e6a3f510d6a7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:42.716415 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-cef9493d-6b97-4cc0-a275-e6a3f510d6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:42.849664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 826/1639] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:42.890099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:42.894861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:43.000184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561da09-6e1b-47e4-b370-f8cb7c441bc2 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:43.021395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb6451-60e9-4578-9510-6ead79523592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:43.022679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6451-60e9-4578-9510-6ead79523592 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:43.022989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6451-60e9-4578-9510-6ead79523592 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:43.024058 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6451-60e9-4578-9510-6ead79523592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:43.038957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb6451-60e9-4578-9510-6ead79523592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:43.041923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb6451-60e9-4578-9510-6ead79523592 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:43.058913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 814/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:44.502511 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9493d-6b97-4cc0-a275-e6a3f510d6a7 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:44.502511 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-cef9493d-6b97-4cc0-a275-e6a3f510d6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:44.528118 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9493d-6b97-4cc0-a275-e6a3f510d6a7 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:44.546825 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:44.548178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:44.549407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:44.551165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] PATH_INFO: `/v3/projects/b1d209138fbe471593b9b7957de49963` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:44.565998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1d209138fbe471593b9b7957de49963)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:44.567376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: WARNING py.warnings [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:16:44.567376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: warnings.warn(msg) Aug 24 17:16:44.567376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: Aug 24 17:16:44.568973 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:44.602381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:44.853043 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d209138fbe471593b9b7957de49963', 'request_id': 'req-79122288-e2e9-4eab-8650-082b9bcd1510'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:44.961168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d209138fbe471593b9b7957de49963', 'request_id': 'req-79122288-e2e9-4eab-8650-082b9bcd1510'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:45.003418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d209138fbe471593b9b7957de49963', 'request_id': 'req-79122288-e2e9-4eab-8650-082b9bcd1510'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:45.042449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] The token cache is being invalidate because project b1d209138fbe471593b9b7957de49963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:16:45.043747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:45.045532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:45.050831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 827/1641] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:16:44 2022] DELETE /identity/v3/projects/b1d209138fbe471593b9b7957de49963 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:45.057944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095dbc3-0f76-4a3e-a589-fe89b89a18f0 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:45.059993 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095dbc3-0f76-4a3e-a589-fe89b89a18f0 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:45.061209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095dbc3-0f76-4a3e-a589-fe89b89a18f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:45.079272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:45.129816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-7095dbc3-0f76-4a3e-a589-fe89b89a18f0 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:45.132509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7095dbc3-0f76-4a3e-a589-fe89b89a18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:45.153156 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:45.161664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:45.352596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79122288-e2e9-4eab-8650-082b9bcd1510 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:45.360652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 815/1642] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:45.365654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e7011-172a-4ba3-9beb-1b593e371b4e None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:45.365920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e7011-172a-4ba3-9beb-1b593e371b4e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:45.366200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e7011-172a-4ba3-9beb-1b593e371b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:45.366783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ef329-30c3-45e2-9378-3a5b09e372cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:45.367455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ef329-30c3-45e2-9378-3a5b09e372cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:45.367785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ef329-30c3-45e2-9378-3a5b09e372cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:45.368065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ef329-30c3-45e2-9378-3a5b09e372cb admin admin] PATH_INFO: `/v3/users/faa05352b7c54c6a88b88a6ce9613aa0` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:45.376582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ef329-30c3-45e2-9378-3a5b09e372cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa05352b7c54c6a88b88a6ce9613aa0)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:45.379049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ef329-30c3-45e2-9378-3a5b09e372cb admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:45.411755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ff9e7011-172a-4ba3-9beb-1b593e371b4e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:45.413230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ff9e7011-172a-4ba3-9beb-1b593e371b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:45.442660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 816/1643] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:16:45.450001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e7011-172a-4ba3-9beb-1b593e371b4e None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:45.476291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e7011-172a-4ba3-9beb-1b593e371b4e None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:45.489953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61f23c-e47c-45c8-a530-533d2825bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:45.491158 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61f23c-e47c-45c8-a530-533d2825bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:45.496727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61f23c-e47c-45c8-a530-533d2825bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:45.497001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61f23c-e47c-45c8-a530-533d2825bb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:45.498027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61f23c-e47c-45c8-a530-533d2825bb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:45.499294 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61f23c-e47c-45c8-a530-533d2825bb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:45.501378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61f23c-e47c-45c8-a530-533d2825bb49 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:45.559635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 817/1644] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:45.565689 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61f23c-e47c-45c8-a530-533d2825bb49 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:45.588031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61f23c-e47c-45c8-a530-533d2825bb49 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:45.590358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aebdc1-6e5b-443f-a66c-f66fd1d3d517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:45.591988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aebdc1-6e5b-443f-a66c-f66fd1d3d517 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:45.592487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aebdc1-6e5b-443f-a66c-f66fd1d3d517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:45.593069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aebdc1-6e5b-443f-a66c-f66fd1d3d517 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:45.594006 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aebdc1-6e5b-443f-a66c-f66fd1d3d517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:45.597258 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aebdc1-6e5b-443f-a66c-f66fd1d3d517 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:45.772292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4a9ef329-30c3-45e2-9378-3a5b09e372cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa05352b7c54c6a88b88a6ce9613aa0'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:45.777268 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4a9ef329-30c3-45e2-9378-3a5b09e372cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa05352b7c54c6a88b88a6ce9613aa0'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:45.793495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4a9ef329-30c3-45e2-9378-3a5b09e372cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa05352b7c54c6a88b88a6ce9613aa0'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:45.794555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4a9ef329-30c3-45e2-9378-3a5b09e372cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa05352b7c54c6a88b88a6ce9613aa0'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:45.800443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 818/1645] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:45 2022] POST /identity/v3/projects => generated 389 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:45.801614 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aebdc1-6e5b-443f-a66c-f66fd1d3d517 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:45.810691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-93aebdc1-6e5b-443f-a66c-f66fd1d3d517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:45.825712 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4a9ef329-30c3-45e2-9378-3a5b09e372cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa05352b7c54c6a88b88a6ce9613aa0'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:45.967464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 828/1646] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:16:45 2022] DELETE /identity/v3/users/faa05352b7c54c6a88b88a6ce9613aa0 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:45.974420 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb1fd-841c-49ed-b0ed-186759a3463e None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:45.975401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb1fd-841c-49ed-b0ed-186759a3463e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:45.976129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cb1fd-841c-49ed-b0ed-186759a3463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:45.992356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aebdc1-6e5b-443f-a66c-f66fd1d3d517 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:46.022600 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-330cb1fd-841c-49ed-b0ed-186759a3463e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:46.025771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-330cb1fd-841c-49ed-b0ed-186759a3463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:46.073886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:46.118211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1576c-49da-4a9b-9505-2ef4b2bd3f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:46.121399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1576c-49da-4a9b-9505-2ef4b2bd3f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:46.121840 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1576c-49da-4a9b-9505-2ef4b2bd3f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:46.122227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1576c-49da-4a9b-9505-2ef4b2bd3f9d admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:46.123920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1576c-49da-4a9b-9505-2ef4b2bd3f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:46.131354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1576c-49da-4a9b-9505-2ef4b2bd3f9d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:46.176164 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 829/1647] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:16:46.201706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cb1fd-841c-49ed-b0ed-186759a3463e None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:46.203239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-330cb1fd-841c-49ed-b0ed-186759a3463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:46.271392 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 819/1648] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:45 2022] POST /identity/v3/users => generated 295 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:46.274012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1576c-49da-4a9b-9505-2ef4b2bd3f9d admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:46.291204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1576c-49da-4a9b-9505-2ef4b2bd3f9d admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:46.306872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f2d47-5d25-42b6-9b9a-a8a5d0351a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:46.307505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2d47-5d25-42b6-9b9a-a8a5d0351a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:46.307786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2d47-5d25-42b6-9b9a-a8a5d0351a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:46.308067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f2d47-5d25-42b6-9b9a-a8a5d0351a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:46.308781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f2d47-5d25-42b6-9b9a-a8a5d0351a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:46.310434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f2d47-5d25-42b6-9b9a-a8a5d0351a1e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:46.337928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 820/1649] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:46.338911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f2d47-5d25-42b6-9b9a-a8a5d0351a1e admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:46.342056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cb1fd-841c-49ed-b0ed-186759a3463e None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:46.350952 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d066bb-5b44-4198-aab7-9b65e022ac00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:46.351438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d066bb-5b44-4198-aab7-9b65e022ac00 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:46.351724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d066bb-5b44-4198-aab7-9b65e022ac00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:46.352004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d066bb-5b44-4198-aab7-9b65e022ac00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:46.364557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f2d47-5d25-42b6-9b9a-a8a5d0351a1e admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:46.368884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d066bb-5b44-4198-aab7-9b65e022ac00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:46.370355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d066bb-5b44-4198-aab7-9b65e022ac00 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:46.381274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4401e4-03e7-4870-ab42-e966e43d22bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:46.383281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4401e4-03e7-4870-ab42-e966e43d22bc admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:46.383281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4401e4-03e7-4870-ab42-e966e43d22bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:46.383281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4401e4-03e7-4870-ab42-e966e43d22bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:46.383620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4401e4-03e7-4870-ab42-e966e43d22bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:46.396093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4401e4-03e7-4870-ab42-e966e43d22bc admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:46.412807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 830/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:46.421753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d066bb-5b44-4198-aab7-9b65e022ac00 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:46.427307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 821/1651] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:46.432421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d066bb-5b44-4198-aab7-9b65e022ac00 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:46.438256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badd36f-ad1c-4c59-b443-f2a9aee35800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:46.439045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badd36f-ad1c-4c59-b443-f2a9aee35800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:46.439332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badd36f-ad1c-4c59-b443-f2a9aee35800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:46.440525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badd36f-ad1c-4c59-b443-f2a9aee35800 admin admin] PATH_INFO: `/v3/projects/ff0c3d207b764399b9c82493acb4ca0b/users/1db46773040a4ae899230ac36b1ea299/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:46.463845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badd36f-ad1c-4c59-b443-f2a9aee35800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0c3d207b764399b9c82493acb4ca0b, user_id=1db46773040a4ae899230ac36b1ea299, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:46.467422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badd36f-ad1c-4c59-b443-f2a9aee35800 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:46.569464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 831/1652] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:46 2022] PUT /identity/v3/projects/ff0c3d207b764399b9c82493acb4ca0b/users/1db46773040a4ae899230ac36b1ea299/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:46.580882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e9f7a-da72-4de0-b4ba-f968f375f306 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:46.581277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e9f7a-da72-4de0-b4ba-f968f375f306 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:46.584790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e9f7a-da72-4de0-b4ba-f968f375f306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:46.665700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-2d9e9f7a-da72-4de0-b4ba-f968f375f306 None None] MFA Rules not processed for user `1db46773040a4ae899230ac36b1ea299`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:46.667065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2d9e9f7a-da72-4de0-b4ba-f968f375f306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:46.855866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badd36f-ad1c-4c59-b443-f2a9aee35800 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:46.860610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 822/1653] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:47.069957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badd36f-ad1c-4c59-b443-f2a9aee35800 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:47.084120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e0b03-2430-4414-9c35-6b70b5f806ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:47.085016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e0b03-2430-4414-9c35-6b70b5f806ce admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:47.085297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e0b03-2430-4414-9c35-6b70b5f806ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:47.085571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e0b03-2430-4414-9c35-6b70b5f806ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:47.086239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e0b03-2430-4414-9c35-6b70b5f806ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:47.088217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e0b03-2430-4414-9c35-6b70b5f806ce admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:47.231075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 832/1654] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:46 2022] POST /identity/v3/projects => generated 389 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:47.235286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e9f7a-da72-4de0-b4ba-f968f375f306 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:47.258381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e9f7a-da72-4de0-b4ba-f968f375f306 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:47.328594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef9bfe-59d9-403f-9c65-c60daaeb17c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:47.329237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9bfe-59d9-403f-9c65-c60daaeb17c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:47.329523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9bfe-59d9-403f-9c65-c60daaeb17c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:47.329802 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef9bfe-59d9-403f-9c65-c60daaeb17c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:47.330817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef9bfe-59d9-403f-9c65-c60daaeb17c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:47.333344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef9bfe-59d9-403f-9c65-c60daaeb17c0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:47.503706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e0b03-2430-4414-9c35-6b70b5f806ce admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:47.505510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 823/1655] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:47 2022] POST /identity/v3/users => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:16:47.515061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e0b03-2430-4414-9c35-6b70b5f806ce admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:47.529043 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877187e3-4180-45a0-8ba2-b33b49913a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:47.530246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877187e3-4180-45a0-8ba2-b33b49913a71 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:47.530534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877187e3-4180-45a0-8ba2-b33b49913a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:47.530983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877187e3-4180-45a0-8ba2-b33b49913a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:47.534900 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877187e3-4180-45a0-8ba2-b33b49913a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:47.536953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877187e3-4180-45a0-8ba2-b33b49913a71 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:47.566199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:47.574588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 833/1656] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:47.575098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef9bfe-59d9-403f-9c65-c60daaeb17c0 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:47.590426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef9bfe-59d9-403f-9c65-c60daaeb17c0 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:47.603815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec2ad2-f94d-46df-bf9b-1896a7bb2841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:47.604624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec2ad2-f94d-46df-bf9b-1896a7bb2841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:47.604862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec2ad2-f94d-46df-bf9b-1896a7bb2841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:47.608687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec2ad2-f94d-46df-bf9b-1896a7bb2841 admin admin] PATH_INFO: `/v3/projects/e9875c76ceb34e19ad776e696870c3eb/users/c8b4f897aa9a4595a35ab070a4d0c519/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:47.651394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec2ad2-f94d-46df-bf9b-1896a7bb2841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9875c76ceb34e19ad776e696870c3eb, user_id=c8b4f897aa9a4595a35ab070a4d0c519, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:47.657768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec2ad2-f94d-46df-bf9b-1896a7bb2841 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:47.768581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 824/1657] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:47 2022] PUT /identity/v3/projects/e9875c76ceb34e19ad776e696870c3eb/users/c8b4f897aa9a4595a35ab070a4d0c519/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:47.777977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877187e3-4180-45a0-8ba2-b33b49913a71 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:47.809764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877187e3-4180-45a0-8ba2-b33b49913a71 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:47.853630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:48.009803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d6576-6542-4cdd-8aff-4966fc654346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:48.010528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d6576-6542-4cdd-8aff-4966fc654346 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:48.010791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d6576-6542-4cdd-8aff-4966fc654346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:48.011012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d6576-6542-4cdd-8aff-4966fc654346 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:48.011688 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d6576-6542-4cdd-8aff-4966fc654346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:48.013473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d6576-6542-4cdd-8aff-4966fc654346 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:48.047625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 834/1658] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:48.050243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec2ad2-f94d-46df-bf9b-1896a7bb2841 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:48.076021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec2ad2-f94d-46df-bf9b-1896a7bb2841 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:48.085383 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6efbfb-7b62-4147-a600-5a0ca9615760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:48.086356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6efbfb-7b62-4147-a600-5a0ca9615760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:48.087133 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6efbfb-7b62-4147-a600-5a0ca9615760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:48.088386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6efbfb-7b62-4147-a600-5a0ca9615760 admin admin] PATH_INFO: `/v3/projects/e9875c76ceb34e19ad776e696870c3eb/users/c8b4f897aa9a4595a35ab070a4d0c519/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:48.102726 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6efbfb-7b62-4147-a600-5a0ca9615760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9875c76ceb34e19ad776e696870c3eb, user_id=c8b4f897aa9a4595a35ab070a4d0c519, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:48.107083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6efbfb-7b62-4147-a600-5a0ca9615760 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:48.145208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd420-6955-4210-98f9-b48bb8332968 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:48.145634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd420-6955-4210-98f9-b48bb8332968 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:48.145634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd420-6955-4210-98f9-b48bb8332968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:48.159571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 825/1659] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:48 2022] PUT /identity/v3/projects/e9875c76ceb34e19ad776e696870c3eb/users/c8b4f897aa9a4595a35ab070a4d0c519/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:48.223570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-998bd420-6955-4210-98f9-b48bb8332968 None None] MFA Rules not processed for user `c8b4f897aa9a4595a35ab070a4d0c519`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:48.225803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-998bd420-6955-4210-98f9-b48bb8332968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:48.461272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 835/1660] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:48 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:48.473568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6efbfb-7b62-4147-a600-5a0ca9615760 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:48.477648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5e6efbfb-7b62-4147-a600-5a0ca9615760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:48.546853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:48.578141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd420-6955-4210-98f9-b48bb8332968 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:48.579760 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-998bd420-6955-4210-98f9-b48bb8332968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:48.628498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6efbfb-7b62-4147-a600-5a0ca9615760 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:48.634561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec7dcc-8ca8-478c-bae8-b4b2672b1471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:48.635870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec7dcc-8ca8-478c-bae8-b4b2672b1471 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:48.636371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec7dcc-8ca8-478c-bae8-b4b2672b1471 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:48.637617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec7dcc-8ca8-478c-bae8-b4b2672b1471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:48.662352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec7dcc-8ca8-478c-bae8-b4b2672b1471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:48.667037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec7dcc-8ca8-478c-bae8-b4b2672b1471 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:48.713514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 826/1661] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:48 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:16:48.765127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd420-6955-4210-98f9-b48bb8332968 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:48.781363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:48.782392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:48.782392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:48.782650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] PATH_INFO: `/v3/projects/8dff65fdd6d24ddd943c7f120449d917` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:48.785275 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dff65fdd6d24ddd943c7f120449d917)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:48.787373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:49.007499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:49.031077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dff65fdd6d24ddd943c7f120449d917', 'request_id': 'req-d33a477b-0d30-4f52-a662-7cc81b2b70e2'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:49.188261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dff65fdd6d24ddd943c7f120449d917', 'request_id': 'req-d33a477b-0d30-4f52-a662-7cc81b2b70e2'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:49.209635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dff65fdd6d24ddd943c7f120449d917', 'request_id': 'req-d33a477b-0d30-4f52-a662-7cc81b2b70e2'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:49.274966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] The token cache is being invalidate because project 8dff65fdd6d24ddd943c7f120449d917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:16:49.275265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:49.283978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d33a477b-0d30-4f52-a662-7cc81b2b70e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:49.288787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 836/1662] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:16:48 2022] DELETE /identity/v3/projects/8dff65fdd6d24ddd943c7f120449d917 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:49.300819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f4fdf-e34a-43a6-b8f6-4e58eb277017 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:49.301298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f4fdf-e34a-43a6-b8f6-4e58eb277017 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:49.301625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f4fdf-e34a-43a6-b8f6-4e58eb277017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:49.374155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b82f4fdf-e34a-43a6-b8f6-4e58eb277017 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:49.375422 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b82f4fdf-e34a-43a6-b8f6-4e58eb277017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:49.553698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 827/1663] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:49.556957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90211-f895-401b-8097-505406c21368 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:49.557646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90211-f895-401b-8097-505406c21368 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:49.558189 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d90211-f895-401b-8097-505406c21368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:49.619021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f4fdf-e34a-43a6-b8f6-4e58eb277017 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:49.621190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b82f4fdf-e34a-43a6-b8f6-4e58eb277017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:49.627013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-73d90211-f895-401b-8097-505406c21368 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:49.632133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-73d90211-f895-401b-8097-505406c21368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:49.655740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f4fdf-e34a-43a6-b8f6-4e58eb277017 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:49.663045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 837/1664] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:49.666131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d90211-f895-401b-8097-505406c21368 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:49.686610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be759b2b-60e7-490a-af86-565a121dd4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:49.686610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be759b2b-60e7-490a-af86-565a121dd4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:49.686610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be759b2b-60e7-490a-af86-565a121dd4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:49.686610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be759b2b-60e7-490a-af86-565a121dd4ba admin admin] PATH_INFO: `/v3/users/1db46773040a4ae899230ac36b1ea299` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:49.691186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be759b2b-60e7-490a-af86-565a121dd4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db46773040a4ae899230ac36b1ea299)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:49.695542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be759b2b-60e7-490a-af86-565a121dd4ba admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:49.700753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d90211-f895-401b-8097-505406c21368 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:49.721525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3ce7-e0a0-4065-8afb-0d0824a2b197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:49.722510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3ce7-e0a0-4065-8afb-0d0824a2b197 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:49.722943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3ce7-e0a0-4065-8afb-0d0824a2b197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:49.723376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d3ce7-e0a0-4065-8afb-0d0824a2b197 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:49.724778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3ce7-e0a0-4065-8afb-0d0824a2b197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:49.725246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3ce7-e0a0-4065-8afb-0d0824a2b197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:49.727053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d3ce7-e0a0-4065-8afb-0d0824a2b197 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:49.756014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 838/1665] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:49.765553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3ce7-e0a0-4065-8afb-0d0824a2b197 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:49.796585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d3ce7-e0a0-4065-8afb-0d0824a2b197 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:49.811235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c7765-1b6b-48b1-a547-17beecfdbac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:49.811964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c7765-1b6b-48b1-a547-17beecfdbac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:49.812641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c7765-1b6b-48b1-a547-17beecfdbac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:49.814740 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c7765-1b6b-48b1-a547-17beecfdbac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:49.818203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c7765-1b6b-48b1-a547-17beecfdbac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:49.822814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c7765-1b6b-48b1-a547-17beecfdbac6 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:49.995236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 839/1666] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:49 2022] POST /identity/v3/projects => generated 367 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:50.006545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c7765-1b6b-48b1-a547-17beecfdbac6 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:50.165529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-be759b2b-60e7-490a-af86-565a121dd4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db46773040a4ae899230ac36b1ea299'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:50.165529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-be759b2b-60e7-490a-af86-565a121dd4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db46773040a4ae899230ac36b1ea299'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:50.165529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-be759b2b-60e7-490a-af86-565a121dd4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db46773040a4ae899230ac36b1ea299'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:50.206884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-be759b2b-60e7-490a-af86-565a121dd4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db46773040a4ae899230ac36b1ea299'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:50.224972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c7765-1b6b-48b1-a547-17beecfdbac6 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:50.237293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2262d10-f181-4bc8-a414-410de8b99b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:50.237979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262d10-f181-4bc8-a414-410de8b99b55 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:50.238257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262d10-f181-4bc8-a414-410de8b99b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:50.240703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2262d10-f181-4bc8-a414-410de8b99b55 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:50.244039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2262d10-f181-4bc8-a414-410de8b99b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:50.245195 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2262d10-f181-4bc8-a414-410de8b99b55 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:50.332147 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-be759b2b-60e7-490a-af86-565a121dd4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db46773040a4ae899230ac36b1ea299'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:50.370862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 840/1667] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:49 2022] POST /identity/v3/users => generated 284 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:50.371872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2262d10-f181-4bc8-a414-410de8b99b55 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:50.376474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e2262d10-f181-4bc8-a414-410de8b99b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:50.377618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 828/1668] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:16:49 2022] DELETE /identity/v3/users/1db46773040a4ae899230ac36b1ea299 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:50.379663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aac0c-434a-412d-bb6f-f6087d35a6cb None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:50.380255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aac0c-434a-412d-bb6f-f6087d35a6cb None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:50.380780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52aac0c-434a-412d-bb6f-f6087d35a6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:50.418948 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2262d10-f181-4bc8-a414-410de8b99b55 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:50.432594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-d52aac0c-434a-412d-bb6f-f6087d35a6cb None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:50.435022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d52aac0c-434a-412d-bb6f-f6087d35a6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:50.535711 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:50.619272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 829/1669] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:50.638536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4a63-3446-4aad-bc8e-166c5f3abd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:50.639687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4a63-3446-4aad-bc8e-166c5f3abd23 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:50.640076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4a63-3446-4aad-bc8e-166c5f3abd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:50.640522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b4a63-3446-4aad-bc8e-166c5f3abd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:50.642143 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b4a63-3446-4aad-bc8e-166c5f3abd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:50.647561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b4a63-3446-4aad-bc8e-166c5f3abd23 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:50.676583 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 841/1670] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:50.680103 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aac0c-434a-412d-bb6f-f6087d35a6cb None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:50.692130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52aac0c-434a-412d-bb6f-f6087d35a6cb None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:50.699177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4a63-3446-4aad-bc8e-166c5f3abd23 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:50.702212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0e8b4a63-3446-4aad-bc8e-166c5f3abd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:50.712755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78e73b-8d08-4f5c-a465-727f6f1d1ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:50.714193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78e73b-8d08-4f5c-a465-727f6f1d1ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:50.715245 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78e73b-8d08-4f5c-a465-727f6f1d1ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:50.715530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78e73b-8d08-4f5c-a465-727f6f1d1ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:50.717049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78e73b-8d08-4f5c-a465-727f6f1d1ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:50.722797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78e73b-8d08-4f5c-a465-727f6f1d1ec7 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:50.743836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:50.754019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 830/1671] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:50.761424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78e73b-8d08-4f5c-a465-727f6f1d1ec7 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:50.781999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78e73b-8d08-4f5c-a465-727f6f1d1ec7 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:50.794224 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e19e8-4af6-4144-84bb-59a66889c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:50.795266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e19e8-4af6-4144-84bb-59a66889c3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:50.795712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e19e8-4af6-4144-84bb-59a66889c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:50.796319 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e19e8-4af6-4144-84bb-59a66889c3fd admin admin] PATH_INFO: `/v3/projects/297b3bef927f46228f5b9600e5c2988e/users/bc32d7a99d9e4b469a28b7a1ccecebe7/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:50.852914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e19e8-4af6-4144-84bb-59a66889c3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=297b3bef927f46228f5b9600e5c2988e, user_id=bc32d7a99d9e4b469a28b7a1ccecebe7, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:50.856293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e19e8-4af6-4144-84bb-59a66889c3fd admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:50.885033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b4a63-3446-4aad-bc8e-166c5f3abd23 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:50.890085 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb720532-a568-4dc1-bc97-50bcc148b2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:50.894503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb720532-a568-4dc1-bc97-50bcc148b2ce service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:50.894503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb720532-a568-4dc1-bc97-50bcc148b2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:50.894503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb720532-a568-4dc1-bc97-50bcc148b2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:50.927871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb720532-a568-4dc1-bc97-50bcc148b2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:50.929595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb720532-a568-4dc1-bc97-50bcc148b2ce service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:50.958665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 831/1672] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:50 2022] PUT /identity/v3/projects/297b3bef927f46228f5b9600e5c2988e/users/bc32d7a99d9e4b469a28b7a1ccecebe7/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:50.958886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 842/1673] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:16:50.961937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2788cb-6e23-4c4d-bdba-93a9c92bfd40 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:50.962317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2788cb-6e23-4c4d-bdba-93a9c92bfd40 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:50.962707 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2788cb-6e23-4c4d-bdba-93a9c92bfd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:51.006872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-7b2788cb-6e23-4c4d-bdba-93a9c92bfd40 None None] MFA Rules not processed for user `bc32d7a99d9e4b469a28b7a1ccecebe7`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:51.009094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7b2788cb-6e23-4c4d-bdba-93a9c92bfd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:51.213456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 832/1674] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:51.223777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb720532-a568-4dc1-bc97-50bcc148b2ce service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:51.247221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb720532-a568-4dc1-bc97-50bcc148b2ce service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:51.396927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baff74-2b72-4b0e-9357-9ee9e77d100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:51.397753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baff74-2b72-4b0e-9357-9ee9e77d100e admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:51.398085 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baff74-2b72-4b0e-9357-9ee9e77d100e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:51.398457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6baff74-2b72-4b0e-9357-9ee9e77d100e admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:51.399514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baff74-2b72-4b0e-9357-9ee9e77d100e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:51.401669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6baff74-2b72-4b0e-9357-9ee9e77d100e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:51.559409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 843/1675] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:51 2022] POST /identity/v3/projects => generated 367 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:51.563533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2788cb-6e23-4c4d-bdba-93a9c92bfd40 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:51.582118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2788cb-6e23-4c4d-bdba-93a9c92bfd40 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:51.896338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec78491-14f0-4643-9762-bf6ea459f7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:51.897169 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec78491-14f0-4643-9762-bf6ea459f7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:51.897543 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec78491-14f0-4643-9762-bf6ea459f7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:51.898084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec78491-14f0-4643-9762-bf6ea459f7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:51.899567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec78491-14f0-4643-9762-bf6ea459f7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:51.925871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec78491-14f0-4643-9762-bf6ea459f7d6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:52.083166 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 833/1676] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:51 2022] POST /identity/v3/users => generated 290 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:16:52.087060 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baff74-2b72-4b0e-9357-9ee9e77d100e admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:52.109101 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6baff74-2b72-4b0e-9357-9ee9e77d100e admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:52.125571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582cfb8-2bbc-41e8-a14c-541cc86399b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:52.126476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582cfb8-2bbc-41e8-a14c-541cc86399b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:52.127463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582cfb8-2bbc-41e8-a14c-541cc86399b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:52.127914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582cfb8-2bbc-41e8-a14c-541cc86399b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:52.128815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582cfb8-2bbc-41e8-a14c-541cc86399b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:52.131726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582cfb8-2bbc-41e8-a14c-541cc86399b4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:52.165044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 844/1677] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:52.173781 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec78491-14f0-4643-9762-bf6ea459f7d6 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:52.190524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec78491-14f0-4643-9762-bf6ea459f7d6 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:52.200518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8e009-f06f-4a0d-8bce-e607ce51a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:52.201201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8e009-f06f-4a0d-8bce-e607ce51a811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:52.201467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8e009-f06f-4a0d-8bce-e607ce51a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:52.201782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8e009-f06f-4a0d-8bce-e607ce51a811 admin admin] PATH_INFO: `/v3/projects/ad1c054398f7483c8d3a2da5839e352f/users/c2029b1719f64996ba91d833ce545099/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:52.293437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8e009-f06f-4a0d-8bce-e607ce51a811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1c054398f7483c8d3a2da5839e352f, user_id=c2029b1719f64996ba91d833ce545099, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:52.307340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8e009-f06f-4a0d-8bce-e607ce51a811 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:52.430841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 834/1678] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:52 2022] PUT /identity/v3/projects/ad1c054398f7483c8d3a2da5839e352f/users/c2029b1719f64996ba91d833ce545099/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:52.437897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582cfb8-2bbc-41e8-a14c-541cc86399b4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:52.481691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582cfb8-2bbc-41e8-a14c-541cc86399b4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:52.686424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed063ea3-b818-4c75-ae96-dd09926e389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:52.687837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed063ea3-b818-4c75-ae96-dd09926e389e admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:52.691202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed063ea3-b818-4c75-ae96-dd09926e389e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:52.694859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed063ea3-b818-4c75-ae96-dd09926e389e admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:52.694859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed063ea3-b818-4c75-ae96-dd09926e389e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:52.694859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed063ea3-b818-4c75-ae96-dd09926e389e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:52.721355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 845/1679] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:52.725379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8e009-f06f-4a0d-8bce-e607ce51a811 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:52.739590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8e009-f06f-4a0d-8bce-e607ce51a811 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:52.755000 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eace3ff-2535-4a85-aeb2-76281f8a09b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:52.756394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eace3ff-2535-4a85-aeb2-76281f8a09b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:52.756950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eace3ff-2535-4a85-aeb2-76281f8a09b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:52.757507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eace3ff-2535-4a85-aeb2-76281f8a09b1 admin admin] PATH_INFO: `/v3/projects/ad1c054398f7483c8d3a2da5839e352f/users/c2029b1719f64996ba91d833ce545099/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:52.761138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eace3ff-2535-4a85-aeb2-76281f8a09b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1c054398f7483c8d3a2da5839e352f, user_id=c2029b1719f64996ba91d833ce545099, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:52.768485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eace3ff-2535-4a85-aeb2-76281f8a09b1 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:52.807763 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 835/1680] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:52 2022] PUT /identity/v3/projects/ad1c054398f7483c8d3a2da5839e352f/users/c2029b1719f64996ba91d833ce545099/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:52.824603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ad7fc-6ad0-4c38-b0f0-212c107c1d59 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:52.825132 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ad7fc-6ad0-4c38-b0f0-212c107c1d59 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:52.825405 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ad7fc-6ad0-4c38-b0f0-212c107c1d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:52.865358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-167ad7fc-6ad0-4c38-b0f0-212c107c1d59 None None] MFA Rules not processed for user `c2029b1719f64996ba91d833ce545099`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:52.867422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-167ad7fc-6ad0-4c38-b0f0-212c107c1d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:53.072572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:53.073112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 846/1681] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:53.093363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eace3ff-2535-4a85-aeb2-76281f8a09b1 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:53.097948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2eace3ff-2535-4a85-aeb2-76281f8a09b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:53.218418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:53.255545 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eace3ff-2535-4a85-aeb2-76281f8a09b1 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:53.263370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81465f-6b55-449a-aa52-231614a84c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:53.264042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81465f-6b55-449a-aa52-231614a84c73 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:53.264389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81465f-6b55-449a-aa52-231614a84c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:53.264699 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81465f-6b55-449a-aa52-231614a84c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:53.321301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81465f-6b55-449a-aa52-231614a84c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:53.327251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81465f-6b55-449a-aa52-231614a84c73 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:53.346593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 836/1682] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:53.380392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ad7fc-6ad0-4c38-b0f0-212c107c1d59 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:53.381930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-167ad7fc-6ad0-4c38-b0f0-212c107c1d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:53.509128 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81465f-6b55-449a-aa52-231614a84c73 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:53.510686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-cb81465f-6b55-449a-aa52-231614a84c73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:53.525391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ad7fc-6ad0-4c38-b0f0-212c107c1d59 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:53.533379 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:53.534608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:53.537946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:53.537946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] PATH_INFO: `/v3/projects/ff0c3d207b764399b9c82493acb4ca0b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:53.537946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0c3d207b764399b9c82493acb4ca0b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:53.538670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:53.540021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81465f-6b55-449a-aa52-231614a84c73 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:53.548465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d980de-a383-404b-99eb-5e96792b58a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:53.549602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d980de-a383-404b-99eb-5e96792b58a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:53.550031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d980de-a383-404b-99eb-5e96792b58a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:53.550323 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d980de-a383-404b-99eb-5e96792b58a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:53.671869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0c3d207b764399b9c82493acb4ca0b', 'request_id': 'req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:53.701160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d980de-a383-404b-99eb-5e96792b58a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:53.705012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d980de-a383-404b-99eb-5e96792b58a3 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:53.727983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 837/1683] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:53.769130 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0c3d207b764399b9c82493acb4ca0b', 'request_id': 'req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:53.785797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0c3d207b764399b9c82493acb4ca0b', 'request_id': 'req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:53.832829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] The token cache is being invalidate because project ff0c3d207b764399b9c82493acb4ca0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:16:53.835061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:53.836201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:53.848888 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 847/1684] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:16:53 2022] DELETE /identity/v3/projects/ff0c3d207b764399b9c82493acb4ca0b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:53.853455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d980de-a383-404b-99eb-5e96792b58a3 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:53.871363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d980de-a383-404b-99eb-5e96792b58a3 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:54.096389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e5f5c-1603-484c-bee6-abc8800011d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:54.097053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e5f5c-1603-484c-bee6-abc8800011d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:54.097322 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e5f5c-1603-484c-bee6-abc8800011d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:54.097596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e5f5c-1603-484c-bee6-abc8800011d3 admin admin] PATH_INFO: `/v3/users/c8b4f897aa9a4595a35ab070a4d0c519` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:54.102421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e5f5c-1603-484c-bee6-abc8800011d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8b4f897aa9a4595a35ab070a4d0c519)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:54.104755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e5f5c-1603-484c-bee6-abc8800011d3 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:54.165417 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:DELETE=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:54.421064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-384e5f5c-1603-484c-bee6-abc8800011d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8b4f897aa9a4595a35ab070a4d0c519'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:54.421759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-384e5f5c-1603-484c-bee6-abc8800011d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8b4f897aa9a4595a35ab070a4d0c519'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:54.422422 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-384e5f5c-1603-484c-bee6-abc8800011d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8b4f897aa9a4595a35ab070a4d0c519'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:54.450598 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-384e5f5c-1603-484c-bee6-abc8800011d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8b4f897aa9a4595a35ab070a4d0c519'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:54.476425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:54.478337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:54.503120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfcd0a-9ace-4c2a-9747-906693fc0de3 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:54.511151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b59dc9-407b-4675-a5cb-8c2daf6c513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:54.512142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59dc9-407b-4675-a5cb-8c2daf6c513c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:54.512747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59dc9-407b-4675-a5cb-8c2daf6c513c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:54.513237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b59dc9-407b-4675-a5cb-8c2daf6c513c admin admin] PATH_INFO: `/v3/users/42eb1f636e62490e905afa042dd4c2bf` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:54.515222 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b59dc9-407b-4675-a5cb-8c2daf6c513c admin admin] RBAC: Authorizing `identity:delete_user(user_id=42eb1f636e62490e905afa042dd4c2bf)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:54.519356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b59dc9-407b-4675-a5cb-8c2daf6c513c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:54.577292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-384e5f5c-1603-484c-bee6-abc8800011d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8b4f897aa9a4595a35ab070a4d0c519'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:54.599681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 838/1685] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:16:53 2022] DELETE /identity/v3/users/c8b4f897aa9a4595a35ab070a4d0c519 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:54.844753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:54.867576 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-83b59dc9-407b-4675-a5cb-8c2daf6c513c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42eb1f636e62490e905afa042dd4c2bf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:54.868340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-83b59dc9-407b-4675-a5cb-8c2daf6c513c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42eb1f636e62490e905afa042dd4c2bf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:54.885295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-83b59dc9-407b-4675-a5cb-8c2daf6c513c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42eb1f636e62490e905afa042dd4c2bf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:54.886086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-83b59dc9-407b-4675-a5cb-8c2daf6c513c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42eb1f636e62490e905afa042dd4c2bf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:54.909312 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-83b59dc9-407b-4675-a5cb-8c2daf6c513c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42eb1f636e62490e905afa042dd4c2bf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:55.079212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 848/1686] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:16:54 2022] DELETE /identity/v3/users/42eb1f636e62490e905afa042dd4c2bf => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:55.079487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe984ec3-74aa-4af8-a587-259b3f6abdfc None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:55.079487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe984ec3-74aa-4af8-a587-259b3f6abdfc None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:55.079487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe984ec3-74aa-4af8-a587-259b3f6abdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:55.085295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d499c-4778-43ed-bd80-7ea421d06379 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:55.085295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d499c-4778-43ed-bd80-7ea421d06379 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:55.097235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d499c-4778-43ed-bd80-7ea421d06379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:55.145554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-fe984ec3-74aa-4af8-a587-259b3f6abdfc None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:55.146874 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-fe984ec3-74aa-4af8-a587-259b3f6abdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:55.183983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-f81d499c-4778-43ed-bd80-7ea421d06379 None None] MFA Rules not processed for user `751a93746a5248cb9ec450b315282f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:55.185272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f81d499c-4778-43ed-bd80-7ea421d06379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:55.388667 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 839/1687] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:55.392651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 849/1688] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:55.404571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f4c2-5135-4c2a-a4bf-31b5210109dd None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:55.405100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f4c2-5135-4c2a-a4bf-31b5210109dd None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:55.405456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f4c2-5135-4c2a-a4bf-31b5210109dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:55.428410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d499c-4778-43ed-bd80-7ea421d06379 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:55.431369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f81d499c-4778-43ed-bd80-7ea421d06379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:55.440353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6ae1f4c2-5135-4c2a-a4bf-31b5210109dd None None] MFA Rules not processed for user `751a93746a5248cb9ec450b315282f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:55.444023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6ae1f4c2-5135-4c2a-a4bf-31b5210109dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:55.464486 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 840/1689] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:55.481808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1f4c2-5135-4c2a-a4bf-31b5210109dd None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:55.483167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6ae1f4c2-5135-4c2a-a4bf-31b5210109dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:55.620387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d499c-4778-43ed-bd80-7ea421d06379 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:55.624568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56012b57-54f0-4c0d-9605-01ca5e80a9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:55.625441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56012b57-54f0-4c0d-9605-01ca5e80a9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:55.625875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56012b57-54f0-4c0d-9605-01ca5e80a9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:55.626301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56012b57-54f0-4c0d-9605-01ca5e80a9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:55.661332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56012b57-54f0-4c0d-9605-01ca5e80a9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:55.666031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1f4c2-5135-4c2a-a4bf-31b5210109dd None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:55.668021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56012b57-54f0-4c0d-9605-01ca5e80a9c2 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:55.689602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30caf80-1882-4b24-a6ff-e2d38fc5ce39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:55.694072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30caf80-1882-4b24-a6ff-e2d38fc5ce39 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:55.694380 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30caf80-1882-4b24-a6ff-e2d38fc5ce39 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:55.694661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30caf80-1882-4b24-a6ff-e2d38fc5ce39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:55.695993 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 850/1690] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:55.709564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30caf80-1882-4b24-a6ff-e2d38fc5ce39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:55.711345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30caf80-1882-4b24-a6ff-e2d38fc5ce39 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:55.738082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 841/1691] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:16:56.942167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c012b-2157-4428-8007-39f69a12fa75 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:56.942654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c012b-2157-4428-8007-39f69a12fa75 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:56.942923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c012b-2157-4428-8007-39f69a12fa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.028559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-6a2c012b-2157-4428-8007-39f69a12fa75 None None] MFA Rules not processed for user `60efa77075d94402a0cb8e9e427772cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:57.033470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6a2c012b-2157-4428-8007-39f69a12fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:57.072795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30caf80-1882-4b24-a6ff-e2d38fc5ce39 service nova] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:57.075494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a30caf80-1882-4b24-a6ff-e2d38fc5ce39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:57.102962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30caf80-1882-4b24-a6ff-e2d38fc5ce39 service nova] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:57.118661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:57.119599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.121088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.121483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] PATH_INFO: `/v3/projects/e9875c76ceb34e19ad776e696870c3eb` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.125369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9875c76ceb34e19ad776e696870c3eb)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:57.133286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:57.148487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:57.201375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:57.237066 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 851/1692] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:57.271828 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c012b-2157-4428-8007-39f69a12fa75 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:57.276563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6a2c012b-2157-4428-8007-39f69a12fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:57.324050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c012b-2157-4428-8007-39f69a12fa75 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:57.349363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf2d11-6dac-4b04-b78b-852657666938 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:57.350381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf2d11-6dac-4b04-b78b-852657666938 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.350381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf2d11-6dac-4b04-b78b-852657666938 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.350585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf2d11-6dac-4b04-b78b-852657666938 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.390840 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9875c76ceb34e19ad776e696870c3eb', 'request_id': 'req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:57.410202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf2d11-6dac-4b04-b78b-852657666938 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:57.417904 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf2d11-6dac-4b04-b78b-852657666938 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:57.448058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 852/1693] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:57.455617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449bd7-2b36-4cb9-9dba-e805a4457a51 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.455617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449bd7-2b36-4cb9-9dba-e805a4457a51 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.455617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2449bd7-2b36-4cb9-9dba-e805a4457a51 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.461257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 853/1694] 10.222.0.20 () {54 vars in 912 bytes} [Wed Aug 24 17:16:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:16:57.462700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c98a2-7889-46e2-b229-c75bbe05b23a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.466113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c98a2-7889-46e2-b229-c75bbe05b23a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.466401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c98a2-7889-46e2-b229-c75bbe05b23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.489960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9875c76ceb34e19ad776e696870c3eb', 'request_id': 'req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:57.517538 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9875c76ceb34e19ad776e696870c3eb', 'request_id': 'req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:57.544901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] The token cache is being invalidate because project e9875c76ceb34e19ad776e696870c3eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:16:57.544901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:57.544901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-53395ebb-98e4-4f9f-9cb8-52f10751cfdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:57.549695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 842/1695] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:16:57 2022] DELETE /identity/v3/projects/e9875c76ceb34e19ad776e696870c3eb => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:57.551366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb8271-827e-4bed-85cc-d3435aae6228 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.551656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb8271-827e-4bed-85cc-d3435aae6228 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.552209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb8271-827e-4bed-85cc-d3435aae6228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.557291 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-335c98a2-7889-46e2-b229-c75bbe05b23a None None] MFA Rules not processed for user `e303777e78b7499fbff457254d14d360`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:57.561098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-335c98a2-7889-46e2-b229-c75bbe05b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:57.600567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-42eb8271-827e-4bed-85cc-d3435aae6228 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:57.606477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-42eb8271-827e-4bed-85cc-d3435aae6228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:57.745203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 854/1696] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:16:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:57.785755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 843/1697] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:16:57.790079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c98a2-7889-46e2-b229-c75bbe05b23a None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:57.798232 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd85caa-cc91-47c2-9dd3-3c4c7e8008fd None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.798444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd85caa-cc91-47c2-9dd3-3c4c7e8008fd None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.798752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd85caa-cc91-47c2-9dd3-3c4c7e8008fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.804872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-335c98a2-7889-46e2-b229-c75bbe05b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:57.862534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c98a2-7889-46e2-b229-c75bbe05b23a None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:57.895773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664949b7-d963-4b7e-b5f2-893abe7e34d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:57.896862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664949b7-d963-4b7e-b5f2-893abe7e34d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.897246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664949b7-d963-4b7e-b5f2-893abe7e34d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.897523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664949b7-d963-4b7e-b5f2-893abe7e34d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.935086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664949b7-d963-4b7e-b5f2-893abe7e34d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:57.936610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-7bd85caa-cc91-47c2-9dd3-3c4c7e8008fd None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:57.937903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664949b7-d963-4b7e-b5f2-893abe7e34d6 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:57.938118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7bd85caa-cc91-47c2-9dd3-3c4c7e8008fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:57.963798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 855/1698] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:57.975621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 844/1699] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:57.980152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664949b7-d963-4b7e-b5f2-893abe7e34d6 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.032566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664949b7-d963-4b7e-b5f2-893abe7e34d6 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.060196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70da2d-481e-4176-a112-834b6b510b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.060987 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70da2d-481e-4176-a112-834b6b510b0a admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.065462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70da2d-481e-4176-a112-834b6b510b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.065462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70da2d-481e-4176-a112-834b6b510b0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.065462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70da2d-481e-4176-a112-834b6b510b0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:58.065462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70da2d-481e-4176-a112-834b6b510b0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.065462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70da2d-481e-4176-a112-834b6b510b0a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.096320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 856/1700] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:58.103244 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd85caa-cc91-47c2-9dd3-3c4c7e8008fd None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.115008 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd85caa-cc91-47c2-9dd3-3c4c7e8008fd None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.128162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa74bf2-4aa4-408e-bdff-710ff6348569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.129271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa74bf2-4aa4-408e-bdff-710ff6348569 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.129768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa74bf2-4aa4-408e-bdff-710ff6348569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.130417 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa74bf2-4aa4-408e-bdff-710ff6348569 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.131167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa74bf2-4aa4-408e-bdff-710ff6348569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.136509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa74bf2-4aa4-408e-bdff-710ff6348569 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.345482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 845/1701] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:58 2022] POST /identity/v3/projects => generated 383 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:58.347828 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70da2d-481e-4176-a112-834b6b510b0a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.384194 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70da2d-481e-4176-a112-834b6b510b0a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.411211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa74bf2-4aa4-408e-bdff-710ff6348569 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.414173 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4fa74bf2-4aa4-408e-bdff-710ff6348569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:58.574445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0036fd6-c38d-4d42-bc13-cc9dfbed28c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.575329 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036fd6-c38d-4d42-bc13-cc9dfbed28c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.575791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036fd6-c38d-4d42-bc13-cc9dfbed28c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.576380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0036fd6-c38d-4d42-bc13-cc9dfbed28c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.577183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0036fd6-c38d-4d42-bc13-cc9dfbed28c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.579350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0036fd6-c38d-4d42-bc13-cc9dfbed28c2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.655429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa74bf2-4aa4-408e-bdff-710ff6348569 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.695260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.697978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.698766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.699075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 857/1702] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:58 2022] POST /identity/v3/users => generated 292 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:58.699890 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] PATH_INFO: `/v3/projects/469e0578aca44e278c68e772614ca1e9` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.703056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469e0578aca44e278c68e772614ca1e9)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.705146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0036fd6-c38d-4d42-bc13-cc9dfbed28c2 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.709150 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.726500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0036fd6-c38d-4d42-bc13-cc9dfbed28c2 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.753294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b7cd2-e8e0-4687-95f2-ad7fa34d4729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.754009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b7cd2-e8e0-4687-95f2-ad7fa34d4729 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.754293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b7cd2-e8e0-4687-95f2-ad7fa34d4729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.754563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b7cd2-e8e0-4687-95f2-ad7fa34d4729 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.755228 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b7cd2-e8e0-4687-95f2-ad7fa34d4729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.756888 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b7cd2-e8e0-4687-95f2-ad7fa34d4729 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.805710 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 858/1703] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:58.808209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b7cd2-e8e0-4687-95f2-ad7fa34d4729 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.832713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b7cd2-e8e0-4687-95f2-ad7fa34d4729 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.863188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6644496-4329-4111-a9c3-25d3bf59945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.863952 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6644496-4329-4111-a9c3-25d3bf59945c admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.864304 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6644496-4329-4111-a9c3-25d3bf59945c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.864690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6644496-4329-4111-a9c3-25d3bf59945c admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.865388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6644496-4329-4111-a9c3-25d3bf59945c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.867146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6644496-4329-4111-a9c3-25d3bf59945c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.872558 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469e0578aca44e278c68e772614ca1e9', 'request_id': 'req-6bd1408a-56af-4001-b402-99ac17a66091'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:58.905420 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 859/1704] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:58.909079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6644496-4329-4111-a9c3-25d3bf59945c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.940752 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6644496-4329-4111-a9c3-25d3bf59945c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.960856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469e0578aca44e278c68e772614ca1e9', 'request_id': 'req-6bd1408a-56af-4001-b402-99ac17a66091'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:58.976724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469e0578aca44e278c68e772614ca1e9', 'request_id': 'req-6bd1408a-56af-4001-b402-99ac17a66091'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:59.024704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] The token cache is being invalidate because project 469e0578aca44e278c68e772614ca1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:16:59.025893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:59.036104 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6bd1408a-56af-4001-b402-99ac17a66091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:59.043802 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 846/1705] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:16:58 2022] DELETE /identity/v3/projects/469e0578aca44e278c68e772614ca1e9 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:59.047410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52741a3-36a9-4866-9f8d-10928a60e980 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:59.047712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52741a3-36a9-4866-9f8d-10928a60e980 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:59.047989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52741a3-36a9-4866-9f8d-10928a60e980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:59.207798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2e43-23b6-49a7-b5a0-937cffbdde64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:59.209803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2e43-23b6-49a7-b5a0-937cffbdde64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:59.211824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2e43-23b6-49a7-b5a0-937cffbdde64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:59.212202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc2e43-23b6-49a7-b5a0-937cffbdde64 admin admin] PATH_INFO: `/v3/projects/cacbb3ea3b2f4a3e804735e8a2350e54/users/41af70f9e64742a0acd94d8e9626c6f6/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:59.231384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-f52741a3-36a9-4866-9f8d-10928a60e980 None None] MFA Rules not processed for user `9a395f2e142643d7a8a22adf7355f960`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:59.240005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f52741a3-36a9-4866-9f8d-10928a60e980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:59.247514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc2e43-23b6-49a7-b5a0-937cffbdde64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacbb3ea3b2f4a3e804735e8a2350e54, user_id=41af70f9e64742a0acd94d8e9626c6f6, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:59.251980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc2e43-23b6-49a7-b5a0-937cffbdde64 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:59.298632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:59.334923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 860/1706] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:58 2022] PUT /identity/v3/projects/cacbb3ea3b2f4a3e804735e8a2350e54/users/41af70f9e64742a0acd94d8e9626c6f6/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:59.337339 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2e43-23b6-49a7-b5a0-937cffbdde64 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:59.338039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:59.347520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b4fc2e43-23b6-49a7-b5a0-937cffbdde64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:59.406986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 847/1707] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:59.409137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb2ad0-a80f-4cd0-9be0-ba2a6be06ac7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:59.409500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb2ad0-a80f-4cd0-9be0-ba2a6be06ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:59.409839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb2ad0-a80f-4cd0-9be0-ba2a6be06ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:59.454212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-71eb2ad0-a80f-4cd0-9be0-ba2a6be06ac7 None None] MFA Rules not processed for user `41af70f9e64742a0acd94d8e9626c6f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:59.454212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-71eb2ad0-a80f-4cd0-9be0-ba2a6be06ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:59.557866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc2e43-23b6-49a7-b5a0-937cffbdde64 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:59.578920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:59.580812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:59.581233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:59.581667 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] PATH_INFO: `/v3/users/38a761838a7f47d1a75ff465a17f1995` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:59.585342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a761838a7f47d1a75ff465a17f1995)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:59.587629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:59.623418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 848/1708] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:59.627353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81aaab-b038-4d25-a173-870f6f47f12a None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:59.628453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81aaab-b038-4d25-a173-870f6f47f12a None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:59.629354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81aaab-b038-4d25-a173-870f6f47f12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:59.781555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-2f81aaab-b038-4d25-a173-870f6f47f12a None None] MFA Rules not processed for user `9a395f2e142643d7a8a22adf7355f960`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:59.797610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2f81aaab-b038-4d25-a173-870f6f47f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:59.932167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a761838a7f47d1a75ff465a17f1995'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:59.933560 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a761838a7f47d1a75ff465a17f1995'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:59.949048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a761838a7f47d1a75ff465a17f1995'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:59.952860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a761838a7f47d1a75ff465a17f1995'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:00.008509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a761838a7f47d1a75ff465a17f1995'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:00.110004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 849/1709] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:16:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:00.112550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81aaab-b038-4d25-a173-870f6f47f12a None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:00.116156 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2f81aaab-b038-4d25-a173-870f6f47f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:00.137302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 861/1710] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:16:59 2022] DELETE /identity/v3/users/38a761838a7f47d1a75ff465a17f1995 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:00.138248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:00.144669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:00.186228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81aaab-b038-4d25-a173-870f6f47f12a None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:00.323627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab649fd-7bcd-46f2-bfea-c7e6a1da080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:00.324374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab649fd-7bcd-46f2-bfea-c7e6a1da080a admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:00.324594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab649fd-7bcd-46f2-bfea-c7e6a1da080a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:00.324913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab649fd-7bcd-46f2-bfea-c7e6a1da080a admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:00.325517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab649fd-7bcd-46f2-bfea-c7e6a1da080a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:00.327526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab649fd-7bcd-46f2-bfea-c7e6a1da080a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:00.446217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ecb3d5-131f-4df3-a09b-fb7d8ea76f41 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:00.465300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa69418-7c16-4533-b056-7186a9a8aeb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:00.466051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69418-7c16-4533-b056-7186a9a8aeb9 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:00.466215 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69418-7c16-4533-b056-7186a9a8aeb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:00.466494 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69418-7c16-4533-b056-7186a9a8aeb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:00.499156 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5fa69418-7c16-4533-b056-7186a9a8aeb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:00.511449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 850/1711] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:00 2022] POST /identity/v3/projects => generated 385 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:00.512906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e793f-5c01-4d12-938b-ee2e52b62fea None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:00.513314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e793f-5c01-4d12-938b-ee2e52b62fea None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:00.531868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e793f-5c01-4d12-938b-ee2e52b62fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:00.691643 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:00.703550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ae0e793f-5c01-4d12-938b-ee2e52b62fea None None] MFA Rules not processed for user `a0ad0c892c464a7ab40a683ca588963a`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:00.705146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ae0e793f-5c01-4d12-938b-ee2e52b62fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:00.765728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa69418-7c16-4533-b056-7186a9a8aeb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:00.779947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa69418-7c16-4533-b056-7186a9a8aeb9 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:00.813231 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 862/1712] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:00.818128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa69418-7c16-4533-b056-7186a9a8aeb9 service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:00.846485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa69418-7c16-4533-b056-7186a9a8aeb9 service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:01.064218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf172-c72a-4ac1-8baa-bed4f713f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:01.066581 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf172-c72a-4ac1-8baa-bed4f713f4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:01.067717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf172-c72a-4ac1-8baa-bed4f713f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:01.068404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf172-c72a-4ac1-8baa-bed4f713f4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:01.070210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cf172-c72a-4ac1-8baa-bed4f713f4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:01.076919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cf172-c72a-4ac1-8baa-bed4f713f4d5 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:01.100324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 851/1713] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 588 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:01.108015 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177402d2-fb1b-4722-b496-4d7643065c82 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:01.108344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177402d2-fb1b-4722-b496-4d7643065c82 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:01.108623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177402d2-fb1b-4722-b496-4d7643065c82 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:01.116298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 852/1714] 10.222.0.20 () {54 vars in 961 bytes} [Wed Aug 24 17:17:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:17:01.123199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a10e7-5f38-4a97-90e3-40eb4dd6c304 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:01.123494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a10e7-5f38-4a97-90e3-40eb4dd6c304 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:01.123764 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a10e7-5f38-4a97-90e3-40eb4dd6c304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:01.220519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-7c4a10e7-5f38-4a97-90e3-40eb4dd6c304 None None] MFA Rules not processed for user `a698e566a46841cf83aa1711e83f8829`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:01.222322 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7c4a10e7-5f38-4a97-90e3-40eb4dd6c304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:01.304526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:01.353464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 863/1715] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:00 2022] POST /identity/v3/users => generated 299 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:01.360083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548a3c-4579-42bf-a6ae-d071a3ec0d7e None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:01.364759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548a3c-4579-42bf-a6ae-d071a3ec0d7e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:01.365571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e548a3c-4579-42bf-a6ae-d071a3ec0d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:01.419099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-9e548a3c-4579-42bf-a6ae-d071a3ec0d7e None None] MFA Rules not processed for user `751a93746a5248cb9ec450b315282f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:01.420870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-9e548a3c-4579-42bf-a6ae-d071a3ec0d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:01.432140 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 853/1716] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Aug 24 17:17:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:01.435131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a10e7-5f38-4a97-90e3-40eb4dd6c304 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:01.437486 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7c4a10e7-5f38-4a97-90e3-40eb4dd6c304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:01.652122 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 864/1717] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:01.660727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e548a3c-4579-42bf-a6ae-d071a3ec0d7e None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:01.703322 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e548a3c-4579-42bf-a6ae-d071a3ec0d7e None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:01.707522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a10e7-5f38-4a97-90e3-40eb4dd6c304 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:01.717254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337701a-e3a5-481d-935d-f1a1737f57f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:01.725045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337701a-e3a5-481d-935d-f1a1737f57f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:01.725045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337701a-e3a5-481d-935d-f1a1737f57f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:01.725045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337701a-e3a5-481d-935d-f1a1737f57f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:01.725045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337701a-e3a5-481d-935d-f1a1737f57f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:01.726551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337701a-e3a5-481d-935d-f1a1737f57f9 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:01.737884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db292c-1c4e-4010-8eb3-ddfc8f246383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:01.739348 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db292c-1c4e-4010-8eb3-ddfc8f246383 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:01.739743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db292c-1c4e-4010-8eb3-ddfc8f246383 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:01.740123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db292c-1c4e-4010-8eb3-ddfc8f246383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:01.757124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db292c-1c4e-4010-8eb3-ddfc8f246383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:01.762401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 865/1718] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:01.762401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337701a-e3a5-481d-935d-f1a1737f57f9 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:01.762917 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db292c-1c4e-4010-8eb3-ddfc8f246383 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:01.793806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 854/1719] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:01.794245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337701a-e3a5-481d-935d-f1a1737f57f9 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:01.794424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c5082-9259-441d-b8ea-af6bdba6308d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:01.794424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c5082-9259-441d-b8ea-af6bdba6308d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:01.794424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c5082-9259-441d-b8ea-af6bdba6308d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:01.802613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e18e5-dda0-4f5b-bf91-42e06fc702a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a698e566a46841cf83aa1711e83f8829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:01.803732 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e18e5-dda0-4f5b-bf91-42e06fc702a7 service placement] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:01.804124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e18e5-dda0-4f5b-bf91-42e06fc702a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:01.805141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e18e5-dda0-4f5b-bf91-42e06fc702a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:01.812973 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-864e18e5-dda0-4f5b-bf91-42e06fc702a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:01.853586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e18e5-dda0-4f5b-bf91-42e06fc702a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:01.855618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e18e5-dda0-4f5b-bf91-42e06fc702a7 service placement] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:01.870273 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-634c5082-9259-441d-b8ea-af6bdba6308d None None] MFA Rules not processed for user `9b22f661cc524dd2a58a499badb8e661`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:01.877126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-634c5082-9259-441d-b8ea-af6bdba6308d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:01.884095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 866/1720] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:01.888755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e18e5-dda0-4f5b-bf91-42e06fc702a7 service placement] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:01.923854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e18e5-dda0-4f5b-bf91-42e06fc702a7 service placement] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:01.955109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45eab94-a705-4b21-b271-bc84896f7c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:01.956271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eab94-a705-4b21-b271-bc84896f7c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:01.958262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eab94-a705-4b21-b271-bc84896f7c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:01.958262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eab94-a705-4b21-b271-bc84896f7c44 admin admin] PATH_INFO: `/v3/projects/0554e79cea8d4fc5b963cce28d95f453/users/cb3bfd739c984fbdadc8a90cd251c3f3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:02.010465 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eab94-a705-4b21-b271-bc84896f7c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0554e79cea8d4fc5b963cce28d95f453, user_id=cb3bfd739c984fbdadc8a90cd251c3f3, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:02.030023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eab94-a705-4b21-b271-bc84896f7c44 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:02.098822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 855/1721] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:02.100074 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c5082-9259-441d-b8ea-af6bdba6308d None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:02.101564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-634c5082-9259-441d-b8ea-af6bdba6308d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:02.132324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c5082-9259-441d-b8ea-af6bdba6308d None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:02.136393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 867/1722] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:01 2022] PUT /identity/v3/projects/0554e79cea8d4fc5b963cce28d95f453/users/cb3bfd739c984fbdadc8a90cd251c3f3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:02.137892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da699a-ee24-4254-a91d-2247662cf10f None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:02.138332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da699a-ee24-4254-a91d-2247662cf10f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:02.138885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da699a-ee24-4254-a91d-2247662cf10f None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:02.144054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 868/1723] 10.222.0.20 () {54 vars in 912 bytes} [Wed Aug 24 17:17:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:17:02.145165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da699a-ee24-4254-a91d-2247662cf10f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:02.150939 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-53da699a-ee24-4254-a91d-2247662cf10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:02.309217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da699a-ee24-4254-a91d-2247662cf10f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:02.309549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c77c26-0a0c-4c46-a05c-c0e6c42db145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:02.310068 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c77c26-0a0c-4c46-a05c-c0e6c42db145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:02.310924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c77c26-0a0c-4c46-a05c-c0e6c42db145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:02.311208 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c77c26-0a0c-4c46-a05c-c0e6c42db145 admin admin] PATH_INFO: `/v3/users/bc32d7a99d9e4b469a28b7a1ccecebe7` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:02.313465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c77c26-0a0c-4c46-a05c-c0e6c42db145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc32d7a99d9e4b469a28b7a1ccecebe7)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:02.321969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c77c26-0a0c-4c46-a05c-c0e6c42db145 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:02.323171 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:02.324300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:02.324590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:02.324967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] PATH_INFO: `/v3/projects/641fff9658c34229b258bf7ea6bd8f41` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:02.326776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641fff9658c34229b258bf7ea6bd8f41)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:02.331310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:02.567544 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:02.603642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641fff9658c34229b258bf7ea6bd8f41', 'request_id': 'req-16c65b95-0098-4e82-9136-cd55e968c014'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:02.614482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-55c77c26-0a0c-4c46-a05c-c0e6c42db145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc32d7a99d9e4b469a28b7a1ccecebe7'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:02.623556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-55c77c26-0a0c-4c46-a05c-c0e6c42db145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc32d7a99d9e4b469a28b7a1ccecebe7'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:02.633344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-55c77c26-0a0c-4c46-a05c-c0e6c42db145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc32d7a99d9e4b469a28b7a1ccecebe7'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:02.702229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-55c77c26-0a0c-4c46-a05c-c0e6c42db145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc32d7a99d9e4b469a28b7a1ccecebe7'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:02.727580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641fff9658c34229b258bf7ea6bd8f41', 'request_id': 'req-16c65b95-0098-4e82-9136-cd55e968c014'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:02.743512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641fff9658c34229b258bf7ea6bd8f41', 'request_id': 'req-16c65b95-0098-4e82-9136-cd55e968c014'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:02.773095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] The token cache is being invalidate because project 641fff9658c34229b258bf7ea6bd8f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:02.774004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:02.775335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:02.785474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 869/1724] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:02 2022] DELETE /identity/v3/projects/641fff9658c34229b258bf7ea6bd8f41 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:02.788102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:02.793223 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:02.830178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-55c77c26-0a0c-4c46-a05c-c0e6c42db145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc32d7a99d9e4b469a28b7a1ccecebe7'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:02.853399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 856/1725] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:02 2022] DELETE /identity/v3/users/bc32d7a99d9e4b469a28b7a1ccecebe7 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:02.858504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f561905-b4f1-46bc-85ae-072e5fb50dfe None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:02.862201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f561905-b4f1-46bc-85ae-072e5fb50dfe None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:02.862201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f561905-b4f1-46bc-85ae-072e5fb50dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:02.922785 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6f561905-b4f1-46bc-85ae-072e5fb50dfe None None] MFA Rules not processed for user `e303777e78b7499fbff457254d14d360`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:02.932880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6f561905-b4f1-46bc-85ae-072e5fb50dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:03.083171 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c65b95-0098-4e82-9136-cd55e968c014 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:03.157073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 857/1726] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:17:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:03.159042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2982d-4a09-4428-ace4-604a3ff44ccb None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:03.159515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2982d-4a09-4428-ace4-604a3ff44ccb None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:03.159896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2982d-4a09-4428-ace4-604a3ff44ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:03.186877 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9165e9-d40d-495f-a7e7-1d4aa569c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:03.189821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9165e9-d40d-495f-a7e7-1d4aa569c13f admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:03.190994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9165e9-d40d-495f-a7e7-1d4aa569c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:03.191875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9165e9-d40d-495f-a7e7-1d4aa569c13f admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:03.192753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9165e9-d40d-495f-a7e7-1d4aa569c13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:03.195366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9165e9-d40d-495f-a7e7-1d4aa569c13f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:03.216641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-eca2982d-4a09-4428-ace4-604a3ff44ccb None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:03.222378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-eca2982d-4a09-4428-ace4-604a3ff44ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:03.227381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 870/1727] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:03.227678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb4cb1-251d-443b-afe3-bcaa7ea3fc24 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:03.228058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb4cb1-251d-443b-afe3-bcaa7ea3fc24 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:03.228364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb4cb1-251d-443b-afe3-bcaa7ea3fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:03.250250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 858/1728] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:03.251652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2982d-4a09-4428-ace4-604a3ff44ccb None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:03.255943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-eca2982d-4a09-4428-ace4-604a3ff44ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:03.298953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2982d-4a09-4428-ace4-604a3ff44ccb None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:03.299317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-5bfb4cb1-251d-443b-afe3-bcaa7ea3fc24 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:03.309424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abbc59-c8b9-4747-91d5-efa31f2ab0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:03.310182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abbc59-c8b9-4747-91d5-efa31f2ab0fb service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:03.310570 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abbc59-c8b9-4747-91d5-efa31f2ab0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:03.310761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5bfb4cb1-251d-443b-afe3-bcaa7ea3fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:03.311046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abbc59-c8b9-4747-91d5-efa31f2ab0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:03.330907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abbc59-c8b9-4747-91d5-efa31f2ab0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:03.336135 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abbc59-c8b9-4747-91d5-efa31f2ab0fb service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:03.362749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 859/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:03.368754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 871/1730] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:03.369265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae2b20-173a-4202-9734-d75cbe7f7d14 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:03.369550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae2b20-173a-4202-9734-d75cbe7f7d14 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:03.369928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae2b20-173a-4202-9734-d75cbe7f7d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:03.384796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abbc59-c8b9-4747-91d5-efa31f2ab0fb service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:03.435228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abbc59-c8b9-4747-91d5-efa31f2ab0fb service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:03.446387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-73ae2b20-173a-4202-9734-d75cbe7f7d14 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:03.448459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-73ae2b20-173a-4202-9734-d75cbe7f7d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:03.451639 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add550-ec97-4971-aa06-0f2c11e7d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:03.454676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add550-ec97-4971-aa06-0f2c11e7d5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:03.457128 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add550-ec97-4971-aa06-0f2c11e7d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:03.457638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add550-ec97-4971-aa06-0f2c11e7d5f9 admin admin] PATH_INFO: `/v3/projects/0554e79cea8d4fc5b963cce28d95f453/users/cb3bfd739c984fbdadc8a90cd251c3f3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:03.463586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41add550-ec97-4971-aa06-0f2c11e7d5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0554e79cea8d4fc5b963cce28d95f453, user_id=cb3bfd739c984fbdadc8a90cd251c3f3, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:03.464036 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 872/1731] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:03.465072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae2b20-173a-4202-9734-d75cbe7f7d14 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:03.475377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41add550-ec97-4971-aa06-0f2c11e7d5f9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:03.475610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-73ae2b20-173a-4202-9734-d75cbe7f7d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:03.531022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 860/1732] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:03 2022] PUT /identity/v3/projects/0554e79cea8d4fc5b963cce28d95f453/users/cb3bfd739c984fbdadc8a90cd251c3f3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:03.533514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae2b20-173a-4202-9734-d75cbe7f7d14 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:03.539057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add550-ec97-4971-aa06-0f2c11e7d5f9 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:03.729017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add550-ec97-4971-aa06-0f2c11e7d5f9 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:03.735927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6aec2-d9f5-41fe-b0f8-07225509e176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:03.736780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6aec2-d9f5-41fe-b0f8-07225509e176 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:03.737154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed4d40-029b-4646-9ddf-35dc60709076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:03.737645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6aec2-d9f5-41fe-b0f8-07225509e176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:03.737645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6aec2-d9f5-41fe-b0f8-07225509e176 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:03.737811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed4d40-029b-4646-9ddf-35dc60709076 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:03.738438 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6aec2-d9f5-41fe-b0f8-07225509e176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:03.738851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6aec2-d9f5-41fe-b0f8-07225509e176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:03.740821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6aec2-d9f5-41fe-b0f8-07225509e176 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:03.741412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed4d40-029b-4646-9ddf-35dc60709076 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:03.741706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed4d40-029b-4646-9ddf-35dc60709076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:03.780679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 861/1733] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:03.786101 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed4d40-029b-4646-9ddf-35dc60709076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:03.787030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791b161-29f4-472f-b6b4-b6fc4b5f0049 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:03.787431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791b161-29f4-472f-b6b4-b6fc4b5f0049 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:03.788193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791b161-29f4-472f-b6b4-b6fc4b5f0049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:03.792387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed4d40-029b-4646-9ddf-35dc60709076 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:03.799285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:03.816633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 873/1734] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:03.824685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed4d40-029b-4646-9ddf-35dc60709076 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:03.861820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed4d40-029b-4646-9ddf-35dc60709076 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:03.905528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253a23-3293-4533-b7c1-60053c7677d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:03.906437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253a23-3293-4533-b7c1-60053c7677d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:03.906727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253a23-3293-4533-b7c1-60053c7677d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:03.906998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253a23-3293-4533-b7c1-60053c7677d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:03.908537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc253a23-3293-4533-b7c1-60053c7677d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:03.913482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0791b161-29f4-472f-b6b4-b6fc4b5f0049 None None] MFA Rules not processed for user `cb3bfd739c984fbdadc8a90cd251c3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:03.920310 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0791b161-29f4-472f-b6b4-b6fc4b5f0049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:03.922745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc253a23-3293-4533-b7c1-60053c7677d5 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:03.964838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:04.093939 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 874/1735] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:03 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:04.102185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253a23-3293-4533-b7c1-60053c7677d5 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:04.118538 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 862/1736] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:04.134813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791b161-29f4-472f-b6b4-b6fc4b5f0049 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:04.142299 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0791b161-29f4-472f-b6b4-b6fc4b5f0049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:04.267733 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791b161-29f4-472f-b6b4-b6fc4b5f0049 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:04.365625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253a23-3293-4533-b7c1-60053c7677d5 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:04.393494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc573de8-8121-4858-9d5f-36b61df615c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:04.397397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc573de8-8121-4858-9d5f-36b61df615c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:04.397798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2699cc-7e39-4104-8f8c-4dab57970380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:04.397908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc573de8-8121-4858-9d5f-36b61df615c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:04.397908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc573de8-8121-4858-9d5f-36b61df615c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:04.398076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2699cc-7e39-4104-8f8c-4dab57970380 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:04.398076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2699cc-7e39-4104-8f8c-4dab57970380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:04.398222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-fc573de8-8121-4858-9d5f-36b61df615c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:04.399680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2699cc-7e39-4104-8f8c-4dab57970380 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:04.399951 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2699cc-7e39-4104-8f8c-4dab57970380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:04.401983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2699cc-7e39-4104-8f8c-4dab57970380 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:04.657276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc573de8-8121-4858-9d5f-36b61df615c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:04.659422 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc573de8-8121-4858-9d5f-36b61df615c5 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:04.696305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 863/1737] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:04.703174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 875/1738] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:04 2022] POST /identity/v3/users => generated 293 bytes in 602 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:04.707837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc573de8-8121-4858-9d5f-36b61df615c5 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:04.727900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc573de8-8121-4858-9d5f-36b61df615c5 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:04.744036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a8188-ded5-48bd-8ad3-4d255fb95ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:04.746780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8188-ded5-48bd-8ad3-4d255fb95ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:04.747195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8188-ded5-48bd-8ad3-4d255fb95ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:04.747552 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a8188-ded5-48bd-8ad3-4d255fb95ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:04.748355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a8188-ded5-48bd-8ad3-4d255fb95ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:04.758277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a8188-ded5-48bd-8ad3-4d255fb95ae4 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:04.784138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2699cc-7e39-4104-8f8c-4dab57970380 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:04.786054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 864/1739] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:04.797681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a8188-ded5-48bd-8ad3-4d255fb95ae4 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:04.805906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0c7a8188-ded5-48bd-8ad3-4d255fb95ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:04.809493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2699cc-7e39-4104-8f8c-4dab57970380 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:04.838904 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108ab56-680e-4401-a6d0-b9ea409526ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:04.839555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108ab56-680e-4401-a6d0-b9ea409526ee admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:04.839835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108ab56-680e-4401-a6d0-b9ea409526ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:04.840109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108ab56-680e-4401-a6d0-b9ea409526ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:04.840914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108ab56-680e-4401-a6d0-b9ea409526ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:04.842460 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108ab56-680e-4401-a6d0-b9ea409526ee admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:04.900949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 876/1740] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:04.905157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108ab56-680e-4401-a6d0-b9ea409526ee admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:04.967449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108ab56-680e-4401-a6d0-b9ea409526ee admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:04.990618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54824429-908c-4839-9bfc-54c6a7b3c52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:04.992247 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54824429-908c-4839-9bfc-54c6a7b3c52e admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:04.992770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54824429-908c-4839-9bfc-54c6a7b3c52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:04.993260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54824429-908c-4839-9bfc-54c6a7b3c52e admin admin] PATH_INFO: `/v3/projects/1a114e149d194b539c205b577895cbda/users/038876d23466496e8a146a066a0cf284/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:05.058547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54824429-908c-4839-9bfc-54c6a7b3c52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a114e149d194b539c205b577895cbda, user_id=038876d23466496e8a146a066a0cf284, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:05.061314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54824429-908c-4839-9bfc-54c6a7b3c52e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:05.082992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a8188-ded5-48bd-8ad3-4d255fb95ae4 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:05.095437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46e275-1615-428a-ba2a-aa5de411d7f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:05.096396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e275-1615-428a-ba2a-aa5de411d7f6 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:05.096396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e275-1615-428a-ba2a-aa5de411d7f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:05.096640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e275-1615-428a-ba2a-aa5de411d7f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:05.105555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-bf46e275-1615-428a-ba2a-aa5de411d7f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:05.241115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 877/1741] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:04 2022] PUT /identity/v3/projects/1a114e149d194b539c205b577895cbda/users/038876d23466496e8a146a066a0cf284/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:05.252693 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526a134-9e8a-452b-bd63-122652f66900 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:05.253063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526a134-9e8a-452b-bd63-122652f66900 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:05.253348 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526a134-9e8a-452b-bd63-122652f66900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:05.330720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46e275-1615-428a-ba2a-aa5de411d7f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:05.330720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46e275-1615-428a-ba2a-aa5de411d7f6 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:05.341619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-f526a134-9e8a-452b-bd63-122652f66900 None None] MFA Rules not processed for user `038876d23466496e8a146a066a0cf284`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:05.342869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f526a134-9e8a-452b-bd63-122652f66900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:05.369049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 865/1742] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:05.375303 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f365b-8dbf-4209-a2df-818511b01973 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:05.375589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f365b-8dbf-4209-a2df-818511b01973 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:05.375928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f365b-8dbf-4209-a2df-818511b01973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:05.429051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 878/1743] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:05.433866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526a134-9e8a-452b-bd63-122652f66900 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:05.458606 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a30f365b-8dbf-4209-a2df-818511b01973 None None] MFA Rules not processed for user `60efa77075d94402a0cb8e9e427772cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:05.462843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a30f365b-8dbf-4209-a2df-818511b01973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:05.532653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526a134-9e8a-452b-bd63-122652f66900 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:05.539018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15870d1-f464-436a-9df0-9a8c0ae42f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:05.540262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15870d1-f464-436a-9df0-9a8c0ae42f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:05.540721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15870d1-f464-436a-9df0-9a8c0ae42f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:05.541145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15870d1-f464-436a-9df0-9a8c0ae42f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:05.541938 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15870d1-f464-436a-9df0-9a8c0ae42f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:05.544438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15870d1-f464-436a-9df0-9a8c0ae42f41 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:05.611056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 866/1744] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:05.694386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 879/1745] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:05 2022] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:05.698692 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f365b-8dbf-4209-a2df-818511b01973 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:05.742092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f365b-8dbf-4209-a2df-818511b01973 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:05.849100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32b68c-6e37-4df3-963e-d38705904b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:05.862695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32b68c-6e37-4df3-963e-d38705904b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:05.862695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32b68c-6e37-4df3-963e-d38705904b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:05.862695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32b68c-6e37-4df3-963e-d38705904b8c admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:05.863771 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32b68c-6e37-4df3-963e-d38705904b8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:05.866067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32b68c-6e37-4df3-963e-d38705904b8c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:05.905826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:05.964217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 867/1746] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:05 2022] POST /identity/v3/users => generated 300 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:05.968099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15870d1-f464-436a-9df0-9a8c0ae42f41 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:05.989060 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15870d1-f464-436a-9df0-9a8c0ae42f41 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:06.013995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824871b7-9bc2-4020-927b-e664c36a8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:06.014649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824871b7-9bc2-4020-927b-e664c36a8c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:06.015227 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824871b7-9bc2-4020-927b-e664c36a8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:06.015671 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824871b7-9bc2-4020-927b-e664c36a8c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:06.016715 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824871b7-9bc2-4020-927b-e664c36a8c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:06.023807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824871b7-9bc2-4020-927b-e664c36a8c30 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:06.033115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 880/1747] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:06.037492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32b68c-6e37-4df3-963e-d38705904b8c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:06.049396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32b68c-6e37-4df3-963e-d38705904b8c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:06.055783 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95665601-b48a-472d-accf-729252a7486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:06.056712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95665601-b48a-472d-accf-729252a7486c admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:06.057568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95665601-b48a-472d-accf-729252a7486c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:06.057955 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95665601-b48a-472d-accf-729252a7486c admin admin] PATH_INFO: `/v3/projects/ebbd71797c29498c8d70f4b22675bc44/users/368a7bc88f16418b97d54ffa4cda5006/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:06.101969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95665601-b48a-472d-accf-729252a7486c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbd71797c29498c8d70f4b22675bc44, user_id=368a7bc88f16418b97d54ffa4cda5006, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:06.105604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95665601-b48a-472d-accf-729252a7486c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:06.308176 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824871b7-9bc2-4020-927b-e664c36a8c30 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:06.310397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-824871b7-9bc2-4020-927b-e664c36a8c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:06.326984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824871b7-9bc2-4020-927b-e664c36a8c30 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:06.336125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:06.337147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:06.337582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:06.338006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] PATH_INFO: `/v3/projects/297b3bef927f46228f5b9600e5c2988e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:06.339492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=297b3bef927f46228f5b9600e5c2988e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:06.343212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:06.434993 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 868/1748] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:06 2022] PUT /identity/v3/projects/ebbd71797c29498c8d70f4b22675bc44/users/368a7bc88f16418b97d54ffa4cda5006/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:06.439623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95665601-b48a-472d-accf-729252a7486c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:06.516612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95665601-b48a-472d-accf-729252a7486c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:06.526615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bba20b-9339-48ca-af0b-6b3069c15e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:06.534635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bba20b-9339-48ca-af0b-6b3069c15e36 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:06.534635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bba20b-9339-48ca-af0b-6b3069c15e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:06.534635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bba20b-9339-48ca-af0b-6b3069c15e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:06.534635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bba20b-9339-48ca-af0b-6b3069c15e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:06.534635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bba20b-9339-48ca-af0b-6b3069c15e36 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:06.543165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297b3bef927f46228f5b9600e5c2988e', 'request_id': 'req-6df04bc3-d6df-4c51-b00a-5e048e2da356'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:06.551232 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 869/1749] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:06.556821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bba20b-9339-48ca-af0b-6b3069c15e36 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:06.573318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bba20b-9339-48ca-af0b-6b3069c15e36 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:06.644325 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297b3bef927f46228f5b9600e5c2988e', 'request_id': 'req-6df04bc3-d6df-4c51-b00a-5e048e2da356'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:06.655356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297b3bef927f46228f5b9600e5c2988e', 'request_id': 'req-6df04bc3-d6df-4c51-b00a-5e048e2da356'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:06.667739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] The token cache is being invalidate because project 297b3bef927f46228f5b9600e5c2988e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:06.668373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:06.669309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:06.669946 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23057c5f-47f4-400e-bdfa-320de581a5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:06.671340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 881/1750] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:06 2022] DELETE /identity/v3/projects/297b3bef927f46228f5b9600e5c2988e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:06.675654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:06.679619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:06.692088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23057c5f-47f4-400e-bdfa-320de581a5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:06.692088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23057c5f-47f4-400e-bdfa-320de581a5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:06.708568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23057c5f-47f4-400e-bdfa-320de581a5a1 admin admin] PATH_INFO: `/v3/projects/ebbd71797c29498c8d70f4b22675bc44/users/368a7bc88f16418b97d54ffa4cda5006/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:06.708568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23057c5f-47f4-400e-bdfa-320de581a5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbd71797c29498c8d70f4b22675bc44, user_id=368a7bc88f16418b97d54ffa4cda5006, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:06.708568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23057c5f-47f4-400e-bdfa-320de581a5a1 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:06.714417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df04bc3-d6df-4c51-b00a-5e048e2da356 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:06.749127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 870/1751] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:06 2022] PUT /identity/v3/projects/ebbd71797c29498c8d70f4b22675bc44/users/368a7bc88f16418b97d54ffa4cda5006/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:06.751546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32f1d-46dc-46f2-82c7-fd579744c601 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:06.752114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32f1d-46dc-46f2-82c7-fd579744c601 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:06.752682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32f1d-46dc-46f2-82c7-fd579744c601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:06.813057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-84a32f1d-46dc-46f2-82c7-fd579744c601 None None] MFA Rules not processed for user `368a7bc88f16418b97d54ffa4cda5006`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:06.815476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-84a32f1d-46dc-46f2-82c7-fd579744c601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:06.890522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cdad1-d288-43b0-aaec-2efc22e101ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:06.891269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cdad1-d288-43b0-aaec-2efc22e101ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:06.892048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cdad1-d288-43b0-aaec-2efc22e101ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:06.892507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cdad1-d288-43b0-aaec-2efc22e101ee admin admin] PATH_INFO: `/v3/users/c2029b1719f64996ba91d833ce545099` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:06.897607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cdad1-d288-43b0-aaec-2efc22e101ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2029b1719f64996ba91d833ce545099)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:06.899583 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cdad1-d288-43b0-aaec-2efc22e101ee admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:07.003817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 871/1752] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:07.019619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32f1d-46dc-46f2-82c7-fd579744c601 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:07.021616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-84a32f1d-46dc-46f2-82c7-fd579744c601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:07.162053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:07.167086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32f1d-46dc-46f2-82c7-fd579744c601 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:07.182838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222fa93-f5bf-4bbc-bc05-914513e5b047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:07.193275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222fa93-f5bf-4bbc-bc05-914513e5b047 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:07.193722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222fa93-f5bf-4bbc-bc05-914513e5b047 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:07.195016 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222fa93-f5bf-4bbc-bc05-914513e5b047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:07.273954 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222fa93-f5bf-4bbc-bc05-914513e5b047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:07.286345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222fa93-f5bf-4bbc-bc05-914513e5b047 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:07.331570 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 872/1753] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:07.365390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:07.461817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6d5cdad1-d288-43b0-aaec-2efc22e101ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2029b1719f64996ba91d833ce545099'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:07.463285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6d5cdad1-d288-43b0-aaec-2efc22e101ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2029b1719f64996ba91d833ce545099'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:07.497431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6d5cdad1-d288-43b0-aaec-2efc22e101ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2029b1719f64996ba91d833ce545099'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:07.498613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6d5cdad1-d288-43b0-aaec-2efc22e101ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2029b1719f64996ba91d833ce545099'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:07.525982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6d5cdad1-d288-43b0-aaec-2efc22e101ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2029b1719f64996ba91d833ce545099'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:07.613908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222fa93-f5bf-4bbc-bc05-914513e5b047 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:07.616594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d222fa93-f5bf-4bbc-bc05-914513e5b047 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:07.673688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222fa93-f5bf-4bbc-bc05-914513e5b047 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:07.680369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:07.694562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:07.696182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:07.697766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] PATH_INFO: `/v3/users/038876d23466496e8a146a066a0cf284` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:07.707861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] RBAC: Authorizing `identity:delete_user(user_id=038876d23466496e8a146a066a0cf284)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:07.715430 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:07.737265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 882/1754] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:06 2022] DELETE /identity/v3/users/c2029b1719f64996ba91d833ce545099 => generated 0 bytes in 1059 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:08.048595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038876d23466496e8a146a066a0cf284'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:08.049560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038876d23466496e8a146a066a0cf284'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:08.050220 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038876d23466496e8a146a066a0cf284'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:08.072522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038876d23466496e8a146a066a0cf284'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:08.205096 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038876d23466496e8a146a066a0cf284'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:08.248133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08973-2507-49de-b67d-9e9b9cdd4896 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.248748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08973-2507-49de-b67d-9e9b9cdd4896 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.249032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea08973-2507-49de-b67d-9e9b9cdd4896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.254948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 873/1755] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:07 2022] DELETE /identity/v3/users/038876d23466496e8a146a066a0cf284 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:08.294363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-3ea08973-2507-49de-b67d-9e9b9cdd4896 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:08.298452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3ea08973-2507-49de-b67d-9e9b9cdd4896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:08.407052 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 883/1756] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:08.725765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:08.727610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:08.796871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a8aa-e196-4dd1-b1a6-1cf262187120 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.797678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a8aa-e196-4dd1-b1a6-1cf262187120 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.798189 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8a8aa-e196-4dd1-b1a6-1cf262187120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.932850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129211c-7ba9-4e0d-8ef8-50a0a74e044b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:08.953368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcaea2-022f-4d30-a488-abf67617ad19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:08.957386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcaea2-022f-4d30-a488-abf67617ad19 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.957975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcaea2-022f-4d30-a488-abf67617ad19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.958802 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcaea2-022f-4d30-a488-abf67617ad19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.981780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-85f8a8aa-e196-4dd1-b1a6-1cf262187120 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:08.990492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-85f8a8aa-e196-4dd1-b1a6-1cf262187120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:08.999415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcaea2-022f-4d30-a488-abf67617ad19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:09.006351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcaea2-022f-4d30-a488-abf67617ad19 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:09.042594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 874/1757] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:09.151277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 884/1758] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:17:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:09.512634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:09.668058 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109754d0-2607-43a6-bb85-a5433ed96221 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:09.669214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109754d0-2607-43a6-bb85-a5433ed96221 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:09.669907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109754d0-2607-43a6-bb85-a5433ed96221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:09.686116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8a8aa-e196-4dd1-b1a6-1cf262187120 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:09.687678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-85f8a8aa-e196-4dd1-b1a6-1cf262187120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:09.782892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-109754d0-2607-43a6-bb85-a5433ed96221 None None] MFA Rules not processed for user `a0ad0c892c464a7ab40a683ca588963a`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:09.783891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-109754d0-2607-43a6-bb85-a5433ed96221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:09.880038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:09.897090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 875/1759] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:10.225173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8a8aa-e196-4dd1-b1a6-1cf262187120 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:10.244637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e9d43-2869-4430-9718-aaff651f0569 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:10.245757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e9d43-2869-4430-9718-aaff651f0569 service swift] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:10.246239 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e9d43-2869-4430-9718-aaff651f0569 service swift] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:10.246736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e9d43-2869-4430-9718-aaff651f0569 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:10.288056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e9d43-2869-4430-9718-aaff651f0569 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:10.298609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e9d43-2869-4430-9718-aaff651f0569 service swift] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:10.326874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 885/1760] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:17:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:17:10.543436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109754d0-2607-43a6-bb85-a5433ed96221 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:10.544814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-109754d0-2607-43a6-bb85-a5433ed96221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:10.565411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:10.577579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109754d0-2607-43a6-bb85-a5433ed96221 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:10.608530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:10.609247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:10.609620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:10.609842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] PATH_INFO: `/v3/projects/ad1c054398f7483c8d3a2da5839e352f` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:10.616769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1c054398f7483c8d3a2da5839e352f)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:10.619212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:11.078374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1c054398f7483c8d3a2da5839e352f', 'request_id': 'req-a8661ae2-93d4-4be9-aaf8-6100676fea33'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.159414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1c054398f7483c8d3a2da5839e352f', 'request_id': 'req-a8661ae2-93d4-4be9-aaf8-6100676fea33'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.182696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1c054398f7483c8d3a2da5839e352f', 'request_id': 'req-a8661ae2-93d4-4be9-aaf8-6100676fea33'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.209784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] The token cache is being invalidate because project ad1c054398f7483c8d3a2da5839e352f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:11.210295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.214084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a8661ae2-93d4-4be9-aaf8-6100676fea33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.230830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 876/1761] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:10 2022] DELETE /identity/v3/projects/ad1c054398f7483c8d3a2da5839e352f => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:11.237362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce208fb-0810-43e3-904c-cdba6f9c91f8 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:11.241016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce208fb-0810-43e3-904c-cdba6f9c91f8 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:11.241016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce208fb-0810-43e3-904c-cdba6f9c91f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:11.288800 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-8ce208fb-0810-43e3-904c-cdba6f9c91f8 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:11.290067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8ce208fb-0810-43e3-904c-cdba6f9c91f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:11.534284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:11.553998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:11.748652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 886/1762] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:11.751831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb1a49-fc21-41b1-88d9-ad864b0b1e33 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:11.752133 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb1a49-fc21-41b1-88d9-ad864b0b1e33 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:11.752675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb1a49-fc21-41b1-88d9-ad864b0b1e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:11.833309 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5dbb1a49-fc21-41b1-88d9-ad864b0b1e33 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:11.834673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5dbb1a49-fc21-41b1-88d9-ad864b0b1e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:11.881265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce208fb-0810-43e3-904c-cdba6f9c91f8 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:11.890972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 877/1763] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:11.900365 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce208fb-0810-43e3-904c-cdba6f9c91f8 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:11.925459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff588564-a16d-4da4-a26e-08aa91054136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:11.925459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff588564-a16d-4da4-a26e-08aa91054136 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:11.946889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff588564-a16d-4da4-a26e-08aa91054136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:11.946889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff588564-a16d-4da4-a26e-08aa91054136 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:11.946889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff588564-a16d-4da4-a26e-08aa91054136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:11.946889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff588564-a16d-4da4-a26e-08aa91054136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:11.988884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff588564-a16d-4da4-a26e-08aa91054136 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:12.030734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 887/1764] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:12.036664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb1a49-fc21-41b1-88d9-ad864b0b1e33 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:12.057597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb1a49-fc21-41b1-88d9-ad864b0b1e33 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:12.091848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9701fd1-fce2-4316-b893-36ce7ccc4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:12.092754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9701fd1-fce2-4316-b893-36ce7ccc4491 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:12.097206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9701fd1-fce2-4316-b893-36ce7ccc4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:12.097661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9701fd1-fce2-4316-b893-36ce7ccc4491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:12.105157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9701fd1-fce2-4316-b893-36ce7ccc4491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:12.109755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9701fd1-fce2-4316-b893-36ce7ccc4491 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:12.265790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 878/1765] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:12 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:12.272780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff588564-a16d-4da4-a26e-08aa91054136 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:12.379787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff588564-a16d-4da4-a26e-08aa91054136 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:12.676928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ded29f-abe9-4a0a-a1a9-a8a98352512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:12.679325 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded29f-abe9-4a0a-a1a9-a8a98352512a admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:12.680996 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded29f-abe9-4a0a-a1a9-a8a98352512a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:12.681447 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded29f-abe9-4a0a-a1a9-a8a98352512a admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:12.683021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ded29f-abe9-4a0a-a1a9-a8a98352512a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:12.695168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ded29f-abe9-4a0a-a1a9-a8a98352512a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:12.947476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275c4b4-a357-4be4-80fd-442efc7ab3c0 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:12.947476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275c4b4-a357-4be4-80fd-442efc7ab3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:12.947476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275c4b4-a357-4be4-80fd-442efc7ab3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:12.947476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1275c4b4-a357-4be4-80fd-442efc7ab3c0 None None] MFA Rules not processed for user `e303777e78b7499fbff457254d14d360`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:12.947476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1275c4b4-a357-4be4-80fd-442efc7ab3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:13.064154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 879/1766] 10.222.0.30 () {58 vars in 1015 bytes} [Wed Aug 24 17:17:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:13.138185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275c4b4-a357-4be4-80fd-442efc7ab3c0 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:13.145795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1275c4b4-a357-4be4-80fd-442efc7ab3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:13.159960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275c4b4-a357-4be4-80fd-442efc7ab3c0 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:13.167776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec70e21-72ad-4d4e-9d12-7fac280497cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:13.168287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec70e21-72ad-4d4e-9d12-7fac280497cf service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:13.177283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec70e21-72ad-4d4e-9d12-7fac280497cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:13.185849 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 888/1767] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:12 2022] POST /identity/v3/users => generated 294 bytes in 917 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:13.185849 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ded29f-abe9-4a0a-a1a9-a8a98352512a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:13.187707 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec70e21-72ad-4d4e-9d12-7fac280497cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:13.189632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-27ded29f-abe9-4a0a-a1a9-a8a98352512a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:13.229486 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec70e21-72ad-4d4e-9d12-7fac280497cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:13.233924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec70e21-72ad-4d4e-9d12-7fac280497cf service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:13.254766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ded29f-abe9-4a0a-a1a9-a8a98352512a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:13.272919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 880/1768] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:13.274619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:13.276413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:13.283898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:13.283898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] PATH_INFO: `/v3/projects/1a114e149d194b539c205b577895cbda` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:13.284212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec70e21-72ad-4d4e-9d12-7fac280497cf service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:13.284343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a114e149d194b539c205b577895cbda)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:13.308269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:13.360677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec70e21-72ad-4d4e-9d12-7fac280497cf service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:13.392990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2c6e5-9f56-427e-8999-7ddcb3da6d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:13.393636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2c6e5-9f56-427e-8999-7ddcb3da6d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:13.393923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2c6e5-9f56-427e-8999-7ddcb3da6d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:13.394728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa2c6e5-9f56-427e-8999-7ddcb3da6d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:13.394856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2c6e5-9f56-427e-8999-7ddcb3da6d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:13.404805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa2c6e5-9f56-427e-8999-7ddcb3da6d42 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:13.465762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 881/1769] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:13.473056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2c6e5-9f56-427e-8999-7ddcb3da6d42 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:13.554983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa2c6e5-9f56-427e-8999-7ddcb3da6d42 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:13.601445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ed432-38b4-49d0-9616-82cd579034bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:13.605047 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ed432-38b4-49d0-9616-82cd579034bd admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:13.611211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ed432-38b4-49d0-9616-82cd579034bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:13.611773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ed432-38b4-49d0-9616-82cd579034bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:13.614234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ed432-38b4-49d0-9616-82cd579034bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:13.620192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ed432-38b4-49d0-9616-82cd579034bd admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:13.674208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a114e149d194b539c205b577895cbda', 'request_id': 'req-0fb91f5b-8916-4692-af61-09a5c216d3e1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:13.680286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 882/1770] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:13 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:13.686117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ed432-38b4-49d0-9616-82cd579034bd admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:13.724822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ed432-38b4-49d0-9616-82cd579034bd admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:13.873177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a114e149d194b539c205b577895cbda', 'request_id': 'req-0fb91f5b-8916-4692-af61-09a5c216d3e1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:13.882573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a114e149d194b539c205b577895cbda', 'request_id': 'req-0fb91f5b-8916-4692-af61-09a5c216d3e1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:13.933503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] The token cache is being invalidate because project 1a114e149d194b539c205b577895cbda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:13.936670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:13.938681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:13.942873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a0dba-9690-4731-9d61-e06c0bd60022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:13.943925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a0dba-9690-4731-9d61-e06c0bd60022 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:13.944437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a0dba-9690-4731-9d61-e06c0bd60022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:13.944897 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a0dba-9690-4731-9d61-e06c0bd60022 admin admin] PATH_INFO: `/v3/projects/ef0d65939a764093a9da2eebdb9ae86e/users/ab2b5f27fc3f44da998f0624ffa0521f/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:13.946560 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 889/1771] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:13 2022] DELETE /identity/v3/projects/1a114e149d194b539c205b577895cbda => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:13.947562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:13.953674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:14.023886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:14.024450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb91f5b-8916-4692-af61-09a5c216d3e1 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:14.024615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a0dba-9690-4731-9d61-e06c0bd60022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0d65939a764093a9da2eebdb9ae86e, user_id=ab2b5f27fc3f44da998f0624ffa0521f, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:14.024615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a0dba-9690-4731-9d61-e06c0bd60022 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:14.048138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:14.054540 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:14.054928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:14.055213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] PATH_INFO: `/v3/users/368a7bc88f16418b97d54ffa4cda5006` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:14.076001 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] RBAC: Authorizing `identity:delete_user(user_id=368a7bc88f16418b97d54ffa4cda5006)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:14.083153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:14.247963 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 883/1772] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:13 2022] PUT /identity/v3/projects/ef0d65939a764093a9da2eebdb9ae86e/users/ab2b5f27fc3f44da998f0624ffa0521f/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:14.261657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac0d4-0d5c-4bd5-a224-b33aae646b17 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:14.261961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac0d4-0d5c-4bd5-a224-b33aae646b17 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:14.262254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac0d4-0d5c-4bd5-a224-b33aae646b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:14.406150 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8cdac0d4-0d5c-4bd5-a224-b33aae646b17 None None] MFA Rules not processed for user `ab2b5f27fc3f44da998f0624ffa0521f`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:14.409657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8cdac0d4-0d5c-4bd5-a224-b33aae646b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:14.600865 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368a7bc88f16418b97d54ffa4cda5006'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:14.607004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368a7bc88f16418b97d54ffa4cda5006'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:14.648134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368a7bc88f16418b97d54ffa4cda5006'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:14.660807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368a7bc88f16418b97d54ffa4cda5006'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:14.761318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 884/1773] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:14.762410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdac0d4-0d5c-4bd5-a224-b33aae646b17 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:14.768422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368a7bc88f16418b97d54ffa4cda5006'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:14.771956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8cdac0d4-0d5c-4bd5-a224-b33aae646b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:14.892052 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 890/1774] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:13 2022] DELETE /identity/v3/users/368a7bc88f16418b97d54ffa4cda5006 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:15.022435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdac0d4-0d5c-4bd5-a224-b33aae646b17 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:15.056532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:15.305411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8938c-e3d1-425b-818e-b2e8200436b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:15.305411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8938c-e3d1-425b-818e-b2e8200436b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:15.305411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8938c-e3d1-425b-818e-b2e8200436b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:15.305411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8938c-e3d1-425b-818e-b2e8200436b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:15.315032 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8938c-e3d1-425b-818e-b2e8200436b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:15.315032 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8938c-e3d1-425b-818e-b2e8200436b9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:15.447199 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:15.449988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:15.549277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 885/1775] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:14 2022] POST /identity/v3/projects => generated 387 bytes in 787 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:15.554571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8938c-e3d1-425b-818e-b2e8200436b9 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:15.804221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38547-dd5b-4ae6-858e-e733266f381e admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:15.861506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8938c-e3d1-425b-818e-b2e8200436b9 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:15.887594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349d138-d303-4e6f-9353-f3adefcd0494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:15.888375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d138-d303-4e6f-9353-f3adefcd0494 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:15.889681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d138-d303-4e6f-9353-f3adefcd0494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:15.890114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d138-d303-4e6f-9353-f3adefcd0494 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:15.891111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349d138-d303-4e6f-9353-f3adefcd0494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:15.901226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349d138-d303-4e6f-9353-f3adefcd0494 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:16.006168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 886/1776] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:15 2022] POST /identity/v3/users => generated 294 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:16.010161 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349d138-d303-4e6f-9353-f3adefcd0494 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:16.026969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349d138-d303-4e6f-9353-f3adefcd0494 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:16.035455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f7591-dac2-4700-8000-8595a09ca8ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:16.038264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7591-dac2-4700-8000-8595a09ca8ec service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:16.039728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7591-dac2-4700-8000-8595a09ca8ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:16.039728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f7591-dac2-4700-8000-8595a09ca8ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:16.045051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-834f7591-dac2-4700-8000-8595a09ca8ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:16.048025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0597b-8f24-4719-9472-ba6d1819dda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:16.048950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0597b-8f24-4719-9472-ba6d1819dda4 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:16.049436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0597b-8f24-4719-9472-ba6d1819dda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:16.049853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0597b-8f24-4719-9472-ba6d1819dda4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:16.050634 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0597b-8f24-4719-9472-ba6d1819dda4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:16.063439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e0597b-8f24-4719-9472-ba6d1819dda4 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:16.122876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 887/1777] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:16.124364 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0597b-8f24-4719-9472-ba6d1819dda4 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:16.178590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0597b-8f24-4719-9472-ba6d1819dda4 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:16.237372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d397ee-c1a6-4b49-9949-7457244befd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:16.238084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d397ee-c1a6-4b49-9949-7457244befd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:16.238562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d397ee-c1a6-4b49-9949-7457244befd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:16.238994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d397ee-c1a6-4b49-9949-7457244befd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:16.239878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d397ee-c1a6-4b49-9949-7457244befd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:16.246559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d397ee-c1a6-4b49-9949-7457244befd9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:16.286864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 888/1778] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:16.295839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d397ee-c1a6-4b49-9949-7457244befd9 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:16.323733 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d397ee-c1a6-4b49-9949-7457244befd9 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:16.344900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d14155-59a8-473c-8cfe-229d45c67ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:16.345845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d14155-59a8-473c-8cfe-229d45c67ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:16.346139 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d14155-59a8-473c-8cfe-229d45c67ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:16.346526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d14155-59a8-473c-8cfe-229d45c67ea4 admin admin] PATH_INFO: `/v3/projects/1cb0e3d44a844f5b8666965de20199f7/users/c2531ea82700419cae6c9bf86b180854/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:16.398762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f7591-dac2-4700-8000-8595a09ca8ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:16.402886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f7591-dac2-4700-8000-8595a09ca8ec service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:16.403308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d14155-59a8-473c-8cfe-229d45c67ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb0e3d44a844f5b8666965de20199f7, user_id=c2531ea82700419cae6c9bf86b180854, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:16.408146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d14155-59a8-473c-8cfe-229d45c67ea4 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:16.447041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 891/1779] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 1001 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:16.544671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 889/1780] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:16 2022] PUT /identity/v3/projects/1cb0e3d44a844f5b8666965de20199f7/users/c2531ea82700419cae6c9bf86b180854/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:16.574059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676773f3-455a-4874-8d61-8eef6a80ba3f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:16.574059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676773f3-455a-4874-8d61-8eef6a80ba3f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:16.574059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676773f3-455a-4874-8d61-8eef6a80ba3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:16.664747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-676773f3-455a-4874-8d61-8eef6a80ba3f None None] MFA Rules not processed for user `c2531ea82700419cae6c9bf86b180854`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:16.667629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-676773f3-455a-4874-8d61-8eef6a80ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:17.062105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 892/1781] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:17.068504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d14155-59a8-473c-8cfe-229d45c67ea4 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:17.160083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:17.375938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d14155-59a8-473c-8cfe-229d45c67ea4 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:17.388562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1c5df-f48e-454f-8148-d987f3880c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:17.393217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1c5df-f48e-454f-8148-d987f3880c18 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:17.393638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1c5df-f48e-454f-8148-d987f3880c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:17.393797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1c5df-f48e-454f-8148-d987f3880c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:17.397907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1c5df-f48e-454f-8148-d987f3880c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:17.404934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1c5df-f48e-454f-8148-d987f3880c18 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:17.843235 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 890/1782] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:17 2022] POST /identity/v3/projects => generated 387 bytes in 775 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:17:17.991126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676773f3-455a-4874-8d61-8eef6a80ba3f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:17.991126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676773f3-455a-4874-8d61-8eef6a80ba3f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:18.213986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686cc44-1183-41d1-b404-657a9344b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:18.220527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686cc44-1183-41d1-b404-657a9344b4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:18.225562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686cc44-1183-41d1-b404-657a9344b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:18.228052 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686cc44-1183-41d1-b404-657a9344b4e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:18.229954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686cc44-1183-41d1-b404-657a9344b4e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:18.248720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686cc44-1183-41d1-b404-657a9344b4e3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:18.379520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:18.801021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 893/1783] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:17 2022] POST /identity/v3/users => generated 300 bytes in 847 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:18.805078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1c5df-f48e-454f-8148-d987f3880c18 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:18.880142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1c5df-f48e-454f-8148-d987f3880c18 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:18.908353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981183-f511-43e3-9e2c-6e5437584647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:18.910292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981183-f511-43e3-9e2c-6e5437584647 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:18.910949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981183-f511-43e3-9e2c-6e5437584647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:18.911412 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00981183-f511-43e3-9e2c-6e5437584647 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:18.914030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00981183-f511-43e3-9e2c-6e5437584647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:18.920613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00981183-f511-43e3-9e2c-6e5437584647 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:18.950237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 891/1784] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:18.955686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686cc44-1183-41d1-b404-657a9344b4e3 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:18.988078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686cc44-1183-41d1-b404-657a9344b4e3 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:18.995856 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fefb9e-0542-4284-9681-4568752218e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:18.997648 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fefb9e-0542-4284-9681-4568752218e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:18.998141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fefb9e-0542-4284-9681-4568752218e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:19.000016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fefb9e-0542-4284-9681-4568752218e4 admin admin] PATH_INFO: `/v3/projects/6b3f7d850d86495fa807b87174244c1e/users/1be8fc50c47b4279a042e48af93fcb8b/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:19.023945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fefb9e-0542-4284-9681-4568752218e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3f7d850d86495fa807b87174244c1e, user_id=1be8fc50c47b4279a042e48af93fcb8b, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:19.031042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fefb9e-0542-4284-9681-4568752218e4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:19.389886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 894/1785] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:18 2022] PUT /identity/v3/projects/6b3f7d850d86495fa807b87174244c1e/users/1be8fc50c47b4279a042e48af93fcb8b/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:19.394624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981183-f511-43e3-9e2c-6e5437584647 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:19.409307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fefb9e-0542-4284-9681-4568752218e4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:19.412466 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-36fefb9e-0542-4284-9681-4568752218e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:19.458054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00981183-f511-43e3-9e2c-6e5437584647 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:19.757184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d984f-3260-410e-8cc7-cbade2e2e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:19.762592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d984f-3260-410e-8cc7-cbade2e2e824 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:19.763790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d984f-3260-410e-8cc7-cbade2e2e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:19.764212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d984f-3260-410e-8cc7-cbade2e2e824 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:19.767418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d984f-3260-410e-8cc7-cbade2e2e824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:19.769588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d984f-3260-410e-8cc7-cbade2e2e824 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:19.783773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fefb9e-0542-4284-9681-4568752218e4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:19.975017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 892/1786] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:19.975017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892db804-e156-4eaf-97e1-9e3cea431d0e None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:19.975017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892db804-e156-4eaf-97e1-9e3cea431d0e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:19.975017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892db804-e156-4eaf-97e1-9e3cea431d0e None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:19.975017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 893/1787] 10.222.0.20 () {54 vars in 921 bytes} [Wed Aug 24 17:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:17:19.975954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:19.975954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:19.975954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:19.975954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] PATH_INFO: `/v3/projects/ebbd71797c29498c8d70f4b22675bc44` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:19.976549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbd71797c29498c8d70f4b22675bc44)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:19.976549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:19.976780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a78cf-5374-47f7-af9f-2ed7eb661675 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:19.976780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a78cf-5374-47f7-af9f-2ed7eb661675 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:19.976780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a78cf-5374-47f7-af9f-2ed7eb661675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:19.976780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-286a78cf-5374-47f7-af9f-2ed7eb661675 None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:19.976780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-286a78cf-5374-47f7-af9f-2ed7eb661675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:20.102230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 894/1788] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Aug 24 17:17:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:20.103193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a78cf-5374-47f7-af9f-2ed7eb661675 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:20.129633 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a78cf-5374-47f7-af9f-2ed7eb661675 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:20.137851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97235836-b354-4897-8fc3-dc1158b8edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:20.139036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97235836-b354-4897-8fc3-dc1158b8edf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:20.139958 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97235836-b354-4897-8fc3-dc1158b8edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:20.140629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97235836-b354-4897-8fc3-dc1158b8edf1 admin admin] PATH_INFO: `/v3/projects/6b3f7d850d86495fa807b87174244c1e/users/1be8fc50c47b4279a042e48af93fcb8b/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:20.148166 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97235836-b354-4897-8fc3-dc1158b8edf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3f7d850d86495fa807b87174244c1e, user_id=1be8fc50c47b4279a042e48af93fcb8b, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:20.148166 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97235836-b354-4897-8fc3-dc1158b8edf1 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:20.166869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 895/1789] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:20 2022] PUT /identity/v3/projects/6b3f7d850d86495fa807b87174244c1e/users/1be8fc50c47b4279a042e48af93fcb8b/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:20.187225 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33998e-5d6c-4c20-b39f-b81d71514e90 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:20.188395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33998e-5d6c-4c20-b39f-b81d71514e90 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:20.189721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33998e-5d6c-4c20-b39f-b81d71514e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:20.260638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5f33998e-5d6c-4c20-b39f-b81d71514e90 None None] MFA Rules not processed for user `1be8fc50c47b4279a042e48af93fcb8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:20.277716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5f33998e-5d6c-4c20-b39f-b81d71514e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:20.358030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbd71797c29498c8d70f4b22675bc44', 'request_id': 'req-dae31afc-d7bd-497b-b563-d4e33779095e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:20.499864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 896/1790] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:20.516814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33998e-5d6c-4c20-b39f-b81d71514e90 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:20.521722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5f33998e-5d6c-4c20-b39f-b81d71514e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:20.639816 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbd71797c29498c8d70f4b22675bc44', 'request_id': 'req-dae31afc-d7bd-497b-b563-d4e33779095e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:20.650741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbd71797c29498c8d70f4b22675bc44', 'request_id': 'req-dae31afc-d7bd-497b-b563-d4e33779095e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:20.695353 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] The token cache is being invalidate because project ebbd71797c29498c8d70f4b22675bc44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:20.697387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:20.699767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-dae31afc-d7bd-497b-b563-d4e33779095e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:20.708283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 895/1791] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:19 2022] DELETE /identity/v3/projects/ebbd71797c29498c8d70f4b22675bc44 => generated 0 bytes in 1300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:20.714246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122feb2a-d513-4de6-83d0-a612a92b8577 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:20.720028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122feb2a-d513-4de6-83d0-a612a92b8577 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:20.720028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122feb2a-d513-4de6-83d0-a612a92b8577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:20.744184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33998e-5d6c-4c20-b39f-b81d71514e90 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:20.798246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-122feb2a-d513-4de6-83d0-a612a92b8577 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:20.804138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-122feb2a-d513-4de6-83d0-a612a92b8577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:20.962451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35658d87-e461-4969-b0ac-2e9b7b3b36f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:20.964211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35658d87-e461-4969-b0ac-2e9b7b3b36f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:20.964535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35658d87-e461-4969-b0ac-2e9b7b3b36f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:20.965381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35658d87-e461-4969-b0ac-2e9b7b3b36f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:20.968854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-35658d87-e461-4969-b0ac-2e9b7b3b36f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:21.026066 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 896/1792] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:21.036034 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa83f5-2534-4af2-bc87-9b837c443009 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:21.036313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa83f5-2534-4af2-bc87-9b837c443009 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:21.036578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaa83f5-2534-4af2-bc87-9b837c443009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:21.106546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-adaa83f5-2534-4af2-bc87-9b837c443009 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:21.108311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-adaa83f5-2534-4af2-bc87-9b837c443009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:21.127095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 897/1793] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:21.132847 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa83f5-2534-4af2-bc87-9b837c443009 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:21.165652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35658d87-e461-4969-b0ac-2e9b7b3b36f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:21.166703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaa83f5-2534-4af2-bc87-9b837c443009 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:21.166855 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35658d87-e461-4969-b0ac-2e9b7b3b36f0 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:21.180137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f8387-b2ea-4378-b111-f8348ae4ebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:21.180796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f8387-b2ea-4378-b111-f8348ae4ebf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:21.181088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f8387-b2ea-4378-b111-f8348ae4ebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:21.181421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f8387-b2ea-4378-b111-f8348ae4ebf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:21.182330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f8387-b2ea-4378-b111-f8348ae4ebf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:21.182650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f8387-b2ea-4378-b111-f8348ae4ebf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:21.190104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f8387-b2ea-4378-b111-f8348ae4ebf0 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:21.196780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 897/1794] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:21.237504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 898/1795] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:21.241812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35658d87-e461-4969-b0ac-2e9b7b3b36f0 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:21.261314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35658d87-e461-4969-b0ac-2e9b7b3b36f0 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:21.277857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11437efc-59e5-46d5-b878-da6a2ba4ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:21.279446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437efc-59e5-46d5-b878-da6a2ba4ec7f admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:21.279923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437efc-59e5-46d5-b878-da6a2ba4ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:21.280412 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437efc-59e5-46d5-b878-da6a2ba4ec7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:21.281883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11437efc-59e5-46d5-b878-da6a2ba4ec7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:21.314590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11437efc-59e5-46d5-b878-da6a2ba4ec7f admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:21.499467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 898/1796] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:21 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:17:21.504817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f8387-b2ea-4378-b111-f8348ae4ebf0 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:21.517538 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb99aa0-adb6-4922-91c1-7b6cec746489 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:21.517848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb99aa0-adb6-4922-91c1-7b6cec746489 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:21.518115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb99aa0-adb6-4922-91c1-7b6cec746489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:21.521047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f8387-b2ea-4378-b111-f8348ae4ebf0 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:21.584285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ecb99aa0-adb6-4922-91c1-7b6cec746489 None None] MFA Rules not processed for user `9b22f661cc524dd2a58a499badb8e661`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:21.584285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ecb99aa0-adb6-4922-91c1-7b6cec746489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:21.799827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269123cb-66ce-4eea-940a-20b6813ff0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:21.799827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269123cb-66ce-4eea-940a-20b6813ff0fc admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:21.799827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269123cb-66ce-4eea-940a-20b6813ff0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:21.799827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269123cb-66ce-4eea-940a-20b6813ff0fc admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:21.801251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269123cb-66ce-4eea-940a-20b6813ff0fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:21.824457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269123cb-66ce-4eea-940a-20b6813ff0fc admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:21.834431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 899/1797] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:21.836114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb99aa0-adb6-4922-91c1-7b6cec746489 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:21.837873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ecb99aa0-adb6-4922-91c1-7b6cec746489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:21.976325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb99aa0-adb6-4922-91c1-7b6cec746489 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:21.985151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fab14-4093-478f-acbc-72aff4aaff65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:21.986402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fab14-4093-478f-acbc-72aff4aaff65 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:21.986859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fab14-4093-478f-acbc-72aff4aaff65 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:21.987305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fab14-4093-478f-acbc-72aff4aaff65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:21.990331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2e9fab14-4093-478f-acbc-72aff4aaff65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:22.007813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fab14-4093-478f-acbc-72aff4aaff65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:22.010005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fab14-4093-478f-acbc-72aff4aaff65 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:22.025595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 900/1798] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:22.027099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bdb03-2190-4dc9-a298-c2fef2f81c89 None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:22.027388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bdb03-2190-4dc9-a298-c2fef2f81c89 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:22.027722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bdb03-2190-4dc9-a298-c2fef2f81c89 None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:22.029632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 901/1799] 10.222.0.20 () {54 vars in 921 bytes} [Wed Aug 24 17:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:17:22.305549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f6995-dc94-46eb-a97f-179707e01523 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:22.305549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f6995-dc94-46eb-a97f-179707e01523 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:22.305549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f6995-dc94-46eb-a97f-179707e01523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:22.305549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6b5f6995-dc94-46eb-a97f-179707e01523 None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:22.305549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6b5f6995-dc94-46eb-a97f-179707e01523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:22.305549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 902/1800] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Aug 24 17:17:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:22.473682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 899/1801] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:21 2022] POST /identity/v3/users => generated 293 bytes in 972 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:22.483027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f6995-dc94-46eb-a97f-179707e01523 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:22.503381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f6995-dc94-46eb-a97f-179707e01523 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:22.517270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12315ce9-da87-46e5-a6d8-28ed1225dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:22.519241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315ce9-da87-46e5-a6d8-28ed1225dbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:22.519888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315ce9-da87-46e5-a6d8-28ed1225dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:22.520550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12315ce9-da87-46e5-a6d8-28ed1225dbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:22.521487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12315ce9-da87-46e5-a6d8-28ed1225dbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:22.524289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12315ce9-da87-46e5-a6d8-28ed1225dbf7 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:22.571880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 903/1802] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:17:22.574711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269123cb-66ce-4eea-940a-20b6813ff0fc admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:22.595340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269123cb-66ce-4eea-940a-20b6813ff0fc admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:22.640140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bb386-2238-4cbd-b441-8e17ff093639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:22.641885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb386-2238-4cbd-b441-8e17ff093639 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:22.642565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb386-2238-4cbd-b441-8e17ff093639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:22.643233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bb386-2238-4cbd-b441-8e17ff093639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:22.644168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bb386-2238-4cbd-b441-8e17ff093639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:22.647991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bb386-2238-4cbd-b441-8e17ff093639 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:22.705289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 900/1803] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:22.709921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12315ce9-da87-46e5-a6d8-28ed1225dbf7 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:22.724126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12315ce9-da87-46e5-a6d8-28ed1225dbf7 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:22.755549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d21085-17f4-4628-a667-4c9adbbbb12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:22.756574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d21085-17f4-4628-a667-4c9adbbbb12e admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:22.758880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d21085-17f4-4628-a667-4c9adbbbb12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:22.759303 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d21085-17f4-4628-a667-4c9adbbbb12e admin admin] PATH_INFO: `/v3/projects/fc24f10e6b3e4855b55d03eb7f0dfd7b/users/2249093983fc412aa5ecebe22f889f74/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:22.849723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d21085-17f4-4628-a667-4c9adbbbb12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc24f10e6b3e4855b55d03eb7f0dfd7b, user_id=2249093983fc412aa5ecebe22f889f74, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:22.852838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d21085-17f4-4628-a667-4c9adbbbb12e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:23.116098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 904/1804] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:22 2022] PUT /identity/v3/projects/fc24f10e6b3e4855b55d03eb7f0dfd7b/users/2249093983fc412aa5ecebe22f889f74/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:23.128349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cdcea-5b90-4afe-acc1-69aa748edb23 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:23.129392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cdcea-5b90-4afe-acc1-69aa748edb23 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:23.129891 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cdcea-5b90-4afe-acc1-69aa748edb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:23.166200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d21085-17f4-4628-a667-4c9adbbbb12e admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:23.207682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:23.242711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-a59cdcea-5b90-4afe-acc1-69aa748edb23 None None] MFA Rules not processed for user `2249093983fc412aa5ecebe22f889f74`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:23.244042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a59cdcea-5b90-4afe-acc1-69aa748edb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:23.468133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 901/1805] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:23.486545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cdcea-5b90-4afe-acc1-69aa748edb23 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:23.489469 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d21085-17f4-4628-a667-4c9adbbbb12e admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:23.498034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a32c02-5a86-4dff-9b8d-2e940a494f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:23.499059 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a32c02-5a86-4dff-9b8d-2e940a494f83 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:23.499446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a32c02-5a86-4dff-9b8d-2e940a494f83 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:23.499827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a32c02-5a86-4dff-9b8d-2e940a494f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:23.517158 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a32c02-5a86-4dff-9b8d-2e940a494f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:23.519406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a32c02-5a86-4dff-9b8d-2e940a494f83 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:23.535990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 905/1806] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:23.642672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cdcea-5b90-4afe-acc1-69aa748edb23 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:23.666645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28524d63-fc18-4241-b469-fd0a022fc2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:23.668070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524d63-fc18-4241-b469-fd0a022fc2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:23.669858 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524d63-fc18-4241-b469-fd0a022fc2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:23.670417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28524d63-fc18-4241-b469-fd0a022fc2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:23.674448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28524d63-fc18-4241-b469-fd0a022fc2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:23.677070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28524d63-fc18-4241-b469-fd0a022fc2e3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:23.887882 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 902/1807] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:23 2022] POST /identity/v3/projects => generated 385 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:23.892178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a32c02-5a86-4dff-9b8d-2e940a494f83 service nova] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:23.915881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a32c02-5a86-4dff-9b8d-2e940a494f83 service nova] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:24.135783 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd75ef1-f427-4a15-8616-4696044a4fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:24.139463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd75ef1-f427-4a15-8616-4696044a4fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.139463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd75ef1-f427-4a15-8616-4696044a4fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.139463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd75ef1-f427-4a15-8616-4696044a4fdc admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.139463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd75ef1-f427-4a15-8616-4696044a4fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:24.142491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd75ef1-f427-4a15-8616-4696044a4fdc admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:24.326216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 906/1808] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:23 2022] POST /identity/v3/users => generated 293 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:24.331365 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28524d63-fc18-4241-b469-fd0a022fc2e3 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:24.353471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28524d63-fc18-4241-b469-fd0a022fc2e3 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:24.368992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c10f32-c078-4bbe-890b-0e170301d4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:24.373058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10f32-c078-4bbe-890b-0e170301d4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.377003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10f32-c078-4bbe-890b-0e170301d4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.378090 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c10f32-c078-4bbe-890b-0e170301d4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.382449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c10f32-c078-4bbe-890b-0e170301d4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:24.389345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c10f32-c078-4bbe-890b-0e170301d4d3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:24.430026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 903/1809] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:24.431275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd75ef1-f427-4a15-8616-4696044a4fdc admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:24.452544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd75ef1-f427-4a15-8616-4696044a4fdc admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:24.469840 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f91f9-ef34-4caa-b62c-137961c3cca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:24.476280 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f91f9-ef34-4caa-b62c-137961c3cca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.478268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f91f9-ef34-4caa-b62c-137961c3cca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.479356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f91f9-ef34-4caa-b62c-137961c3cca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.480369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f91f9-ef34-4caa-b62c-137961c3cca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:24.483831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f91f9-ef34-4caa-b62c-137961c3cca4 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:24.536947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 907/1810] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:17:24.543563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c10f32-c078-4bbe-890b-0e170301d4d3 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:24.580148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c10f32-c078-4bbe-890b-0e170301d4d3 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:24.592043 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03a193-a340-4d25-98f3-6229b9b62a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:24.594706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03a193-a340-4d25-98f3-6229b9b62a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.595601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03a193-a340-4d25-98f3-6229b9b62a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.596376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03a193-a340-4d25-98f3-6229b9b62a57 admin admin] PATH_INFO: `/v3/projects/1437dd4906c7479cb42486fcd94517fe/users/db6531f422064284a187d93ce34f8d38/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.617977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03a193-a340-4d25-98f3-6229b9b62a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1437dd4906c7479cb42486fcd94517fe, user_id=db6531f422064284a187d93ce34f8d38, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:24.630379 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a03a193-a340-4d25-98f3-6229b9b62a57 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:24.767456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 904/1811] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:24 2022] PUT /identity/v3/projects/1437dd4906c7479cb42486fcd94517fe/users/db6531f422064284a187d93ce34f8d38/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:24.779562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d1170-96e3-4531-b118-de275a90b27b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.779964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d1170-96e3-4531-b118-de275a90b27b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.780445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d1170-96e3-4531-b118-de275a90b27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.893108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0a3d1170-96e3-4531-b118-de275a90b27b None None] MFA Rules not processed for user `db6531f422064284a187d93ce34f8d38`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:24.895384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0a3d1170-96e3-4531-b118-de275a90b27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:24.896982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03a193-a340-4d25-98f3-6229b9b62a57 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:24.898817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0a03a193-a340-4d25-98f3-6229b9b62a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:25.074783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03a193-a340-4d25-98f3-6229b9b62a57 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:25.094878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 908/1812] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:25.094878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d1170-96e3-4531-b118-de275a90b27b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:25.095342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63424621-fb3a-4276-a908-445a9dc8bc10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:25.095342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424621-fb3a-4276-a908-445a9dc8bc10 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:25.095342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424621-fb3a-4276-a908-445a9dc8bc10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:25.095342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63424621-fb3a-4276-a908-445a9dc8bc10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:25.095903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-63424621-fb3a-4276-a908-445a9dc8bc10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:25.257932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63424621-fb3a-4276-a908-445a9dc8bc10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:25.258814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d1170-96e3-4531-b118-de275a90b27b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:25.261738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63424621-fb3a-4276-a908-445a9dc8bc10 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:25.271753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2da09-4559-4219-85a8-433a770d58c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:25.272504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2da09-4559-4219-85a8-433a770d58c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:25.273778 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2da09-4559-4219-85a8-433a770d58c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:25.274092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2da09-4559-4219-85a8-433a770d58c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:25.274777 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2da09-4559-4219-85a8-433a770d58c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:25.277033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2da09-4559-4219-85a8-433a770d58c1 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:25.321707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 905/1813] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:25.666229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 909/1814] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:25 2022] POST /identity/v3/projects => generated 385 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:17:25.679224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63424621-fb3a-4276-a908-445a9dc8bc10 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:25.699502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63424621-fb3a-4276-a908-445a9dc8bc10 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:25.759307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:25.910976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551d54a-47dd-424a-9f57-78bd9cbf3956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:25.912547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d54a-47dd-424a-9f57-78bd9cbf3956 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:25.917585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d54a-47dd-424a-9f57-78bd9cbf3956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:25.918397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551d54a-47dd-424a-9f57-78bd9cbf3956 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:25.919983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551d54a-47dd-424a-9f57-78bd9cbf3956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:25.930261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551d54a-47dd-424a-9f57-78bd9cbf3956 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:26.141323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 906/1815] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:25 2022] POST /identity/v3/users => generated 299 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:26.142904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2da09-4559-4219-85a8-433a770d58c1 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:26.169894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2da09-4559-4219-85a8-433a770d58c1 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:26.189334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dfdfc-7ae9-4a95-a79f-2dba4516d0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:26.192784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dfdfc-7ae9-4a95-a79f-2dba4516d0bd admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:26.192784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dfdfc-7ae9-4a95-a79f-2dba4516d0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:26.194186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dfdfc-7ae9-4a95-a79f-2dba4516d0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:26.195458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dfdfc-7ae9-4a95-a79f-2dba4516d0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:26.199329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692dfdfc-7ae9-4a95-a79f-2dba4516d0bd admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:26.246300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 910/1816] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:17:26.258450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551d54a-47dd-424a-9f57-78bd9cbf3956 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:26.277555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551d54a-47dd-424a-9f57-78bd9cbf3956 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:26.292152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162c5e0-fb63-4b45-a2f5-b6ccabe06caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:26.293198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c5e0-fb63-4b45-a2f5-b6ccabe06caf admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:26.293743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c5e0-fb63-4b45-a2f5-b6ccabe06caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:26.295677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162c5e0-fb63-4b45-a2f5-b6ccabe06caf admin admin] PATH_INFO: `/v3/projects/51f3ac7340514e53b487a43e91e60d29/users/b74387bd248e470e8c775df2e7e4d539/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:26.350631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162c5e0-fb63-4b45-a2f5-b6ccabe06caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f3ac7340514e53b487a43e91e60d29, user_id=b74387bd248e470e8c775df2e7e4d539, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:26.355516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162c5e0-fb63-4b45-a2f5-b6ccabe06caf admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:26.572292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 907/1817] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:26 2022] PUT /identity/v3/projects/51f3ac7340514e53b487a43e91e60d29/users/b74387bd248e470e8c775df2e7e4d539/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:26.581439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dfdfc-7ae9-4a95-a79f-2dba4516d0bd admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:26.637477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dfdfc-7ae9-4a95-a79f-2dba4516d0bd admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:26.882699 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d51a4-dc06-4889-ade0-d90ceb514a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:26.883802 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d51a4-dc06-4889-ade0-d90ceb514a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:26.884965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d51a4-dc06-4889-ade0-d90ceb514a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:26.885448 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d51a4-dc06-4889-ade0-d90ceb514a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:26.886112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d51a4-dc06-4889-ade0-d90ceb514a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:26.890363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d51a4-dc06-4889-ade0-d90ceb514a41 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:26.914345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 911/1818] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:26.919208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162c5e0-fb63-4b45-a2f5-b6ccabe06caf admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:26.935632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162c5e0-fb63-4b45-a2f5-b6ccabe06caf admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:26.945733 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8e095-72dd-47b5-92aa-c0642917a4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:26.947966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e095-72dd-47b5-92aa-c0642917a4d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:26.948757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e095-72dd-47b5-92aa-c0642917a4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:26.949260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8e095-72dd-47b5-92aa-c0642917a4d1 admin admin] PATH_INFO: `/v3/projects/51f3ac7340514e53b487a43e91e60d29/users/b74387bd248e470e8c775df2e7e4d539/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:26.952419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8e095-72dd-47b5-92aa-c0642917a4d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f3ac7340514e53b487a43e91e60d29, user_id=b74387bd248e470e8c775df2e7e4d539, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:26.957476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8e095-72dd-47b5-92aa-c0642917a4d1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:26.986212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 908/1819] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:26 2022] PUT /identity/v3/projects/51f3ac7340514e53b487a43e91e60d29/users/b74387bd248e470e8c775df2e7e4d539/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:26.998055 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411db64-305a-494a-aac8-a0edcf3af721 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:26.998338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411db64-305a-494a-aac8-a0edcf3af721 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:26.998798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411db64-305a-494a-aac8-a0edcf3af721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:27.053804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-7411db64-305a-494a-aac8-a0edcf3af721 None None] MFA Rules not processed for user `b74387bd248e470e8c775df2e7e4d539`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:27.055837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7411db64-305a-494a-aac8-a0edcf3af721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:27.180035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 912/1820] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:27.199779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8e095-72dd-47b5-92aa-c0642917a4d1 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:27.329521 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8e095-72dd-47b5-92aa-c0642917a4d1 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:27.333484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf986bd-03fa-43bb-a576-31002e1f31c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:27.334260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf986bd-03fa-43bb-a576-31002e1f31c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:27.334597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf986bd-03fa-43bb-a576-31002e1f31c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:27.334931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf986bd-03fa-43bb-a576-31002e1f31c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:27.408468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf986bd-03fa-43bb-a576-31002e1f31c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:27.410092 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf986bd-03fa-43bb-a576-31002e1f31c4 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:27.424380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 909/1821] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:28.142528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:28.335548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411db64-305a-494a-aac8-a0edcf3af721 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:28.335548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7411db64-305a-494a-aac8-a0edcf3af721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:28.451127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411db64-305a-494a-aac8-a0edcf3af721 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:28.459342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:28.460377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:28.460736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:28.461163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] PATH_INFO: `/v3/users/41af70f9e64742a0acd94d8e9626c6f6` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:28.463970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41af70f9e64742a0acd94d8e9626c6f6)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:28.466948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:28.771281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41af70f9e64742a0acd94d8e9626c6f6'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:28.773053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41af70f9e64742a0acd94d8e9626c6f6'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:28.773809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41af70f9e64742a0acd94d8e9626c6f6'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:28.789668 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41af70f9e64742a0acd94d8e9626c6f6'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:28.895293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41af70f9e64742a0acd94d8e9626c6f6'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:28.912722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 913/1822] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:28 2022] DELETE /identity/v3/users/41af70f9e64742a0acd94d8e9626c6f6 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:28.918264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d1e80-3329-4312-9348-80f98b718e85 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:28.919059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d1e80-3329-4312-9348-80f98b718e85 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:28.919241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d1e80-3329-4312-9348-80f98b718e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:28.944204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-444d1e80-3329-4312-9348-80f98b718e85 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:28.945587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-444d1e80-3329-4312-9348-80f98b718e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:29.025293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 910/1823] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:29.034587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:29.040334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:29.120474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bea5fd-42d4-4da4-979b-5c52b6cb0994 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:29.124405 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b52e3e-7db3-4f7c-9533-710bf6b36ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:29.127929 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b52e3e-7db3-4f7c-9533-710bf6b36ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:29.127929 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b52e3e-7db3-4f7c-9533-710bf6b36ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:29.127929 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b52e3e-7db3-4f7c-9533-710bf6b36ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:29.154852 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b52e3e-7db3-4f7c-9533-710bf6b36ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:29.158010 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b52e3e-7db3-4f7c-9533-710bf6b36ba3 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:29.177188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 914/1824] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:29.894890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d1e80-3329-4312-9348-80f98b718e85 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:29.894890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-444d1e80-3329-4312-9348-80f98b718e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:30.016077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d1e80-3329-4312-9348-80f98b718e85 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:30.022538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f15da-1ec0-48b6-84f6-a2f8f7a75aa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:30.023171 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f15da-1ec0-48b6-84f6-a2f8f7a75aa0 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:30.023646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f15da-1ec0-48b6-84f6-a2f8f7a75aa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:30.023912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f15da-1ec0-48b6-84f6-a2f8f7a75aa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:30.026380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-456f15da-1ec0-48b6-84f6-a2f8f7a75aa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:30.126853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f15da-1ec0-48b6-84f6-a2f8f7a75aa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:30.128437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f15da-1ec0-48b6-84f6-a2f8f7a75aa0 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:30.139410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 911/1825] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:30.312811 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b52e3e-7db3-4f7c-9533-710bf6b36ba3 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:30.315254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f7b52e3e-7db3-4f7c-9533-710bf6b36ba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:30.335772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b52e3e-7db3-4f7c-9533-710bf6b36ba3 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:30.342518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:30.344059 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:30.345787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:30.346293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] PATH_INFO: `/v3/projects/cacbb3ea3b2f4a3e804735e8a2350e54` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:30.351547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] RBAC: Authorizing `identity:delete_project(project_id=cacbb3ea3b2f4a3e804735e8a2350e54)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:30.351547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:30.553964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cacbb3ea3b2f4a3e804735e8a2350e54', 'request_id': 'req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:30.645068 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cacbb3ea3b2f4a3e804735e8a2350e54', 'request_id': 'req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:30.653780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cacbb3ea3b2f4a3e804735e8a2350e54', 'request_id': 'req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:30.667602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] The token cache is being invalidate because project cacbb3ea3b2f4a3e804735e8a2350e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:30.667923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:30.668654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:30.670271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 915/1826] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:30 2022] DELETE /identity/v3/projects/cacbb3ea3b2f4a3e804735e8a2350e54 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:30.679226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f15da-1ec0-48b6-84f6-a2f8f7a75aa0 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:30.704140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f15da-1ec0-48b6-84f6-a2f8f7a75aa0 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:30.795331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf17b63-fd72-4db8-bd15-bea4a5e7bf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:30.796214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17b63-fd72-4db8-bd15-bea4a5e7bf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:30.797204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17b63-fd72-4db8-bd15-bea4a5e7bf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:30.797691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf17b63-fd72-4db8-bd15-bea4a5e7bf5f admin admin] PATH_INFO: `/v3/users/cb3bfd739c984fbdadc8a90cd251c3f3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:30.798990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf17b63-fd72-4db8-bd15-bea4a5e7bf5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3bfd739c984fbdadc8a90cd251c3f3)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:30.801028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf17b63-fd72-4db8-bd15-bea4a5e7bf5f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:31.111815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ecf17b63-fd72-4db8-bd15-bea4a5e7bf5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3bfd739c984fbdadc8a90cd251c3f3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:31.112910 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ecf17b63-fd72-4db8-bd15-bea4a5e7bf5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3bfd739c984fbdadc8a90cd251c3f3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:31.125505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ecf17b63-fd72-4db8-bd15-bea4a5e7bf5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3bfd739c984fbdadc8a90cd251c3f3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:31.126663 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ecf17b63-fd72-4db8-bd15-bea4a5e7bf5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3bfd739c984fbdadc8a90cd251c3f3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:31.145296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ecf17b63-fd72-4db8-bd15-bea4a5e7bf5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3bfd739c984fbdadc8a90cd251c3f3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:31.243858 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 912/1827] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:30 2022] DELETE /identity/v3/users/cb3bfd739c984fbdadc8a90cd251c3f3 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:31.575436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:31.644870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:31.992322 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:31.994678 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:32.023178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d6ca1-85c5-4675-a721-ef4bd02dc3db admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:32.113119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:32.113784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:32.114058 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:32.114327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] PATH_INFO: `/v3/projects/0554e79cea8d4fc5b963cce28d95f453` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:32.115559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0554e79cea8d4fc5b963cce28d95f453)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:32.118640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:32.284718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0554e79cea8d4fc5b963cce28d95f453', 'request_id': 'req-fcfd7000-4081-4b32-98c1-605a9072f9bc'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:32.372136 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0554e79cea8d4fc5b963cce28d95f453', 'request_id': 'req-fcfd7000-4081-4b32-98c1-605a9072f9bc'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:32.385718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0554e79cea8d4fc5b963cce28d95f453', 'request_id': 'req-fcfd7000-4081-4b32-98c1-605a9072f9bc'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:32.409566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] The token cache is being invalidate because project 0554e79cea8d4fc5b963cce28d95f453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:32.409566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:32.409566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-fcfd7000-4081-4b32-98c1-605a9072f9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:32.409566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 916/1828] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:31 2022] DELETE /identity/v3/projects/0554e79cea8d4fc5b963cce28d95f453 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:32.416788 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f269e0-4ef9-4a81-8cbd-46c2e27a7abe None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:32.417414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f269e0-4ef9-4a81-8cbd-46c2e27a7abe None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:32.417694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f269e0-4ef9-4a81-8cbd-46c2e27a7abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:32.450179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c9f269e0-4ef9-4a81-8cbd-46c2e27a7abe None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:32.450179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c9f269e0-4ef9-4a81-8cbd-46c2e27a7abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:32.532840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 913/1829] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:32.542404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebb647-f339-4662-97d9-911931fa2f6d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:32.543124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebb647-f339-4662-97d9-911931fa2f6d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:32.543803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebb647-f339-4662-97d9-911931fa2f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:32.573521 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f269e0-4ef9-4a81-8cbd-46c2e27a7abe None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:32.575463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-56ebb647-f339-4662-97d9-911931fa2f6d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:32.576271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c9f269e0-4ef9-4a81-8cbd-46c2e27a7abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:32.576867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-56ebb647-f339-4662-97d9-911931fa2f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:32.589318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 917/1830] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:32.594169 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebb647-f339-4662-97d9-911931fa2f6d None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:32.605432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebb647-f339-4662-97d9-911931fa2f6d None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:32.612395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a595e-fa68-4cb7-ab3a-9e6b0ac1df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:32.613090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a595e-fa68-4cb7-ab3a-9e6b0ac1df12 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:32.613368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a595e-fa68-4cb7-ab3a-9e6b0ac1df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:32.613638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a595e-fa68-4cb7-ab3a-9e6b0ac1df12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:32.614352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a595e-fa68-4cb7-ab3a-9e6b0ac1df12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:32.614700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a595e-fa68-4cb7-ab3a-9e6b0ac1df12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:32.616358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a595e-fa68-4cb7-ab3a-9e6b0ac1df12 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:32.640553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 918/1831] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:32.648828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a595e-fa68-4cb7-ab3a-9e6b0ac1df12 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:32.670987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a595e-fa68-4cb7-ab3a-9e6b0ac1df12 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:32.671323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f269e0-4ef9-4a81-8cbd-46c2e27a7abe None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:32.677331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec11d5-6f2b-4562-b4b0-ff77bb7c4440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:32.677963 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec11d5-6f2b-4562-b4b0-ff77bb7c4440 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:32.678348 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec11d5-6f2b-4562-b4b0-ff77bb7c4440 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:32.682470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec11d5-6f2b-4562-b4b0-ff77bb7c4440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:32.683053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2960e-2965-4c50-9f08-04e10461a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:32.683053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2960e-2965-4c50-9f08-04e10461a48e admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:32.683053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2960e-2965-4c50-9f08-04e10461a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:32.683053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2960e-2965-4c50-9f08-04e10461a48e admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:32.683569 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2960e-2965-4c50-9f08-04e10461a48e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:32.683699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4eec11d5-6f2b-4562-b4b0-ff77bb7c4440 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:32.684333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2960e-2965-4c50-9f08-04e10461a48e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:32.769042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec11d5-6f2b-4562-b4b0-ff77bb7c4440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:32.769042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec11d5-6f2b-4562-b4b0-ff77bb7c4440 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:32.775327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 914/1832] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:32.861975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 919/1833] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:32 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:32.863245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec11d5-6f2b-4562-b4b0-ff77bb7c4440 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:32.874142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec11d5-6f2b-4562-b4b0-ff77bb7c4440 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:32.950604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6869516-7fb8-4023-9955-a89797db157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:32.951131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869516-7fb8-4023-9955-a89797db157b admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:32.951596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869516-7fb8-4023-9955-a89797db157b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:32.951901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869516-7fb8-4023-9955-a89797db157b admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:32.952855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6869516-7fb8-4023-9955-a89797db157b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:32.954881 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6869516-7fb8-4023-9955-a89797db157b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:32.986166 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2960e-2965-4c50-9f08-04e10461a48e admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:32.988780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-def2960e-2965-4c50-9f08-04e10461a48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:33.061512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 915/1834] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:32 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:33.066565 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2960e-2965-4c50-9f08-04e10461a48e admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:33.066994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6869516-7fb8-4023-9955-a89797db157b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:33.070413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdabad2-a015-457a-8299-e729cf541822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:33.071107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdabad2-a015-457a-8299-e729cf541822 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:33.071383 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdabad2-a015-457a-8299-e729cf541822 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:33.071836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdabad2-a015-457a-8299-e729cf541822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:33.073865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ebdabad2-a015-457a-8299-e729cf541822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:33.080008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6869516-7fb8-4023-9955-a89797db157b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:33.088773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebffd23-54a8-4e38-aee1-8c349cfae099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:33.089558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebffd23-54a8-4e38-aee1-8c349cfae099 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:33.089892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebffd23-54a8-4e38-aee1-8c349cfae099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:33.090403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebffd23-54a8-4e38-aee1-8c349cfae099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:33.092019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebffd23-54a8-4e38-aee1-8c349cfae099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:33.096470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebffd23-54a8-4e38-aee1-8c349cfae099 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:33.114266 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 916/1835] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:17:33.120217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebffd23-54a8-4e38-aee1-8c349cfae099 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:33.138576 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebffd23-54a8-4e38-aee1-8c349cfae099 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:33.144750 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eff27-adf9-42f3-8717-da3c2f19a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:33.145409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eff27-adf9-42f3-8717-da3c2f19a86d admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:33.145687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eff27-adf9-42f3-8717-da3c2f19a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:33.146009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9eff27-adf9-42f3-8717-da3c2f19a86d admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:33.146722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9eff27-adf9-42f3-8717-da3c2f19a86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:33.148387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9eff27-adf9-42f3-8717-da3c2f19a86d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:33.166211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 917/1836] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:33.167351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eff27-adf9-42f3-8717-da3c2f19a86d admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:33.168338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdabad2-a015-457a-8299-e729cf541822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:33.170399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdabad2-a015-457a-8299-e729cf541822 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:33.182219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9eff27-adf9-42f3-8717-da3c2f19a86d admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:33.190161 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 920/1837] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:32 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:33.200450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270ebc2-eace-4d88-bfd5-8df98eee9522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:33.205372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270ebc2-eace-4d88-bfd5-8df98eee9522 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:33.205907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270ebc2-eace-4d88-bfd5-8df98eee9522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:33.206323 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270ebc2-eace-4d88-bfd5-8df98eee9522 admin admin] PATH_INFO: `/v3/projects/b8a079454bae496aa02810f977386d61/users/d020e2275da446758766d571e46544ae/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:33.241717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270ebc2-eace-4d88-bfd5-8df98eee9522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a079454bae496aa02810f977386d61, user_id=d020e2275da446758766d571e46544ae, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:33.261419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270ebc2-eace-4d88-bfd5-8df98eee9522 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:33.418830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 918/1838] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:33 2022] PUT /identity/v3/projects/b8a079454bae496aa02810f977386d61/users/d020e2275da446758766d571e46544ae/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:33.436087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa301d-dd14-4f9a-9abe-b7f178d4ef38 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:33.436463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa301d-dd14-4f9a-9abe-b7f178d4ef38 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:33.437497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa301d-dd14-4f9a-9abe-b7f178d4ef38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:33.478716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-2aaa301d-dd14-4f9a-9abe-b7f178d4ef38 None None] MFA Rules not processed for user `d020e2275da446758766d571e46544ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:33.479963 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2aaa301d-dd14-4f9a-9abe-b7f178d4ef38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:33.558187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 921/1839] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:33.564419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270ebc2-eace-4d88-bfd5-8df98eee9522 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:33.631760 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270ebc2-eace-4d88-bfd5-8df98eee9522 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:33.636854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b7e66-8338-4a51-aedb-cb1dd60bb348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:33.637513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b7e66-8338-4a51-aedb-cb1dd60bb348 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:33.637786 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b7e66-8338-4a51-aedb-cb1dd60bb348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:33.638209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b7e66-8338-4a51-aedb-cb1dd60bb348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:33.639182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b7e66-8338-4a51-aedb-cb1dd60bb348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:33.641302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b7e66-8338-4a51-aedb-cb1dd60bb348 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:33.745337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 919/1840] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:33 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:17:33.751134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa301d-dd14-4f9a-9abe-b7f178d4ef38 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:33.761549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa301d-dd14-4f9a-9abe-b7f178d4ef38 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:33.821132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652141d3-229c-404b-8d52-bbc21c116502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:33.821756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652141d3-229c-404b-8d52-bbc21c116502 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:33.822030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652141d3-229c-404b-8d52-bbc21c116502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:33.822299 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652141d3-229c-404b-8d52-bbc21c116502 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:33.822947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652141d3-229c-404b-8d52-bbc21c116502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:33.824922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652141d3-229c-404b-8d52-bbc21c116502 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:33.965276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 922/1841] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:33 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:33.970568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b7e66-8338-4a51-aedb-cb1dd60bb348 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:33.982326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b7e66-8338-4a51-aedb-cb1dd60bb348 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:33.988666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68581ea0-0cd4-4dc0-b9ed-113b8d7682b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:33.989310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581ea0-0cd4-4dc0-b9ed-113b8d7682b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:33.989591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581ea0-0cd4-4dc0-b9ed-113b8d7682b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:33.989864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68581ea0-0cd4-4dc0-b9ed-113b8d7682b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:33.990588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68581ea0-0cd4-4dc0-b9ed-113b8d7682b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:33.992357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68581ea0-0cd4-4dc0-b9ed-113b8d7682b7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:34.005792 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 920/1842] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:17:34.011414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652141d3-229c-404b-8d52-bbc21c116502 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:34.031263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652141d3-229c-404b-8d52-bbc21c116502 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:34.038592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38428e52-b11b-4381-8ec7-7c2bdbe513f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:34.039329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38428e52-b11b-4381-8ec7-7c2bdbe513f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:34.039583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38428e52-b11b-4381-8ec7-7c2bdbe513f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:34.039868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38428e52-b11b-4381-8ec7-7c2bdbe513f1 admin admin] PATH_INFO: `/v3/projects/2b4bf9b9599a49f28ec5b27eaa8d1b02/users/6711b250ffdb4ab7a00ecc3105e9a13e/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:34.058450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38428e52-b11b-4381-8ec7-7c2bdbe513f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4bf9b9599a49f28ec5b27eaa8d1b02, user_id=6711b250ffdb4ab7a00ecc3105e9a13e, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:34.061314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38428e52-b11b-4381-8ec7-7c2bdbe513f1 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:34.179147 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 923/1843] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:34 2022] PUT /identity/v3/projects/2b4bf9b9599a49f28ec5b27eaa8d1b02/users/6711b250ffdb4ab7a00ecc3105e9a13e/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:34.183332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68581ea0-0cd4-4dc0-b9ed-113b8d7682b7 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:34.206720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68581ea0-0cd4-4dc0-b9ed-113b8d7682b7 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:34.227126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:34.323623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd5508-3e60-4427-9cc5-df6c4fc3ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:34.324882 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd5508-3e60-4427-9cc5-df6c4fc3ede3 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:34.325203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd5508-3e60-4427-9cc5-df6c4fc3ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:34.325472 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd5508-3e60-4427-9cc5-df6c4fc3ede3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:34.326162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd5508-3e60-4427-9cc5-df6c4fc3ede3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:34.328731 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd5508-3e60-4427-9cc5-df6c4fc3ede3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:34.343317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:34.346117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 921/1844] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:17:34.349496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38428e52-b11b-4381-8ec7-7c2bdbe513f1 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:34.360171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38428e52-b11b-4381-8ec7-7c2bdbe513f1 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:34.381260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929de708-b0d9-4594-a357-3f18bf9b2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:34.383482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de708-b0d9-4594-a357-3f18bf9b2779 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:34.384261 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de708-b0d9-4594-a357-3f18bf9b2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:34.384534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de708-b0d9-4594-a357-3f18bf9b2779 admin admin] PATH_INFO: `/v3/projects/2b4bf9b9599a49f28ec5b27eaa8d1b02/users/6711b250ffdb4ab7a00ecc3105e9a13e/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:34.390867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929de708-b0d9-4594-a357-3f18bf9b2779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4bf9b9599a49f28ec5b27eaa8d1b02, user_id=6711b250ffdb4ab7a00ecc3105e9a13e, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:34.393814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929de708-b0d9-4594-a357-3f18bf9b2779 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:34.433445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 924/1845] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:34 2022] PUT /identity/v3/projects/2b4bf9b9599a49f28ec5b27eaa8d1b02/users/6711b250ffdb4ab7a00ecc3105e9a13e/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:34.445118 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239b0f2-b7b1-455d-b6ed-05da7c9622d2 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:34.446365 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239b0f2-b7b1-455d-b6ed-05da7c9622d2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:34.446832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239b0f2-b7b1-455d-b6ed-05da7c9622d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:34.486443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c239b0f2-b7b1-455d-b6ed-05da7c9622d2 None None] MFA Rules not processed for user `6711b250ffdb4ab7a00ecc3105e9a13e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:34.488054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c239b0f2-b7b1-455d-b6ed-05da7c9622d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:34.596440 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 922/1846] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:35.463116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929de708-b0d9-4594-a357-3f18bf9b2779 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:35.548309 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929de708-b0d9-4594-a357-3f18bf9b2779 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:35.554918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f60d5-4f74-43f1-971a-b5e2064c1664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:35.555835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f60d5-4f74-43f1-971a-b5e2064c1664 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:35.556134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f60d5-4f74-43f1-971a-b5e2064c1664 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:35.556629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f60d5-4f74-43f1-971a-b5e2064c1664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:35.685625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f60d5-4f74-43f1-971a-b5e2064c1664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:35.687606 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f60d5-4f74-43f1-971a-b5e2064c1664 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:35.704561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 925/1847] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:36.284301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:37.340154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:37.550003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7337d-7846-42ed-bd7c-e458ef7aa869 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:37.550515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7337d-7846-42ed-bd7c-e458ef7aa869 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:37.550931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7337d-7846-42ed-bd7c-e458ef7aa869 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:37.552673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 923/1848] 10.222.0.20 () {54 vars in 921 bytes} [Wed Aug 24 17:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:17:37.574607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97743d89-4182-4416-afbc-7e0cdc8cba85 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:37.575143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97743d89-4182-4416-afbc-7e0cdc8cba85 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:37.575244 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97743d89-4182-4416-afbc-7e0cdc8cba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:37.640845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-97743d89-4182-4416-afbc-7e0cdc8cba85 None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:37.643264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-97743d89-4182-4416-afbc-7e0cdc8cba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:37.777484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 926/1849] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Aug 24 17:17:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:37.835432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7337d-7846-42ed-bd7c-e458ef7aa869 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:37.837542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bfc7337d-7846-42ed-bd7c-e458ef7aa869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:37.860079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc7337d-7846-42ed-bd7c-e458ef7aa869 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:37.866727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa7dc5-213c-44d2-aa82-a74171aff1cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:37.867367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7dc5-213c-44d2-aa82-a74171aff1cf service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:37.867812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7dc5-213c-44d2-aa82-a74171aff1cf service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:37.868095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa7dc5-213c-44d2-aa82-a74171aff1cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:37.879397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa7dc5-213c-44d2-aa82-a74171aff1cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:37.881908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa7dc5-213c-44d2-aa82-a74171aff1cf service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:37.894972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 924/1850] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:38.656076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:39.224035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97743d89-4182-4416-afbc-7e0cdc8cba85 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:39.226550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-97743d89-4182-4416-afbc-7e0cdc8cba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:39.278423 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa7dc5-213c-44d2-aa82-a74171aff1cf service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:39.281890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c7fa7dc5-213c-44d2-aa82-a74171aff1cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:39.387225 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97743d89-4182-4416-afbc-7e0cdc8cba85 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:39.395211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:39.396011 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:39.396488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:39.397272 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] PATH_INFO: `/v3/users/2249093983fc412aa5ecebe22f889f74` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:39.399330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2249093983fc412aa5ecebe22f889f74)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:39.401915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:39.436010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa7dc5-213c-44d2-aa82-a74171aff1cf service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:39.446531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209822f-8678-4e88-a976-dcdb20b8c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:39.448096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209822f-8678-4e88-a976-dcdb20b8c3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:39.448889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209822f-8678-4e88-a976-dcdb20b8c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:39.449367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209822f-8678-4e88-a976-dcdb20b8c3c1 admin admin] PATH_INFO: `/v3/users/ab2b5f27fc3f44da998f0624ffa0521f` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:39.451508 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209822f-8678-4e88-a976-dcdb20b8c3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2b5f27fc3f44da998f0624ffa0521f)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:39.456371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209822f-8678-4e88-a976-dcdb20b8c3c1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:39.717935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2249093983fc412aa5ecebe22f889f74'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.720444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2249093983fc412aa5ecebe22f889f74'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.720667 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2249093983fc412aa5ecebe22f889f74'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.745042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2249093983fc412aa5ecebe22f889f74'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.779540 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a209822f-8678-4e88-a976-dcdb20b8c3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2b5f27fc3f44da998f0624ffa0521f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.782982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a209822f-8678-4e88-a976-dcdb20b8c3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2b5f27fc3f44da998f0624ffa0521f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.806820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a209822f-8678-4e88-a976-dcdb20b8c3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2b5f27fc3f44da998f0624ffa0521f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.815029 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a209822f-8678-4e88-a976-dcdb20b8c3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2b5f27fc3f44da998f0624ffa0521f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.850910 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a209822f-8678-4e88-a976-dcdb20b8c3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2b5f27fc3f44da998f0624ffa0521f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.867350 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2249093983fc412aa5ecebe22f889f74'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.896210 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 927/1851] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:39 2022] DELETE /identity/v3/users/2249093983fc412aa5ecebe22f889f74 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:39.905052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:39.908502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:39.974455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 925/1852] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:39 2022] DELETE /identity/v3/users/ab2b5f27fc3f44da998f0624ffa0521f => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:39.978982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01825805-0ae7-493d-874a-e438e92658c1 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:39.983285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01825805-0ae7-493d-874a-e438e92658c1 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:39.984393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01825805-0ae7-493d-874a-e438e92658c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:40.057247 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:40.063575 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-01825805-0ae7-493d-874a-e438e92658c1 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:40.066681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-01825805-0ae7-493d-874a-e438e92658c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:40.074616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0aa703-be90-4213-92aa-60c3fcc3ceee admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:40.194642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:40.195460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:40.195748 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:40.199332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] PATH_INFO: `/v3/users/d020e2275da446758766d571e46544ae` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:40.200849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d020e2275da446758766d571e46544ae)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:40.205475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:40.267748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 926/1853] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:40.281976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08162-52a8-4633-a417-0021c9a16b99 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:40.281976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08162-52a8-4633-a417-0021c9a16b99 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:40.281976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e08162-52a8-4633-a417-0021c9a16b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:40.307437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-d1e08162-52a8-4633-a417-0021c9a16b99 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:40.309857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d1e08162-52a8-4633-a417-0021c9a16b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:40.327374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 927/1854] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:40.332531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e08162-52a8-4633-a417-0021c9a16b99 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:40.335387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d1e08162-52a8-4633-a417-0021c9a16b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:40.487741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e08162-52a8-4633-a417-0021c9a16b99 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:40.498318 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5cb2-769b-4a36-8686-108197ddc04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:40.501777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5cb2-769b-4a36-8686-108197ddc04c service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:40.503188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5cb2-769b-4a36-8686-108197ddc04c service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:40.504055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc5cb2-769b-4a36-8686-108197ddc04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:40.510698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd020e2275da446758766d571e46544ae'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:40.517530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd020e2275da446758766d571e46544ae'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:40.517530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd020e2275da446758766d571e46544ae'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:40.537775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc5cb2-769b-4a36-8686-108197ddc04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:40.543392 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd020e2275da446758766d571e46544ae'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:40.545906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc5cb2-769b-4a36-8686-108197ddc04c service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:40.574509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 928/1855] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:40.579249 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5cb2-769b-4a36-8686-108197ddc04c service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:40.590701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc5cb2-769b-4a36-8686-108197ddc04c service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:40.596298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6688f3-fad8-4184-8073-bd004896ebab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:40.597507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6688f3-fad8-4184-8073-bd004896ebab service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:40.598048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6688f3-fad8-4184-8073-bd004896ebab service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:40.598570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6688f3-fad8-4184-8073-bd004896ebab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:40.601158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0b6688f3-fad8-4184-8073-bd004896ebab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:40.624401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6688f3-fad8-4184-8073-bd004896ebab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:40.626411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6688f3-fad8-4184-8073-bd004896ebab service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:40.640960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd020e2275da446758766d571e46544ae'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:40.647482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 929/1856] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:40.675770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 928/1857] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:39 2022] DELETE /identity/v3/users/d020e2275da446758766d571e46544ae => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:40.687682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0e159-544b-4e71-9da3-46e57af59dfc None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:40.687682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0e159-544b-4e71-9da3-46e57af59dfc None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:40.687682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0e159-544b-4e71-9da3-46e57af59dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:40.713660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-25f0e159-544b-4e71-9da3-46e57af59dfc None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:40.716643 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-25f0e159-544b-4e71-9da3-46e57af59dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:40.840272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 930/1858] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:40.859044 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:40.861062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:40.985427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4816575-10eb-4e7e-b7f8-d84be588fbfc admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:40.990638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36573c8-0831-4f2f-81fd-923be4b61002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:40.996338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36573c8-0831-4f2f-81fd-923be4b61002 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:40.996338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36573c8-0831-4f2f-81fd-923be4b61002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:40.996338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36573c8-0831-4f2f-81fd-923be4b61002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:41.003477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36573c8-0831-4f2f-81fd-923be4b61002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:41.005052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36573c8-0831-4f2f-81fd-923be4b61002 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:41.016760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 929/1859] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:41.298002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:41.697508 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0e159-544b-4e71-9da3-46e57af59dfc None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:41.700382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-25f0e159-544b-4e71-9da3-46e57af59dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:41.716387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0e159-544b-4e71-9da3-46e57af59dfc None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:41.722717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:41.724938 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:41.724938 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:41.724938 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] PATH_INFO: `/v3/projects/b8a079454bae496aa02810f977386d61` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:41.727102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a079454bae496aa02810f977386d61)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:41.729040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:41.894055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a079454bae496aa02810f977386d61', 'request_id': 'req-7d2d14ce-0293-4f70-885c-4a697b99f14f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:41.921430 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36573c8-0831-4f2f-81fd-923be4b61002 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:41.925703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f36573c8-0831-4f2f-81fd-923be4b61002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:41.945864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36573c8-0831-4f2f-81fd-923be4b61002 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:42.059064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:42.059064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:42.059064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:42.059064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] PATH_INFO: `/v3/projects/ef0d65939a764093a9da2eebdb9ae86e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:42.059500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0d65939a764093a9da2eebdb9ae86e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:42.059500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:42.085289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a079454bae496aa02810f977386d61', 'request_id': 'req-7d2d14ce-0293-4f70-885c-4a697b99f14f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.097842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a079454bae496aa02810f977386d61', 'request_id': 'req-7d2d14ce-0293-4f70-885c-4a697b99f14f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.113777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] The token cache is being invalidate because project b8a079454bae496aa02810f977386d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:42.116547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.116547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.121351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 931/1860] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:41 2022] DELETE /identity/v3/projects/b8a079454bae496aa02810f977386d61 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:42.122597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:42.124890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:42.142821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:42.149319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d14ce-0293-4f70-885c-4a697b99f14f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:42.155156 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:42.156024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:42.156210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:42.156651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] PATH_INFO: `/v3/users/6711b250ffdb4ab7a00ecc3105e9a13e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:42.158062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6711b250ffdb4ab7a00ecc3105e9a13e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:42.160074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:42.245427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0d65939a764093a9da2eebdb9ae86e', 'request_id': 'req-72e830ff-d54b-4225-bb31-9a1233a82097'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.340948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0d65939a764093a9da2eebdb9ae86e', 'request_id': 'req-72e830ff-d54b-4225-bb31-9a1233a82097'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.348614 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0d65939a764093a9da2eebdb9ae86e', 'request_id': 'req-72e830ff-d54b-4225-bb31-9a1233a82097'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.370862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] The token cache is being invalidate because project ef0d65939a764093a9da2eebdb9ae86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:42.371161 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.372062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.375162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 930/1861] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:41 2022] DELETE /identity/v3/projects/ef0d65939a764093a9da2eebdb9ae86e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:42.376265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:42.378064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:42.432749 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6711b250ffdb4ab7a00ecc3105e9a13e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.433998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6711b250ffdb4ab7a00ecc3105e9a13e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.446337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6711b250ffdb4ab7a00ecc3105e9a13e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.447565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6711b250ffdb4ab7a00ecc3105e9a13e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.463459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6711b250ffdb4ab7a00ecc3105e9a13e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.475270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e830ff-d54b-4225-bb31-9a1233a82097 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:42.480964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:42.486088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:42.486088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:42.486088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] PATH_INFO: `/v3/projects/fc24f10e6b3e4855b55d03eb7f0dfd7b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:42.486088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc24f10e6b3e4855b55d03eb7f0dfd7b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:42.486088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:42.541961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 932/1862] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:42 2022] DELETE /identity/v3/users/6711b250ffdb4ab7a00ecc3105e9a13e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:42.542654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:42.544204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:42.626540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc24f10e6b3e4855b55d03eb7f0dfd7b', 'request_id': 'req-c7637a97-b9d2-4526-b7a2-6e79078db3b3'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.665382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74138a6-c7ac-4a0d-a475-8a8e8b63199b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:42.696040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc24f10e6b3e4855b55d03eb7f0dfd7b', 'request_id': 'req-c7637a97-b9d2-4526-b7a2-6e79078db3b3'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.705423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc24f10e6b3e4855b55d03eb7f0dfd7b', 'request_id': 'req-c7637a97-b9d2-4526-b7a2-6e79078db3b3'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.726894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] The token cache is being invalidate because project fc24f10e6b3e4855b55d03eb7f0dfd7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:42.727193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.728297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.733634 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 931/1863] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:42 2022] DELETE /identity/v3/projects/fc24f10e6b3e4855b55d03eb7f0dfd7b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:42.736735 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:42.737635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:42.746254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:42.747157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:42.747528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:42.747947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] PATH_INFO: `/v3/users/c2531ea82700419cae6c9bf86b180854` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:42.750023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2531ea82700419cae6c9bf86b180854)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:42.752314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:42.841048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7637a97-b9d2-4526-b7a2-6e79078db3b3 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:42.851370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bb4fa-216a-4913-a279-766a0edb985a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:42.852754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bb4fa-216a-4913-a279-766a0edb985a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:42.853259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bb4fa-216a-4913-a279-766a0edb985a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:42.853749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bb4fa-216a-4913-a279-766a0edb985a admin admin] PATH_INFO: `/v3/users/db6531f422064284a187d93ce34f8d38` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:42.857847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bb4fa-216a-4913-a279-766a0edb985a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6531f422064284a187d93ce34f8d38)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:42.858412 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bb4fa-216a-4913-a279-766a0edb985a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:43.048317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2531ea82700419cae6c9bf86b180854'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.049410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2531ea82700419cae6c9bf86b180854'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.057552 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2531ea82700419cae6c9bf86b180854'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.058313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2531ea82700419cae6c9bf86b180854'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.076442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2531ea82700419cae6c9bf86b180854'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.118773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b04bb4fa-216a-4913-a279-766a0edb985a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6531f422064284a187d93ce34f8d38'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.120185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b04bb4fa-216a-4913-a279-766a0edb985a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6531f422064284a187d93ce34f8d38'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.121043 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b04bb4fa-216a-4913-a279-766a0edb985a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6531f422064284a187d93ce34f8d38'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.147938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b04bb4fa-216a-4913-a279-766a0edb985a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6531f422064284a187d93ce34f8d38'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.206458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 933/1864] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:42 2022] DELETE /identity/v3/users/c2531ea82700419cae6c9bf86b180854 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:43.206458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:43.209350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:43.286767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b04bb4fa-216a-4913-a279-766a0edb985a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6531f422064284a187d93ce34f8d38'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.316255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 932/1865] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:42 2022] DELETE /identity/v3/users/db6531f422064284a187d93ce34f8d38 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:43.400207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62550ed7-391e-4395-b630-cc0b00048c5b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:43.417879 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:43.484421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:43.485395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:43.485693 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:43.485947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] PATH_INFO: `/v3/projects/2b4bf9b9599a49f28ec5b27eaa8d1b02` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:43.488448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4bf9b9599a49f28ec5b27eaa8d1b02)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:43.490173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:43.632584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4bf9b9599a49f28ec5b27eaa8d1b02', 'request_id': 'req-817464d2-51a9-4b75-98a4-04b38db806e7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.748523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4bf9b9599a49f28ec5b27eaa8d1b02', 'request_id': 'req-817464d2-51a9-4b75-98a4-04b38db806e7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.764781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4bf9b9599a49f28ec5b27eaa8d1b02', 'request_id': 'req-817464d2-51a9-4b75-98a4-04b38db806e7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.810974 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] The token cache is being invalidate because project 2b4bf9b9599a49f28ec5b27eaa8d1b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:43.817145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.819214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.828260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 934/1866] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:43 2022] DELETE /identity/v3/projects/2b4bf9b9599a49f28ec5b27eaa8d1b02 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:43.834723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcea21-cd1d-4c39-9856-c544bbda50df None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:43.835001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcea21-cd1d-4c39-9856-c544bbda50df None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:43.835260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcea21-cd1d-4c39-9856-c544bbda50df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:43.886037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a3bcea21-cd1d-4c39-9856-c544bbda50df None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:43.887950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a3bcea21-cd1d-4c39-9856-c544bbda50df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:43.962725 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:43.965118 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:43.996275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 933/1867] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:44.004789 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29039c-c72c-4878-8730-cf3e2e10be2f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:44.011816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29039c-c72c-4878-8730-cf3e2e10be2f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:44.011816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29039c-c72c-4878-8730-cf3e2e10be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:44.057909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4d29039c-c72c-4878-8730-cf3e2e10be2f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:44.066108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4d29039c-c72c-4878-8730-cf3e2e10be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:44.089758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 934/1868] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:44.104901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29039c-c72c-4878-8730-cf3e2e10be2f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:44.128742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817464d2-51a9-4b75-98a4-04b38db806e7 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:44.134867 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:44.135740 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:44.136029 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:44.136534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] PATH_INFO: `/v3/projects/1437dd4906c7479cb42486fcd94517fe` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:44.138870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1437dd4906c7479cb42486fcd94517fe)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:44.139174 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29039c-c72c-4878-8730-cf3e2e10be2f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:44.141722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:44.149500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecdb11-b225-4a41-93ea-bf10d8e12f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:44.151012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecdb11-b225-4a41-93ea-bf10d8e12f3d admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:44.152666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecdb11-b225-4a41-93ea-bf10d8e12f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:44.153451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ecdb11-b225-4a41-93ea-bf10d8e12f3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:44.154998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecdb11-b225-4a41-93ea-bf10d8e12f3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:44.156036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecdb11-b225-4a41-93ea-bf10d8e12f3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:44.159260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ecdb11-b225-4a41-93ea-bf10d8e12f3d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:44.183661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 935/1869] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:44.192407 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecdb11-b225-4a41-93ea-bf10d8e12f3d admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:44.213534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ecdb11-b225-4a41-93ea-bf10d8e12f3d admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:44.236863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:44.252994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a0d8c-f6c7-4f98-8ef4-2a825af71d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:44.255715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a0d8c-f6c7-4f98-8ef4-2a825af71d23 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:44.256724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a0d8c-f6c7-4f98-8ef4-2a825af71d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:44.257266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a0d8c-f6c7-4f98-8ef4-2a825af71d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:44.258736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a0d8c-f6c7-4f98-8ef4-2a825af71d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:44.264531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a0d8c-f6c7-4f98-8ef4-2a825af71d23 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:44.379900 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1437dd4906c7479cb42486fcd94517fe', 'request_id': 'req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:44.435614 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 936/1870] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:44 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:44.435614 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a0d8c-f6c7-4f98-8ef4-2a825af71d23 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:44.440401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d28a0d8c-f6c7-4f98-8ef4-2a825af71d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:44.480550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1437dd4906c7479cb42486fcd94517fe', 'request_id': 'req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:44.492627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1437dd4906c7479cb42486fcd94517fe', 'request_id': 'req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:44.510685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] The token cache is being invalidate because project 1437dd4906c7479cb42486fcd94517fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:44.511262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:44.511949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:44.516373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 935/1871] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:43 2022] DELETE /identity/v3/projects/1437dd4906c7479cb42486fcd94517fe => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:44.516373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:44.517316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:44.538328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a0d8c-f6c7-4f98-8ef4-2a825af71d23 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:44.547418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:44.549650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:44.549650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:44.549908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] PATH_INFO: `/v3/projects/1cb0e3d44a844f5b8666965de20199f7` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:44.551506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb0e3d44a844f5b8666965de20199f7)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:44.553594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:44.634311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eed7a7-4566-49f3-ac1a-71a746a2b0ef admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:44.641388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf0e01-06da-487f-a558-e1980ce8739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:44.642270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf0e01-06da-487f-a558-e1980ce8739e admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:44.642602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf0e01-06da-487f-a558-e1980ce8739e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:44.642948 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf0e01-06da-487f-a558-e1980ce8739e admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:44.643603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf0e01-06da-487f-a558-e1980ce8739e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:44.646346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf0e01-06da-487f-a558-e1980ce8739e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:44.756439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb0e3d44a844f5b8666965de20199f7', 'request_id': 'req-527be351-2b90-4c5a-8689-1b599c7f96c2'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:44.769008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 936/1872] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:44 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:44.771613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf0e01-06da-487f-a558-e1980ce8739e admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:44.774581 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e3bf0e01-06da-487f-a558-e1980ce8739e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:44.803673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf0e01-06da-487f-a558-e1980ce8739e admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:44.861905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb0e3d44a844f5b8666965de20199f7', 'request_id': 'req-527be351-2b90-4c5a-8689-1b599c7f96c2'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:44.871211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb0e3d44a844f5b8666965de20199f7', 'request_id': 'req-527be351-2b90-4c5a-8689-1b599c7f96c2'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:44.886203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] The token cache is being invalidate because project 1cb0e3d44a844f5b8666965de20199f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:44.886659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:44.888372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:44.890363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 937/1873] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:44 2022] DELETE /identity/v3/projects/1cb0e3d44a844f5b8666965de20199f7 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:44.891796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:44.894410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:44.901297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:44.901955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:44.902236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:44.902517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] PATH_INFO: `/v3/users/b74387bd248e470e8c775df2e7e4d539` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:44.903813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74387bd248e470e8c775df2e7e4d539)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:44.906629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:45.033776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527be351-2b90-4c5a-8689-1b599c7f96c2 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:45.038975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384739d-2fd5-4c7a-b37a-b2a82b4fc5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:45.039637 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384739d-2fd5-4c7a-b37a-b2a82b4fc5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:45.044561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384739d-2fd5-4c7a-b37a-b2a82b4fc5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:45.044561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384739d-2fd5-4c7a-b37a-b2a82b4fc5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:45.044561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384739d-2fd5-4c7a-b37a-b2a82b4fc5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:45.044561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384739d-2fd5-4c7a-b37a-b2a82b4fc5f6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:45.055325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 938/1874] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:45.056005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384739d-2fd5-4c7a-b37a-b2a82b4fc5f6 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:45.060372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2384739d-2fd5-4c7a-b37a-b2a82b4fc5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:45.076116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384739d-2fd5-4c7a-b37a-b2a82b4fc5f6 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:45.128306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:45.129579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:45.130603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74387bd248e470e8c775df2e7e4d539'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:45.131322 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74387bd248e470e8c775df2e7e4d539'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:45.132077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:45.132740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] PATH_INFO: `/v3/users/1be8fc50c47b4279a042e48af93fcb8b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:45.143790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74387bd248e470e8c775df2e7e4d539'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:45.148148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74387bd248e470e8c775df2e7e4d539'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:45.148372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be8fc50c47b4279a042e48af93fcb8b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:45.156533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:45.160014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74387bd248e470e8c775df2e7e4d539'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:45.245418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 937/1875] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:44 2022] DELETE /identity/v3/users/b74387bd248e470e8c775df2e7e4d539 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:45.245418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:45.249457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:45.366650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd0c23-bbbc-4fe1-adad-7d6d9ea7cfcb admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:45.373692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8244f-1436-48d0-a07b-fbc499c184a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:45.375605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8244f-1436-48d0-a07b-fbc499c184a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:45.376144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8244f-1436-48d0-a07b-fbc499c184a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:45.376990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8244f-1436-48d0-a07b-fbc499c184a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:45.378062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8244f-1436-48d0-a07b-fbc499c184a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:45.380418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8244f-1436-48d0-a07b-fbc499c184a3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:45.404031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 938/1876] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:45.405224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8244f-1436-48d0-a07b-fbc499c184a3 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:45.423138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8244f-1436-48d0-a07b-fbc499c184a3 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:45.441398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c7883-7854-42f8-9ef6-e95f3513e660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:45.442072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be8fc50c47b4279a042e48af93fcb8b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:45.442901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c7883-7854-42f8-9ef6-e95f3513e660 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:45.456437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c7883-7854-42f8-9ef6-e95f3513e660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:45.456658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be8fc50c47b4279a042e48af93fcb8b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:45.457958 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c7883-7854-42f8-9ef6-e95f3513e660 admin admin] PATH_INFO: `/v3/projects/e6ab9372679947008c4f924f19b259be/users/ff0762a857a94fcb86c99dce8142284e/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:45.459580 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be8fc50c47b4279a042e48af93fcb8b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:45.492463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be8fc50c47b4279a042e48af93fcb8b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:45.498220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c7883-7854-42f8-9ef6-e95f3513e660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6ab9372679947008c4f924f19b259be, user_id=ff0762a857a94fcb86c99dce8142284e, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:45.501541 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c7883-7854-42f8-9ef6-e95f3513e660 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:45.569458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be8fc50c47b4279a042e48af93fcb8b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:45.581623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 939/1877] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:45 2022] PUT /identity/v3/projects/e6ab9372679947008c4f924f19b259be/users/ff0762a857a94fcb86c99dce8142284e/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:45.589388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 939/1878] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:45 2022] DELETE /identity/v3/users/1be8fc50c47b4279a042e48af93fcb8b => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:45.594800 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b74b82-fe17-4576-92be-28047b1c7b6a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:45.595087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b74b82-fe17-4576-92be-28047b1c7b6a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:45.595363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b74b82-fe17-4576-92be-28047b1c7b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:45.632934 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-88b74b82-fe17-4576-92be-28047b1c7b6a None None] MFA Rules not processed for user `ff0762a857a94fcb86c99dce8142284e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:45.634160 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-88b74b82-fe17-4576-92be-28047b1c7b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:45.744253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 940/1879] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:45.757654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:45.759631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:45.846497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabbd04-0d85-4371-94c4-3dacd49937d6 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:45.851902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db452d-bd81-43aa-bf83-c09bd06f4e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:45.852888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db452d-bd81-43aa-bf83-c09bd06f4e82 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:45.853457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db452d-bd81-43aa-bf83-c09bd06f4e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:45.854311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db452d-bd81-43aa-bf83-c09bd06f4e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:45.894030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db452d-bd81-43aa-bf83-c09bd06f4e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:45.895643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db452d-bd81-43aa-bf83-c09bd06f4e82 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:45.917020 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 940/1880] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:46.160009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b74b82-fe17-4576-92be-28047b1c7b6a None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:46.161958 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-88b74b82-fe17-4576-92be-28047b1c7b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:46.267453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db452d-bd81-43aa-bf83-c09bd06f4e82 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:46.275075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a3db452d-bd81-43aa-bf83-c09bd06f4e82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:46.303139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b74b82-fe17-4576-92be-28047b1c7b6a None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:46.312419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:46.313169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:46.313562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:46.313915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] PATH_INFO: `/v3/projects/51f3ac7340514e53b487a43e91e60d29` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:46.315201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f3ac7340514e53b487a43e91e60d29)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:46.317595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:46.356321 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db452d-bd81-43aa-bf83-c09bd06f4e82 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:46.362097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:46.362441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:46.362724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:46.362998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] PATH_INFO: `/v3/projects/6b3f7d850d86495fa807b87174244c1e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:46.364472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3f7d850d86495fa807b87174244c1e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:46.367837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:46.475442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f3ac7340514e53b487a43e91e60d29', 'request_id': 'req-c456caa9-9b6b-4041-88eb-f19afd97e4c8'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:46.528113 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3f7d850d86495fa807b87174244c1e', 'request_id': 'req-deee12d3-fcee-4cde-8600-e9858c283b76'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:46.649644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f3ac7340514e53b487a43e91e60d29', 'request_id': 'req-c456caa9-9b6b-4041-88eb-f19afd97e4c8'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:46.661419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f3ac7340514e53b487a43e91e60d29', 'request_id': 'req-c456caa9-9b6b-4041-88eb-f19afd97e4c8'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:46.674048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] The token cache is being invalidate because project 51f3ac7340514e53b487a43e91e60d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:46.674369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:46.684993 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c456caa9-9b6b-4041-88eb-f19afd97e4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:46.684993 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 941/1881] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:46 2022] DELETE /identity/v3/projects/51f3ac7340514e53b487a43e91e60d29 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:46.685201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:46.685314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e223d4-f8a1-4342-a06b-1fb177d57a6b None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:46.685314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e223d4-f8a1-4342-a06b-1fb177d57a6b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:46.685314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e223d4-f8a1-4342-a06b-1fb177d57a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:46.704920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-89e223d4-f8a1-4342-a06b-1fb177d57a6b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:46.706197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-89e223d4-f8a1-4342-a06b-1fb177d57a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:46.729625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3f7d850d86495fa807b87174244c1e', 'request_id': 'req-deee12d3-fcee-4cde-8600-e9858c283b76'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:46.741497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3f7d850d86495fa807b87174244c1e', 'request_id': 'req-deee12d3-fcee-4cde-8600-e9858c283b76'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:46.761051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] The token cache is being invalidate because project 6b3f7d850d86495fa807b87174244c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:46.761442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:46.762324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-deee12d3-fcee-4cde-8600-e9858c283b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:46.769234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 941/1882] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:46 2022] DELETE /identity/v3/projects/6b3f7d850d86495fa807b87174244c1e => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:46.772863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801d9d-933e-43bc-8dd7-c6008f607859 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:46.773628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801d9d-933e-43bc-8dd7-c6008f607859 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:46.773628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801d9d-933e-43bc-8dd7-c6008f607859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:46.800541 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-09801d9d-933e-43bc-8dd7-c6008f607859 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:46.801829 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-09801d9d-933e-43bc-8dd7-c6008f607859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:46.822300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 942/1883] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:46.835754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2faec-ecd5-4c5a-a510-5b7e0bae59ba None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:46.836046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2faec-ecd5-4c5a-a510-5b7e0bae59ba None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:46.836441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2faec-ecd5-4c5a-a510-5b7e0bae59ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:46.857990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-4ec2faec-ecd5-4c5a-a510-5b7e0bae59ba None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:46.860429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4ec2faec-ecd5-4c5a-a510-5b7e0bae59ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:46.873314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 943/1884] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:46.874859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2faec-ecd5-4c5a-a510-5b7e0bae59ba None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:46.881180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 942/1885] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:46.885664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2faec-ecd5-4c5a-a510-5b7e0bae59ba None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:46.891100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54e97c-2404-46f5-8685-3dade54c089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:46.891782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c0d1c-0e03-4724-a164-6126e969f25e None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:46.892279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c0d1c-0e03-4724-a164-6126e969f25e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:46.892412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e97c-2404-46f5-8685-3dade54c089d admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:46.892597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c0d1c-0e03-4724-a164-6126e969f25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:46.892707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e97c-2404-46f5-8685-3dade54c089d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:46.892949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54e97c-2404-46f5-8685-3dade54c089d admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:46.893987 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54e97c-2404-46f5-8685-3dade54c089d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:46.894329 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54e97c-2404-46f5-8685-3dade54c089d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:46.896686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54e97c-2404-46f5-8685-3dade54c089d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:46.920397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 944/1886] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:46.922431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54e97c-2404-46f5-8685-3dade54c089d admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:46.931761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ef1c0d1c-0e03-4724-a164-6126e969f25e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:46.933159 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ef1c0d1c-0e03-4724-a164-6126e969f25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:46.941467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54e97c-2404-46f5-8685-3dade54c089d admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:46.947637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff7e5d-9280-40c0-b6f8-deb7554b4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:46.947916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff7e5d-9280-40c0-b6f8-deb7554b4eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:46.948307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff7e5d-9280-40c0-b6f8-deb7554b4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:46.949232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff7e5d-9280-40c0-b6f8-deb7554b4eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:46.949426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff7e5d-9280-40c0-b6f8-deb7554b4eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:46.951335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff7e5d-9280-40c0-b6f8-deb7554b4eb1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:46.984373 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 943/1887] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:46.992284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c0d1c-0e03-4724-a164-6126e969f25e None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:47.007208 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c0d1c-0e03-4724-a164-6126e969f25e None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:47.016684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993842c2-65e8-4d2e-8234-2ecc982cbdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:47.021325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993842c2-65e8-4d2e-8234-2ecc982cbdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.021762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993842c2-65e8-4d2e-8234-2ecc982cbdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.022153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993842c2-65e8-4d2e-8234-2ecc982cbdd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.022951 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993842c2-65e8-4d2e-8234-2ecc982cbdd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:47.023335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993842c2-65e8-4d2e-8234-2ecc982cbdd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:47.025140 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993842c2-65e8-4d2e-8234-2ecc982cbdd8 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:47.040656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 944/1888] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:17:47.047747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993842c2-65e8-4d2e-8234-2ecc982cbdd8 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:47.061571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993842c2-65e8-4d2e-8234-2ecc982cbdd8 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:47.068039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ec440-217c-451e-9092-d618d6e7d0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:47.069163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ec440-217c-451e-9092-d618d6e7d0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.069514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ec440-217c-451e-9092-d618d6e7d0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.069966 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ec440-217c-451e-9092-d618d6e7d0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.071019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ec440-217c-451e-9092-d618d6e7d0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:47.083932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ec440-217c-451e-9092-d618d6e7d0f6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:47.098728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 945/1889] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:46 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:47.100218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff7e5d-9280-40c0-b6f8-deb7554b4eb1 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:47.217100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 945/1890] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:47 2022] POST /identity/v3/projects => generated 393 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:47.220868 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff7e5d-9280-40c0-b6f8-deb7554b4eb1 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:47.223446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ec440-217c-451e-9092-d618d6e7d0f6 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:47.318716 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c79c89-2df2-4a95-89dc-f66e2155d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:47.319343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c79c89-2df2-4a95-89dc-f66e2155d4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.319621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c79c89-2df2-4a95-89dc-f66e2155d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.319890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c79c89-2df2-4a95-89dc-f66e2155d4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.320567 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c79c89-2df2-4a95-89dc-f66e2155d4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:47.322798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c79c89-2df2-4a95-89dc-f66e2155d4a9 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:47.337821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ec440-217c-451e-9092-d618d6e7d0f6 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:47.343534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e560610-1243-4003-a084-7b32fd750f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:47.344262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e560610-1243-4003-a084-7b32fd750f81 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.344560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e560610-1243-4003-a084-7b32fd750f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.344832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e560610-1243-4003-a084-7b32fd750f81 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.345460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e560610-1243-4003-a084-7b32fd750f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:47.347362 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e560610-1243-4003-a084-7b32fd750f81 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:47.460279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 946/1891] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:47 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:17:47.467754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 946/1892] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:47 2022] POST /identity/v3/users => generated 284 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:47.472695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c79c89-2df2-4a95-89dc-f66e2155d4a9 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:47.473208 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e560610-1243-4003-a084-7b32fd750f81 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:47.509899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c79c89-2df2-4a95-89dc-f66e2155d4a9 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:47.523641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e560610-1243-4003-a084-7b32fd750f81 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:47.525506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b882eb-009a-4b0b-8c9d-b2abea98d5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:47.526337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b882eb-009a-4b0b-8c9d-b2abea98d5bd admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.526563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b882eb-009a-4b0b-8c9d-b2abea98d5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.526836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b882eb-009a-4b0b-8c9d-b2abea98d5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.527548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b882eb-009a-4b0b-8c9d-b2abea98d5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:47.529592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b882eb-009a-4b0b-8c9d-b2abea98d5bd admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:47.531763 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7214e6-88fa-4dd0-83e5-911f24a406f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:47.532753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7214e6-88fa-4dd0-83e5-911f24a406f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.533302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7214e6-88fa-4dd0-83e5-911f24a406f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.533302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7214e6-88fa-4dd0-83e5-911f24a406f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.535164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7214e6-88fa-4dd0-83e5-911f24a406f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:47.537212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7214e6-88fa-4dd0-83e5-911f24a406f7 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:47.558016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:47.560268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 947/1893] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:47.561207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 947/1894] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:47.562093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7214e6-88fa-4dd0-83e5-911f24a406f7 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:47.564103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b882eb-009a-4b0b-8c9d-b2abea98d5bd admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:47.577352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b882eb-009a-4b0b-8c9d-b2abea98d5bd admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:47.581515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7214e6-88fa-4dd0-83e5-911f24a406f7 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:47.585782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919fb73-aa27-4d85-a3c9-c153e2290f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:47.586417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919fb73-aa27-4d85-a3c9-c153e2290f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.586699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919fb73-aa27-4d85-a3c9-c153e2290f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.587043 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919fb73-aa27-4d85-a3c9-c153e2290f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.587691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919fb73-aa27-4d85-a3c9-c153e2290f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:47.589091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903761c0-04c4-4dff-a857-915eef13d0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:47.589484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919fb73-aa27-4d85-a3c9-c153e2290f0c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:47.589850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903761c0-04c4-4dff-a857-915eef13d0ba admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.590196 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903761c0-04c4-4dff-a857-915eef13d0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.590976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903761c0-04c4-4dff-a857-915eef13d0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.592040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903761c0-04c4-4dff-a857-915eef13d0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:47.594456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903761c0-04c4-4dff-a857-915eef13d0ba admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:47.615499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 948/1895] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:17:47.615714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 948/1896] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:17:47.617715 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919fb73-aa27-4d85-a3c9-c153e2290f0c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:47.619188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903761c0-04c4-4dff-a857-915eef13d0ba admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:47.637273 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919fb73-aa27-4d85-a3c9-c153e2290f0c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:47.640347 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903761c0-04c4-4dff-a857-915eef13d0ba admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:47.647095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2a755-6eed-4a5d-aa65-f1846aefb3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:47.648135 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2a755-6eed-4a5d-aa65-f1846aefb3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.648595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2a755-6eed-4a5d-aa65-f1846aefb3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.648877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2a755-6eed-4a5d-aa65-f1846aefb3cd admin admin] PATH_INFO: `/v3/projects/9758e508e5e6417dbb03c7423d6a22e3/users/acf6f0aa351847b3bcb36eb3f1654495/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.658078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39e3b0-ba1d-403b-a9d7-aa3b6c9565b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:47.658471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39e3b0-ba1d-403b-a9d7-aa3b6c9565b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.658754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39e3b0-ba1d-403b-a9d7-aa3b6c9565b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.659030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39e3b0-ba1d-403b-a9d7-aa3b6c9565b7 admin admin] PATH_INFO: `/v3/projects/84230e6c4bda40ff93b1dbbbede6df85/users/57aacfe7bcfb486697ac4323aa2c5c7f/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.667029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2a755-6eed-4a5d-aa65-f1846aefb3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9758e508e5e6417dbb03c7423d6a22e3, user_id=acf6f0aa351847b3bcb36eb3f1654495, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:47.670445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2a755-6eed-4a5d-aa65-f1846aefb3cd admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:47.685824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39e3b0-ba1d-403b-a9d7-aa3b6c9565b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84230e6c4bda40ff93b1dbbbede6df85, user_id=57aacfe7bcfb486697ac4323aa2c5c7f, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:47.689438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39e3b0-ba1d-403b-a9d7-aa3b6c9565b7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:47.822707 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 949/1897] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:47 2022] PUT /identity/v3/projects/9758e508e5e6417dbb03c7423d6a22e3/users/acf6f0aa351847b3bcb36eb3f1654495/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:47.838991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1e81-e5a6-471c-a4d1-cf12c56c28bd None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.838991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1e81-e5a6-471c-a4d1-cf12c56c28bd None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.838991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1e81-e5a6-471c-a4d1-cf12c56c28bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.841578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 949/1898] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:47 2022] PUT /identity/v3/projects/84230e6c4bda40ff93b1dbbbede6df85/users/57aacfe7bcfb486697ac4323aa2c5c7f/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:47.844452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f805-823d-43df-bd07-268e10b65c80 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:47.844813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f805-823d-43df-bd07-268e10b65c80 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:47.845221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7f805-823d-43df-bd07-268e10b65c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:47.884122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-81ed1e81-e5a6-471c-a4d1-cf12c56c28bd None None] MFA Rules not processed for user `57aacfe7bcfb486697ac4323aa2c5c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:47.885308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-81ed1e81-e5a6-471c-a4d1-cf12c56c28bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:47.895899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-00f7f805-823d-43df-bd07-268e10b65c80 None None] MFA Rules not processed for user `acf6f0aa351847b3bcb36eb3f1654495`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:47.897667 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-00f7f805-823d-43df-bd07-268e10b65c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:47.992499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 950/1899] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:48.164426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed1e81-e5a6-471c-a4d1-cf12c56c28bd None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:48.164426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-81ed1e81-e5a6-471c-a4d1-cf12c56c28bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:48.167378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 950/1900] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:48.167378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7f805-823d-43df-bd07-268e10b65c80 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:48.167378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7f805-823d-43df-bd07-268e10b65c80 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:48.167378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc324cc-9dd4-4ecd-ad62-913ac158bcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:48.168308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc324cc-9dd4-4ecd-ad62-913ac158bcf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:48.168308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc324cc-9dd4-4ecd-ad62-913ac158bcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:48.168308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc324cc-9dd4-4ecd-ad62-913ac158bcf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:48.168308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc324cc-9dd4-4ecd-ad62-913ac158bcf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:48.168308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc324cc-9dd4-4ecd-ad62-913ac158bcf3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:48.193575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed1e81-e5a6-471c-a4d1-cf12c56c28bd None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:48.198345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37360733-3180-4ef1-9217-4f08630c157a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1684abe7e6aa44a0873e43dfc146c1b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:48.199263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37360733-3180-4ef1-9217-4f08630c157a service glance] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:48.199766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37360733-3180-4ef1-9217-4f08630c157a service glance] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:48.200385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37360733-3180-4ef1-9217-4f08630c157a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:48.216444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37360733-3180-4ef1-9217-4f08630c157a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:48.218983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37360733-3180-4ef1-9217-4f08630c157a service glance] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:48.240616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 951/1901] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:48.340479 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 951/1902] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:48 2022] POST /identity/v3/projects => generated 393 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:48.341919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37360733-3180-4ef1-9217-4f08630c157a service glance] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:48.372897 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37360733-3180-4ef1-9217-4f08630c157a service glance] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:48.541906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f5bfb-c08d-4d8a-ac5b-7e0da7796379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:48.543524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f5bfb-c08d-4d8a-ac5b-7e0da7796379 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:48.543806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f5bfb-c08d-4d8a-ac5b-7e0da7796379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:48.544078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f5bfb-c08d-4d8a-ac5b-7e0da7796379 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:48.544865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f5bfb-c08d-4d8a-ac5b-7e0da7796379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:48.546988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f5bfb-c08d-4d8a-ac5b-7e0da7796379 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:48.662252 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:48.674551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 952/1903] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:48 2022] POST /identity/v3/users => generated 303 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:17:48.688260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc324cc-9dd4-4ecd-ad62-913ac158bcf3 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:48.692650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc324cc-9dd4-4ecd-ad62-913ac158bcf3 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:48.705072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6be7b1-ded8-4d14-9cf8-1d23e930c313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:48.705437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6be7b1-ded8-4d14-9cf8-1d23e930c313 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:48.705764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6be7b1-ded8-4d14-9cf8-1d23e930c313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:48.705978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6be7b1-ded8-4d14-9cf8-1d23e930c313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:48.707875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6be7b1-ded8-4d14-9cf8-1d23e930c313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:48.713960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6be7b1-ded8-4d14-9cf8-1d23e930c313 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:48.724886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 952/1904] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:48.729879 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f5bfb-c08d-4d8a-ac5b-7e0da7796379 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:48.741975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f5bfb-c08d-4d8a-ac5b-7e0da7796379 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:48.747349 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd87d1-f378-441f-b610-ffc95819b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:48.748115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd87d1-f378-441f-b610-ffc95819b198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:48.748490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd87d1-f378-441f-b610-ffc95819b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:48.748833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd87d1-f378-441f-b610-ffc95819b198 admin admin] PATH_INFO: `/v3/projects/3ba85d891ad3410ab90852fa2f25d1e0/users/d5cc9f8517b54835a536b15d1864eb0a/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:48.768712 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd87d1-f378-441f-b610-ffc95819b198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba85d891ad3410ab90852fa2f25d1e0, user_id=d5cc9f8517b54835a536b15d1864eb0a, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:48.773626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd87d1-f378-441f-b610-ffc95819b198 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:48.877850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 953/1905] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:48 2022] PUT /identity/v3/projects/3ba85d891ad3410ab90852fa2f25d1e0/users/d5cc9f8517b54835a536b15d1864eb0a/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:48.882550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6be7b1-ded8-4d14-9cf8-1d23e930c313 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:48.900657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6be7b1-ded8-4d14-9cf8-1d23e930c313 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:48.989817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a801298-e896-4383-8629-816413569d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:48.990951 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801298-e896-4383-8629-816413569d21 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:48.991304 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801298-e896-4383-8629-816413569d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:48.991649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a801298-e896-4383-8629-816413569d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:48.992424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a801298-e896-4383-8629-816413569d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:48.996419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a801298-e896-4383-8629-816413569d21 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:49.022746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 953/1906] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:49.027156 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd87d1-f378-441f-b610-ffc95819b198 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:49.054603 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd87d1-f378-441f-b610-ffc95819b198 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:49.060544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd8556-455a-4c2b-9db7-8958a9ee3a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:49.061463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd8556-455a-4c2b-9db7-8958a9ee3a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:49.062403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd8556-455a-4c2b-9db7-8958a9ee3a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:49.062942 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd8556-455a-4c2b-9db7-8958a9ee3a58 admin admin] PATH_INFO: `/v3/projects/3ba85d891ad3410ab90852fa2f25d1e0/users/d5cc9f8517b54835a536b15d1864eb0a/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:49.065850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd8556-455a-4c2b-9db7-8958a9ee3a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba85d891ad3410ab90852fa2f25d1e0, user_id=d5cc9f8517b54835a536b15d1864eb0a, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:49.069808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd8556-455a-4c2b-9db7-8958a9ee3a58 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:49.083550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 954/1907] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:49 2022] PUT /identity/v3/projects/3ba85d891ad3410ab90852fa2f25d1e0/users/d5cc9f8517b54835a536b15d1864eb0a/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:49.096380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f17a6-cfc4-4690-952e-b1f329291ef7 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:49.096708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f17a6-cfc4-4690-952e-b1f329291ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:49.097814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f17a6-cfc4-4690-952e-b1f329291ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:49.145158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-909f17a6-cfc4-4690-952e-b1f329291ef7 None None] MFA Rules not processed for user `d5cc9f8517b54835a536b15d1864eb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:49.146986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-909f17a6-cfc4-4690-952e-b1f329291ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:49.250518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 954/1908] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:49.261160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd8556-455a-4c2b-9db7-8958a9ee3a58 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:49.263010 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b7cd8556-455a-4c2b-9db7-8958a9ee3a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:49.332744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd8556-455a-4c2b-9db7-8958a9ee3a58 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:49.340284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845d7ce-e0c9-49f7-bc0f-aa709883cfe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:49.344307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845d7ce-e0c9-49f7-bc0f-aa709883cfe9 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:49.344307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845d7ce-e0c9-49f7-bc0f-aa709883cfe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:49.344307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845d7ce-e0c9-49f7-bc0f-aa709883cfe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:49.355253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845d7ce-e0c9-49f7-bc0f-aa709883cfe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:49.357083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845d7ce-e0c9-49f7-bc0f-aa709883cfe9 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:49.371468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 955/1909] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:49 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:49.432303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f17a6-cfc4-4690-952e-b1f329291ef7 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:49.446136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f17a6-cfc4-4690-952e-b1f329291ef7 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:49.450571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c424b-73bc-4f3d-86be-815b9126d528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:49.451236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c424b-73bc-4f3d-86be-815b9126d528 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:49.451554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c424b-73bc-4f3d-86be-815b9126d528 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:49.451839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c424b-73bc-4f3d-86be-815b9126d528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:49.537320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c424b-73bc-4f3d-86be-815b9126d528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:49.538814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c424b-73bc-4f3d-86be-815b9126d528 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:49.549278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 955/1910] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:49.599554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:50.478011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:51.462914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:53.210833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:53.307071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:53.552811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:55.285812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:56.090096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:56.659216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845d7ce-e0c9-49f7-bc0f-aa709883cfe9 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:56.755925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845d7ce-e0c9-49f7-bc0f-aa709883cfe9 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:56.761217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:56.761981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:56.762273 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:56.762549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] PATH_INFO: `/v3/users/acf6f0aa351847b3bcb36eb3f1654495` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:56.764032 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf6f0aa351847b3bcb36eb3f1654495)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:56.766121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:57.079985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf6f0aa351847b3bcb36eb3f1654495'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:57.082872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf6f0aa351847b3bcb36eb3f1654495'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:57.082872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf6f0aa351847b3bcb36eb3f1654495'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:57.099173 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf6f0aa351847b3bcb36eb3f1654495'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:57.249783 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf6f0aa351847b3bcb36eb3f1654495'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:57.264142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 956/1911] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:56 2022] DELETE /identity/v3/users/acf6f0aa351847b3bcb36eb3f1654495 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:57.268829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370d515-2376-40d9-87bc-fb75ec91eb2d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:57.268829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370d515-2376-40d9-87bc-fb75ec91eb2d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:57.268829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370d515-2376-40d9-87bc-fb75ec91eb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:57.289716 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b370d515-2376-40d9-87bc-fb75ec91eb2d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:57.291493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b370d515-2376-40d9-87bc-fb75ec91eb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:57.360420 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 956/1912] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:57.370642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:57.372209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:57.473988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235327e-a08e-48e2-b468-e01fd91fe0c9 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:57.481620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8fc36-7757-4f17-8a5d-8b6e8e4711e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:57.482259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8fc36-7757-4f17-8a5d-8b6e8e4711e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:57.482538 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8fc36-7757-4f17-8a5d-8b6e8e4711e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:57.482839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8fc36-7757-4f17-8a5d-8b6e8e4711e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:57.495432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8fc36-7757-4f17-8a5d-8b6e8e4711e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:57.497097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8fc36-7757-4f17-8a5d-8b6e8e4711e6 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:57.518770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 957/1913] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:57.891168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:58.117592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370d515-2376-40d9-87bc-fb75ec91eb2d None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:58.119515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b370d515-2376-40d9-87bc-fb75ec91eb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:58.143607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370d515-2376-40d9-87bc-fb75ec91eb2d None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:58.149000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:58.150411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:58.150704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:58.151455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] PATH_INFO: `/v3/projects/9758e508e5e6417dbb03c7423d6a22e3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:58.156070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9758e508e5e6417dbb03c7423d6a22e3)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:58.156070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:58.302632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9758e508e5e6417dbb03c7423d6a22e3', 'request_id': 'req-ffad03b8-4ad0-4288-a524-cf067bffeac2'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:58.435668 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9758e508e5e6417dbb03c7423d6a22e3', 'request_id': 'req-ffad03b8-4ad0-4288-a524-cf067bffeac2'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:58.443931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9758e508e5e6417dbb03c7423d6a22e3', 'request_id': 'req-ffad03b8-4ad0-4288-a524-cf067bffeac2'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:58.454645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] The token cache is being invalidate because project 9758e508e5e6417dbb03c7423d6a22e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:58.454992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:58.455651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:58.457185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 957/1914] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:58 2022] DELETE /identity/v3/projects/9758e508e5e6417dbb03c7423d6a22e3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:58.461202 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8fc36-7757-4f17-8a5d-8b6e8e4711e6 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:58.461355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:58.471191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8fc36-7757-4f17-8a5d-8b6e8e4711e6 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:58.546584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a2afa-42c0-4fea-90bc-1b1f6a624bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:58.546584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a2afa-42c0-4fea-90bc-1b1f6a624bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:58.546584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a2afa-42c0-4fea-90bc-1b1f6a624bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:58.546584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a2afa-42c0-4fea-90bc-1b1f6a624bb3 admin admin] PATH_INFO: `/v3/users/d5cc9f8517b54835a536b15d1864eb0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:58.547062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a2afa-42c0-4fea-90bc-1b1f6a624bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5cc9f8517b54835a536b15d1864eb0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:58.547062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a2afa-42c0-4fea-90bc-1b1f6a624bb3 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:58.721387 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c91a2afa-42c0-4fea-90bc-1b1f6a624bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5cc9f8517b54835a536b15d1864eb0a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:58.722398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c91a2afa-42c0-4fea-90bc-1b1f6a624bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5cc9f8517b54835a536b15d1864eb0a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:58.723327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c91a2afa-42c0-4fea-90bc-1b1f6a624bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5cc9f8517b54835a536b15d1864eb0a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:58.764014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c91a2afa-42c0-4fea-90bc-1b1f6a624bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5cc9f8517b54835a536b15d1864eb0a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:58.912328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c91a2afa-42c0-4fea-90bc-1b1f6a624bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5cc9f8517b54835a536b15d1864eb0a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:58.933362 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 958/1915] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:58 2022] DELETE /identity/v3/users/d5cc9f8517b54835a536b15d1864eb0a => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:59.412650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:59.414857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:59.457007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad03b8-4ad0-4288-a524-cf067bffeac2 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:59.593193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:59.594384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:59.594822 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:59.595324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] PATH_INFO: `/v3/projects/3ba85d891ad3410ab90852fa2f25d1e0` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:59.596907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba85d891ad3410ab90852fa2f25d1e0)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:59.599201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:59.807730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba85d891ad3410ab90852fa2f25d1e0', 'request_id': 'req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:59.918083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba85d891ad3410ab90852fa2f25d1e0', 'request_id': 'req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:59.926566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba85d891ad3410ab90852fa2f25d1e0', 'request_id': 'req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:59.939647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] The token cache is being invalidate because project 3ba85d891ad3410ab90852fa2f25d1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:59.939942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:59.942254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a92d1a83-ecbe-4173-b4c4-87bebcea3ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:59.944107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 958/1916] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:59 2022] DELETE /identity/v3/projects/3ba85d891ad3410ab90852fa2f25d1e0 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:59.954442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b581-cbc8-4b9c-9b35-e324686d309c None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:59.956266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b581-cbc8-4b9c-9b35-e324686d309c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:59.956811 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61b581-cbc8-4b9c-9b35-e324686d309c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:59.979470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ca61b581-cbc8-4b9c-9b35-e324686d309c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:59.980905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ca61b581-cbc8-4b9c-9b35-e324686d309c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:00.063449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 959/1917] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:00.072109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e83a4-815d-4f4d-af32-ef30f04412c2 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:00.072419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e83a4-815d-4f4d-af32-ef30f04412c2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:00.072721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e83a4-815d-4f4d-af32-ef30f04412c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:00.125644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ae5e83a4-815d-4f4d-af32-ef30f04412c2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:00.126995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ae5e83a4-815d-4f4d-af32-ef30f04412c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:00.147112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 959/1918] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:00.151111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61b581-cbc8-4b9c-9b35-e324686d309c None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:00.161908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61b581-cbc8-4b9c-9b35-e324686d309c None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:00.166329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:00.170346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea71a2-449c-4f89-88f9-98f973aca44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:00.171502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea71a2-449c-4f89-88f9-98f973aca44e admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:00.171776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea71a2-449c-4f89-88f9-98f973aca44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:00.172069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea71a2-449c-4f89-88f9-98f973aca44e admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:00.172790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea71a2-449c-4f89-88f9-98f973aca44e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:00.173092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea71a2-449c-4f89-88f9-98f973aca44e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:00.174791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea71a2-449c-4f89-88f9-98f973aca44e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:00.189464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 960/1919] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:18:00.200164 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e83a4-815d-4f4d-af32-ef30f04412c2 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:00.210040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e83a4-815d-4f4d-af32-ef30f04412c2 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:00.214843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1392a-6679-4ab3-9496-73d022e077bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:00.215461 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1392a-6679-4ab3-9496-73d022e077bb admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:00.215741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1392a-6679-4ab3-9496-73d022e077bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:00.216014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1392a-6679-4ab3-9496-73d022e077bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:00.216691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1392a-6679-4ab3-9496-73d022e077bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:00.219187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1392a-6679-4ab3-9496-73d022e077bb admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:00.366144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 960/1920] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:00 2022] POST /identity/v3/projects => generated 401 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:00.370903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea71a2-449c-4f89-88f9-98f973aca44e admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:00.382556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea71a2-449c-4f89-88f9-98f973aca44e admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:00.448851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9836a-d7f0-44cb-b505-1e526bcb50d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:00.450492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9836a-d7f0-44cb-b505-1e526bcb50d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:00.450714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9836a-d7f0-44cb-b505-1e526bcb50d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:00.451042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9836a-d7f0-44cb-b505-1e526bcb50d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:00.451643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9836a-d7f0-44cb-b505-1e526bcb50d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:00.453945 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9836a-d7f0-44cb-b505-1e526bcb50d5 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:00.547907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 961/1921] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:00 2022] POST /identity/v3/users => generated 301 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:00.552252 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1392a-6679-4ab3-9496-73d022e077bb admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:00.565305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1392a-6679-4ab3-9496-73d022e077bb admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:00.574261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02a454-01c9-4f7d-b617-affe8e7c1217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:00.575354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02a454-01c9-4f7d-b617-affe8e7c1217 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:00.575866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02a454-01c9-4f7d-b617-affe8e7c1217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:00.576927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02a454-01c9-4f7d-b617-affe8e7c1217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:00.578777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02a454-01c9-4f7d-b617-affe8e7c1217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:00.582520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02a454-01c9-4f7d-b617-affe8e7c1217 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:00.609061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 961/1922] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:18:00.611117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9836a-d7f0-44cb-b505-1e526bcb50d5 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:00.623622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9836a-d7f0-44cb-b505-1e526bcb50d5 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:00.629183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6b226-4241-43a6-ab06-5ba58265f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:00.629992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b226-4241-43a6-ab06-5ba58265f74e admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:00.630433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b226-4241-43a6-ab06-5ba58265f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:00.630714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b226-4241-43a6-ab06-5ba58265f74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:00.634097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6b226-4241-43a6-ab06-5ba58265f74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:00.634097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6b226-4241-43a6-ab06-5ba58265f74e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:00.650110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 962/1923] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:00.658349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02a454-01c9-4f7d-b617-affe8e7c1217 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:00.678041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02a454-01c9-4f7d-b617-affe8e7c1217 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:00.683610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98776b-ad10-4c67-9691-7adedb3a47ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:00.684430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98776b-ad10-4c67-9691-7adedb3a47ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:00.684778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98776b-ad10-4c67-9691-7adedb3a47ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:00.685141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb98776b-ad10-4c67-9691-7adedb3a47ab admin admin] PATH_INFO: `/v3/projects/4601cb2b9e3a4be9b152e12cd92bf34b/users/f99606935bc041e0a47d671be7ff157c/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:00.712627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98776b-ad10-4c67-9691-7adedb3a47ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4601cb2b9e3a4be9b152e12cd92bf34b, user_id=f99606935bc041e0a47d671be7ff157c, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:00.715683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb98776b-ad10-4c67-9691-7adedb3a47ab admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:00.765497 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:00.820994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 962/1924] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:00 2022] PUT /identity/v3/projects/4601cb2b9e3a4be9b152e12cd92bf34b/users/f99606935bc041e0a47d671be7ff157c/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:00.832411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a122-8b0e-4c21-9d7f-9e0d198966a4 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:00.832706 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a122-8b0e-4c21-9d7f-9e0d198966a4 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:00.832973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2a122-8b0e-4c21-9d7f-9e0d198966a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:00.872368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-71d2a122-8b0e-4c21-9d7f-9e0d198966a4 None None] MFA Rules not processed for user `f99606935bc041e0a47d671be7ff157c`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:00.873886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-71d2a122-8b0e-4c21-9d7f-9e0d198966a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:00.973471 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 963/1925] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:00 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:00.978142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98776b-ad10-4c67-9691-7adedb3a47ab admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:01.064800 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb98776b-ad10-4c67-9691-7adedb3a47ab admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:01.070207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07d081-b525-41e1-b981-0ea9e16facec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:01.070909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d081-b525-41e1-b981-0ea9e16facec admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:01.071185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d081-b525-41e1-b981-0ea9e16facec admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:01.071460 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d081-b525-41e1-b981-0ea9e16facec admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:01.072113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07d081-b525-41e1-b981-0ea9e16facec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:01.074088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07d081-b525-41e1-b981-0ea9e16facec admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:01.219981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 963/1926] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:00 2022] POST /identity/v3/projects => generated 401 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:01.223938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2a122-8b0e-4c21-9d7f-9e0d198966a4 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:01.235730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2a122-8b0e-4c21-9d7f-9e0d198966a4 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:01.305638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9aa5b-c108-45b9-b1e1-1e08448cf21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:01.305638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9aa5b-c108-45b9-b1e1-1e08448cf21f admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:01.305914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9aa5b-c108-45b9-b1e1-1e08448cf21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:01.306123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9aa5b-c108-45b9-b1e1-1e08448cf21f admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:01.306772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9aa5b-c108-45b9-b1e1-1e08448cf21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:01.308865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9aa5b-c108-45b9-b1e1-1e08448cf21f admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:01.455728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 964/1927] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:01 2022] POST /identity/v3/users => generated 307 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:01.460204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07d081-b525-41e1-b981-0ea9e16facec admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:01.473413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07d081-b525-41e1-b981-0ea9e16facec admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:01.489743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f84e6-0b68-4b84-ada7-5364c79ceb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:01.489743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f84e6-0b68-4b84-ada7-5364c79ceb18 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:01.489743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f84e6-0b68-4b84-ada7-5364c79ceb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:01.489743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f84e6-0b68-4b84-ada7-5364c79ceb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:01.490317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f84e6-0b68-4b84-ada7-5364c79ceb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:01.490317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f84e6-0b68-4b84-ada7-5364c79ceb18 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:01.496919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 964/1928] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:01.501987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9aa5b-c108-45b9-b1e1-1e08448cf21f admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:01.514137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9aa5b-c108-45b9-b1e1-1e08448cf21f admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:01.524308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c09c18-5ed2-4a5c-b851-a8d58ca6464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:01.525431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09c18-5ed2-4a5c-b851-a8d58ca6464b admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:01.525869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09c18-5ed2-4a5c-b851-a8d58ca6464b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:01.526323 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c09c18-5ed2-4a5c-b851-a8d58ca6464b admin admin] PATH_INFO: `/v3/projects/3cf5140a87ae4e69aa093d101d247e99/users/bb0af61ab1c24a9d8e4a36a8e510b365/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:01.543076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c09c18-5ed2-4a5c-b851-a8d58ca6464b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf5140a87ae4e69aa093d101d247e99, user_id=bb0af61ab1c24a9d8e4a36a8e510b365, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:01.545677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c09c18-5ed2-4a5c-b851-a8d58ca6464b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:01.644926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 965/1929] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:01 2022] PUT /identity/v3/projects/3cf5140a87ae4e69aa093d101d247e99/users/bb0af61ab1c24a9d8e4a36a8e510b365/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:01.650455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f84e6-0b68-4b84-ada7-5364c79ceb18 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:01.660874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f84e6-0b68-4b84-ada7-5364c79ceb18 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:01.738234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b70725-122f-4024-be4a-528b4ca91489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:01.739292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b70725-122f-4024-be4a-528b4ca91489 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:01.739808 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b70725-122f-4024-be4a-528b4ca91489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:01.740351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b70725-122f-4024-be4a-528b4ca91489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:01.741563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b70725-122f-4024-be4a-528b4ca91489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:01.745722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b70725-122f-4024-be4a-528b4ca91489 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:01.766432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 965/1930] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:01 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:18:01.770994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c09c18-5ed2-4a5c-b851-a8d58ca6464b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:01.792494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c09c18-5ed2-4a5c-b851-a8d58ca6464b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:01.802551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b1c47-f082-4753-8443-a44a043bc1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:01.803830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b1c47-f082-4753-8443-a44a043bc1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:01.804375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b1c47-f082-4753-8443-a44a043bc1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:01.804870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b1c47-f082-4753-8443-a44a043bc1ea admin admin] PATH_INFO: `/v3/projects/3cf5140a87ae4e69aa093d101d247e99/users/bb0af61ab1c24a9d8e4a36a8e510b365/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:01.808868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b1c47-f082-4753-8443-a44a043bc1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf5140a87ae4e69aa093d101d247e99, user_id=bb0af61ab1c24a9d8e4a36a8e510b365, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:01.815193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b1c47-f082-4753-8443-a44a043bc1ea admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:01.840838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 966/1931] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:01 2022] PUT /identity/v3/projects/3cf5140a87ae4e69aa093d101d247e99/users/bb0af61ab1c24a9d8e4a36a8e510b365/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:01.855003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc917a7-7ffe-4751-b738-3eda8803e278 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:01.855385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc917a7-7ffe-4751-b738-3eda8803e278 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:01.855844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc917a7-7ffe-4751-b738-3eda8803e278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:01.898835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-7bc917a7-7ffe-4751-b738-3eda8803e278 None None] MFA Rules not processed for user `bb0af61ab1c24a9d8e4a36a8e510b365`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:01.901603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7bc917a7-7ffe-4751-b738-3eda8803e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:02.039393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 966/1932] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:01 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:02.089088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b1c47-f082-4753-8443-a44a043bc1ea admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:02.091339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-004b1c47-f082-4753-8443-a44a043bc1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:02.211265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b1c47-f082-4753-8443-a44a043bc1ea admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:02.219488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d56df8-a869-40d4-86de-c42f009b5d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:02.223915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d56df8-a869-40d4-86de-c42f009b5d7e service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:02.223915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d56df8-a869-40d4-86de-c42f009b5d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:02.223915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d56df8-a869-40d4-86de-c42f009b5d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:02.243822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d56df8-a869-40d4-86de-c42f009b5d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:02.246811 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d56df8-a869-40d4-86de-c42f009b5d7e service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:02.271728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 967/1933] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:02 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:02.570235 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:02.584169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc917a7-7ffe-4751-b738-3eda8803e278 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:02.596201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc917a7-7ffe-4751-b738-3eda8803e278 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:02.601423 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a27914-0f1b-48cf-8cd2-d56665b77f2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:02.602528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a27914-0f1b-48cf-8cd2-d56665b77f2e service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:02.604291 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a27914-0f1b-48cf-8cd2-d56665b77f2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:02.604291 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a27914-0f1b-48cf-8cd2-d56665b77f2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:02.677840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a27914-0f1b-48cf-8cd2-d56665b77f2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:02.680911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a27914-0f1b-48cf-8cd2-d56665b77f2e service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:02.704020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 967/1934] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:02 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:03.073789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:04.449757 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:04.799320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:05.873534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:06.181193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:07.455901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:07.558707 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:08.032940 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:08.246108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d56df8-a869-40d4-86de-c42f009b5d7e service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:08.297239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:08.316528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d56df8-a869-40d4-86de-c42f009b5d7e service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:08.322608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:08.323464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:08.323913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:08.324346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] PATH_INFO: `/v3/users/f99606935bc041e0a47d671be7ff157c` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:08.325626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99606935bc041e0a47d671be7ff157c)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:08.327713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:08.545012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99606935bc041e0a47d671be7ff157c'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:08.545684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99606935bc041e0a47d671be7ff157c'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:08.547483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99606935bc041e0a47d671be7ff157c'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:08.560798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99606935bc041e0a47d671be7ff157c'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:08.644019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99606935bc041e0a47d671be7ff157c'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:08.658354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 968/1935] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:08 2022] DELETE /identity/v3/users/f99606935bc041e0a47d671be7ff157c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:08.663249 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe879d-808c-438f-b8f4-44b32e5d12df None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:08.663766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe879d-808c-438f-b8f4-44b32e5d12df None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:08.663854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe879d-808c-438f-b8f4-44b32e5d12df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:08.684564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-efbe879d-808c-438f-b8f4-44b32e5d12df None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:08.685903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-efbe879d-808c-438f-b8f4-44b32e5d12df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:08.754539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 968/1936] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:08.761606 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:08.763339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:08.829510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a894c-5863-4eda-8b74-b054350f2595 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:08.834493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e8100-49a7-432c-94f5-809c6aba5a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:08.835116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8100-49a7-432c-94f5-809c6aba5a70 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:08.835397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8100-49a7-432c-94f5-809c6aba5a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:08.835670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e8100-49a7-432c-94f5-809c6aba5a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:08.846623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e8100-49a7-432c-94f5-809c6aba5a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:08.848118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e8100-49a7-432c-94f5-809c6aba5a70 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:08.858066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 969/1937] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:18:09.084497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:09.260851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:09.319815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe879d-808c-438f-b8f4-44b32e5d12df None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:09.321673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-efbe879d-808c-438f-b8f4-44b32e5d12df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:09.343225 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e8100-49a7-432c-94f5-809c6aba5a70 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:09.344837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-990e8100-49a7-432c-94f5-809c6aba5a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:09.359221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe879d-808c-438f-b8f4-44b32e5d12df None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:09.366228 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:09.371946 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e8100-49a7-432c-94f5-809c6aba5a70 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:09.372080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:09.372080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:09.372080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] PATH_INFO: `/v3/projects/4601cb2b9e3a4be9b152e12cd92bf34b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:09.372080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4601cb2b9e3a4be9b152e12cd92bf34b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:09.373342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:09.381326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eecb1a-de2e-4932-9b8e-0b8a5aee63d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:09.382328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eecb1a-de2e-4932-9b8e-0b8a5aee63d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:09.382707 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eecb1a-de2e-4932-9b8e-0b8a5aee63d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:09.383116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eecb1a-de2e-4932-9b8e-0b8a5aee63d2 admin admin] PATH_INFO: `/v3/users/ff0762a857a94fcb86c99dce8142284e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:09.384950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eecb1a-de2e-4932-9b8e-0b8a5aee63d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0762a857a94fcb86c99dce8142284e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:09.388960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eecb1a-de2e-4932-9b8e-0b8a5aee63d2 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:09.522154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4601cb2b9e3a4be9b152e12cd92bf34b', 'request_id': 'req-d83d70ca-0304-46d4-9854-4596cdeb451e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:09.615136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4601cb2b9e3a4be9b152e12cd92bf34b', 'request_id': 'req-d83d70ca-0304-46d4-9854-4596cdeb451e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:09.624017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4601cb2b9e3a4be9b152e12cd92bf34b', 'request_id': 'req-d83d70ca-0304-46d4-9854-4596cdeb451e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:09.632530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-85eecb1a-de2e-4932-9b8e-0b8a5aee63d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0762a857a94fcb86c99dce8142284e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:09.633190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-85eecb1a-de2e-4932-9b8e-0b8a5aee63d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0762a857a94fcb86c99dce8142284e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:09.633804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-85eecb1a-de2e-4932-9b8e-0b8a5aee63d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0762a857a94fcb86c99dce8142284e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:09.639600 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] The token cache is being invalidate because project 4601cb2b9e3a4be9b152e12cd92bf34b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:09.639983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:09.640658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:09.642393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 969/1938] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:09 2022] DELETE /identity/v3/projects/4601cb2b9e3a4be9b152e12cd92bf34b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:09.646237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:09.647613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:09.648756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-85eecb1a-de2e-4932-9b8e-0b8a5aee63d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0762a857a94fcb86c99dce8142284e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:09.719268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-85eecb1a-de2e-4932-9b8e-0b8a5aee63d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0762a857a94fcb86c99dce8142284e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:09.719719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d70ca-0304-46d4-9854-4596cdeb451e admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:09.725266 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:09.725992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:09.726282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:09.726710 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] PATH_INFO: `/v3/users/bb0af61ab1c24a9d8e4a36a8e510b365` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:09.728205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb0af61ab1c24a9d8e4a36a8e510b365)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:09.730298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:09.736659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 970/1939] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:09 2022] DELETE /identity/v3/users/ff0762a857a94fcb86c99dce8142284e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:09.741432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cac18d-1a4a-4756-8570-4e511a39494b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:09.741838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cac18d-1a4a-4756-8570-4e511a39494b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:09.742244 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cac18d-1a4a-4756-8570-4e511a39494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:09.765809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-71cac18d-1a4a-4756-8570-4e511a39494b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:09.767021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-71cac18d-1a4a-4756-8570-4e511a39494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:09.828281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:09.833555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 971/1940] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:09.851152 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cac18d-1a4a-4756-8570-4e511a39494b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:09.852719 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-71cac18d-1a4a-4756-8570-4e511a39494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:09.928486 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cac18d-1a4a-4756-8570-4e511a39494b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:09.933185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112e1c6-b8b5-4f0e-ab05-19ea919725bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:09.934038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112e1c6-b8b5-4f0e-ab05-19ea919725bd service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:09.934316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112e1c6-b8b5-4f0e-ab05-19ea919725bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:09.934591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112e1c6-b8b5-4f0e-ab05-19ea919725bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:09.946968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112e1c6-b8b5-4f0e-ab05-19ea919725bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:09.949916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112e1c6-b8b5-4f0e-ab05-19ea919725bd service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:09.952856 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:09.974919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 972/1941] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:10.011822 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb0af61ab1c24a9d8e4a36a8e510b365'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:10.012556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb0af61ab1c24a9d8e4a36a8e510b365'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:10.028441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb0af61ab1c24a9d8e4a36a8e510b365'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:10.031368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb0af61ab1c24a9d8e4a36a8e510b365'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:10.050848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb0af61ab1c24a9d8e4a36a8e510b365'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:10.154163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 970/1942] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:09 2022] DELETE /identity/v3/users/bb0af61ab1c24a9d8e4a36a8e510b365 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:10.181434 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:10.586689 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:10.820407 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112e1c6-b8b5-4f0e-ab05-19ea919725bd service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:10.823885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1112e1c6-b8b5-4f0e-ab05-19ea919725bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:10.838431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112e1c6-b8b5-4f0e-ab05-19ea919725bd service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:10.870640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:10.873190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:10.926563 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:10.926720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:10.927032 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:10.927317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] PATH_INFO: `/v3/projects/e6ab9372679947008c4f924f19b259be` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:10.928588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6ab9372679947008c4f924f19b259be)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:10.930531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:10.977590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c7058-f798-469b-80db-927d347e78aa admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:10.982466 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:10.983132 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:10.983452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:10.983775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] PATH_INFO: `/v3/projects/3cf5140a87ae4e69aa093d101d247e99` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:10.985172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf5140a87ae4e69aa093d101d247e99)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:10.987113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:11.095957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6ab9372679947008c4f924f19b259be', 'request_id': 'req-ff3683ab-f57e-41cc-9424-a5197f4188b0'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:11.120988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf5140a87ae4e69aa093d101d247e99', 'request_id': 'req-4b9fea28-4dae-4984-8b34-f826ef2f02bf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:11.232520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6ab9372679947008c4f924f19b259be', 'request_id': 'req-ff3683ab-f57e-41cc-9424-a5197f4188b0'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:11.245224 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6ab9372679947008c4f924f19b259be', 'request_id': 'req-ff3683ab-f57e-41cc-9424-a5197f4188b0'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:11.264749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] The token cache is being invalidate because project e6ab9372679947008c4f924f19b259be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:11.266257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:11.268114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ff3683ab-f57e-41cc-9424-a5197f4188b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:11.274588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 973/1943] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:10 2022] DELETE /identity/v3/projects/e6ab9372679947008c4f924f19b259be => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:11.278376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf5140a87ae4e69aa093d101d247e99', 'request_id': 'req-4b9fea28-4dae-4984-8b34-f826ef2f02bf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:11.284045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad9f28-51cb-4892-aeb9-8a0f2bcb1d4b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.284045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad9f28-51cb-4892-aeb9-8a0f2bcb1d4b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.284045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad9f28-51cb-4892-aeb9-8a0f2bcb1d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.288695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf5140a87ae4e69aa093d101d247e99', 'request_id': 'req-4b9fea28-4dae-4984-8b34-f826ef2f02bf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:11.302580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] The token cache is being invalidate because project 3cf5140a87ae4e69aa093d101d247e99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:11.303044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:11.303909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4b9fea28-4dae-4984-8b34-f826ef2f02bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:11.306206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 971/1944] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:10 2022] DELETE /identity/v3/projects/3cf5140a87ae4e69aa093d101d247e99 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:11.310852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3dcdf-870e-40cf-b00e-30a43cfa6529 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.311055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3dcdf-870e-40cf-b00e-30a43cfa6529 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.311603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3dcdf-870e-40cf-b00e-30a43cfa6529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.314639 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-4dad9f28-51cb-4892-aeb9-8a0f2bcb1d4b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:11.317328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4dad9f28-51cb-4892-aeb9-8a0f2bcb1d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:11.339632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-55d3dcdf-870e-40cf-b00e-30a43cfa6529 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:11.341012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-55d3dcdf-870e-40cf-b00e-30a43cfa6529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:11.408946 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 974/1945] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:11.417210 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd4e06-26d6-4380-9d68-a78b2e81179f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.417488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd4e06-26d6-4380-9d68-a78b2e81179f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.417731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd4e06-26d6-4380-9d68-a78b2e81179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.432267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 972/1946] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:11.438523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f3a5b-1e6a-4ba2-8880-ef31a14a4dae None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.438975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f3a5b-1e6a-4ba2-8880-ef31a14a4dae None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.439876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f3a5b-1e6a-4ba2-8880-ef31a14a4dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.449969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-eadd4e06-26d6-4380-9d68-a78b2e81179f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:11.450549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:11.452478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-eadd4e06-26d6-4380-9d68-a78b2e81179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:11.462760 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:11.470269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-393f3a5b-1e6a-4ba2-8880-ef31a14a4dae None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:11.471875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-393f3a5b-1e6a-4ba2-8880-ef31a14a4dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:11.479353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 975/1947] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:11.479859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd4e06-26d6-4380-9d68-a78b2e81179f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:11.489809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 973/1948] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:11.491191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd4e06-26d6-4380-9d68-a78b2e81179f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:11.495937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf770140-a232-4b30-a9f5-33e3e0624f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:11.496636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770140-a232-4b30-a9f5-33e3e0624f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.496919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770140-a232-4b30-a9f5-33e3e0624f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.497198 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770140-a232-4b30-a9f5-33e3e0624f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.497863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf770140-a232-4b30-a9f5-33e3e0624f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:11.498170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf770140-a232-4b30-a9f5-33e3e0624f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:11.499566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f3a5b-1e6a-4ba2-8880-ef31a14a4dae None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:11.500434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf770140-a232-4b30-a9f5-33e3e0624f98 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:11.509604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f3a5b-1e6a-4ba2-8880-ef31a14a4dae None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:11.515212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6da8d-ebb7-47ec-acd8-a6b82d707ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:11.516058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6da8d-ebb7-47ec-acd8-a6b82d707ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.516875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6da8d-ebb7-47ec-acd8-a6b82d707ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.517279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6da8d-ebb7-47ec-acd8-a6b82d707ff1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.518171 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6da8d-ebb7-47ec-acd8-a6b82d707ff1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:11.518655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6da8d-ebb7-47ec-acd8-a6b82d707ff1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:11.519576 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 976/1949] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:18:11.520059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6da8d-ebb7-47ec-acd8-a6b82d707ff1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:11.520608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf770140-a232-4b30-a9f5-33e3e0624f98 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:11.538104 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf770140-a232-4b30-a9f5-33e3e0624f98 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:11.538945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 974/1950] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:18:11.543907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8961a-26d3-497a-9cef-4fb94aeecfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:11.549396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8961a-26d3-497a-9cef-4fb94aeecfad admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.549396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8961a-26d3-497a-9cef-4fb94aeecfad admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.549396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8961a-26d3-497a-9cef-4fb94aeecfad admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.549396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8961a-26d3-497a-9cef-4fb94aeecfad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:11.549396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8961a-26d3-497a-9cef-4fb94aeecfad admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:11.552484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6da8d-ebb7-47ec-acd8-a6b82d707ff1 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:11.563576 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6da8d-ebb7-47ec-acd8-a6b82d707ff1 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:11.569401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4f43d-36df-4622-ab32-ba8be56f86a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:11.570017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4f43d-36df-4622-ab32-ba8be56f86a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.570436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4f43d-36df-4622-ab32-ba8be56f86a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.570718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4f43d-36df-4622-ab32-ba8be56f86a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.571351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4f43d-36df-4622-ab32-ba8be56f86a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:11.573352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4f43d-36df-4622-ab32-ba8be56f86a8 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:11.691522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 975/1951] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:11 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:11.696286 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4f43d-36df-4622-ab32-ba8be56f86a8 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:11.697217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 977/1952] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:11 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:11.700919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8961a-26d3-497a-9cef-4fb94aeecfad admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:11.806751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8961a-26d3-497a-9cef-4fb94aeecfad admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:11.808962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4f43d-36df-4622-ab32-ba8be56f86a8 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:11.815933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40854014-157a-4539-bf16-ed1250222b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:11.817400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854014-157a-4539-bf16-ed1250222b74 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.818562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854014-157a-4539-bf16-ed1250222b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.819335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7057b5-d698-41bd-9c5a-ab687f0d1702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:11.825110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854014-157a-4539-bf16-ed1250222b74 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.825777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7057b5-d698-41bd-9c5a-ab687f0d1702 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.825777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7057b5-d698-41bd-9c5a-ab687f0d1702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.825777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7057b5-d698-41bd-9c5a-ab687f0d1702 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.826011 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40854014-157a-4539-bf16-ed1250222b74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:11.826094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7057b5-d698-41bd-9c5a-ab687f0d1702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:11.826185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40854014-157a-4539-bf16-ed1250222b74 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:11.828903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7057b5-d698-41bd-9c5a-ab687f0d1702 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:11.944298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 978/1953] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:11 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:11.948334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40854014-157a-4539-bf16-ed1250222b74 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:11.969939 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 976/1954] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:11 2022] POST /identity/v3/users => generated 291 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:11.970563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7057b5-d698-41bd-9c5a-ab687f0d1702 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:11.972916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40854014-157a-4539-bf16-ed1250222b74 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:11.984665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7057b5-d698-41bd-9c5a-ab687f0d1702 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:11.988843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9549a-6bf3-4e77-8ce9-52cee86ebe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:11.990842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee3973-2fe6-4fd2-bdf5-4e77170b2d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:11.990842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee3973-2fe6-4fd2-bdf5-4e77170b2d86 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.990842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee3973-2fe6-4fd2-bdf5-4e77170b2d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.991115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee3973-2fe6-4fd2-bdf5-4e77170b2d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.991757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee3973-2fe6-4fd2-bdf5-4e77170b2d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:11.992153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9549a-6bf3-4e77-8ce9-52cee86ebe6f admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:11.992607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9549a-6bf3-4e77-8ce9-52cee86ebe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:11.993022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9549a-6bf3-4e77-8ce9-52cee86ebe6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:11.993416 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee3973-2fe6-4fd2-bdf5-4e77170b2d86 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:11.994063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9549a-6bf3-4e77-8ce9-52cee86ebe6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:11.996553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9549a-6bf3-4e77-8ce9-52cee86ebe6f admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:12.007908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 977/1955] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:12.008848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee3973-2fe6-4fd2-bdf5-4e77170b2d86 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:12.014101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 979/1956] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:18:12.017736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9549a-6bf3-4e77-8ce9-52cee86ebe6f admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:12.021346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee3973-2fe6-4fd2-bdf5-4e77170b2d86 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:12.026497 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5858f-d2ca-4bff-9e71-335a77f20da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:12.027247 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5858f-d2ca-4bff-9e71-335a77f20da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.027394 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5858f-d2ca-4bff-9e71-335a77f20da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.027672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5858f-d2ca-4bff-9e71-335a77f20da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.028433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5858f-d2ca-4bff-9e71-335a77f20da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:12.031333 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5858f-d2ca-4bff-9e71-335a77f20da6 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:12.034381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9549a-6bf3-4e77-8ce9-52cee86ebe6f admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:12.047249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c552f5-c9db-453e-ac4a-a0307e988eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:12.048206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c552f5-c9db-453e-ac4a-a0307e988eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.048816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c552f5-c9db-453e-ac4a-a0307e988eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.049462 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c552f5-c9db-453e-ac4a-a0307e988eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.050409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c552f5-c9db-453e-ac4a-a0307e988eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:12.052903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 978/1957] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:12.053643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c552f5-c9db-453e-ac4a-a0307e988eb5 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:12.057083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5858f-d2ca-4bff-9e71-335a77f20da6 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:12.071343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5858f-d2ca-4bff-9e71-335a77f20da6 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:12.071435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 980/1958] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:12.075690 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c552f5-c9db-453e-ac4a-a0307e988eb5 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:12.078674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9c9ed-f75f-48fd-8c2d-db3d5c987ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:12.079470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9c9ed-f75f-48fd-8c2d-db3d5c987ca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.079819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9c9ed-f75f-48fd-8c2d-db3d5c987ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.080163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9c9ed-f75f-48fd-8c2d-db3d5c987ca1 admin admin] PATH_INFO: `/v3/projects/3b27a79819c74ae09e601325111456fa/users/5f2bb8528dad4dfcb29add17e42c8afe/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.086674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c552f5-c9db-453e-ac4a-a0307e988eb5 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:12.092654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e3665-d713-4235-a084-8316beb712b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:12.093544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e3665-d713-4235-a084-8316beb712b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.093830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e3665-d713-4235-a084-8316beb712b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.094419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e3665-d713-4235-a084-8316beb712b7 admin admin] PATH_INFO: `/v3/projects/6178066eed1a49a5b0ff99b44ba0f921/users/fa4f396fb563434188c1d6c16ec7746b/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.097952 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9c9ed-f75f-48fd-8c2d-db3d5c987ca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b27a79819c74ae09e601325111456fa, user_id=5f2bb8528dad4dfcb29add17e42c8afe, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:12.100726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9c9ed-f75f-48fd-8c2d-db3d5c987ca1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:12.111342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e3665-d713-4235-a084-8316beb712b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6178066eed1a49a5b0ff99b44ba0f921, user_id=fa4f396fb563434188c1d6c16ec7746b, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:12.114130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e3665-d713-4235-a084-8316beb712b7 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:12.214718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:12.216284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 979/1959] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:12 2022] PUT /identity/v3/projects/3b27a79819c74ae09e601325111456fa/users/5f2bb8528dad4dfcb29add17e42c8afe/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:12.228051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5907-fb2e-471e-bb2d-815499d3091e None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.228377 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5907-fb2e-471e-bb2d-815499d3091e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.228660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e5907-fb2e-471e-bb2d-815499d3091e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.238406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 981/1960] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:12 2022] PUT /identity/v3/projects/6178066eed1a49a5b0ff99b44ba0f921/users/fa4f396fb563434188c1d6c16ec7746b/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:12.243318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982baa-b00a-46fd-92bd-120388362b8b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.243608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982baa-b00a-46fd-92bd-120388362b8b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.243890 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34982baa-b00a-46fd-92bd-120388362b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.265898 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-34982baa-b00a-46fd-92bd-120388362b8b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:12.267296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-34982baa-b00a-46fd-92bd-120388362b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:12.272635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-9a2e5907-fb2e-471e-bb2d-815499d3091e None None] MFA Rules not processed for user `5f2bb8528dad4dfcb29add17e42c8afe`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:12.277943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-9a2e5907-fb2e-471e-bb2d-815499d3091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:12.335029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 982/1961] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:12.345924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34982baa-b00a-46fd-92bd-120388362b8b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:12.346889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-34982baa-b00a-46fd-92bd-120388362b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:12.352040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:12.357825 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 980/1962] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:12.364388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e5907-fb2e-471e-bb2d-815499d3091e None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:12.375365 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e5907-fb2e-471e-bb2d-815499d3091e None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:12.380162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab36f1-a0ae-4194-b35e-3d15cf94b1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:12.380991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab36f1-a0ae-4194-b35e-3d15cf94b1ae admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.381281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab36f1-a0ae-4194-b35e-3d15cf94b1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.381602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab36f1-a0ae-4194-b35e-3d15cf94b1ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.382180 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab36f1-a0ae-4194-b35e-3d15cf94b1ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:12.384097 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab36f1-a0ae-4194-b35e-3d15cf94b1ae admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:12.417484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34982baa-b00a-46fd-92bd-120388362b8b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:12.421435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea437a-f370-4eef-936b-995944700a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:12.422124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea437a-f370-4eef-936b-995944700a00 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.422474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea437a-f370-4eef-936b-995944700a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.422814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea437a-f370-4eef-936b-995944700a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.433040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea437a-f370-4eef-936b-995944700a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:12.434566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea437a-f370-4eef-936b-995944700a00 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:12.445040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 983/1963] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:18:12.514170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 981/1964] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:12 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:12.514585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea437a-f370-4eef-936b-995944700a00 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:12.525136 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea437a-f370-4eef-936b-995944700a00 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:12.610267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f4a4b-38de-44a0-a150-985b25e99049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:12.610896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f4a4b-38de-44a0-a150-985b25e99049 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.611175 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f4a4b-38de-44a0-a150-985b25e99049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.611449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f4a4b-38de-44a0-a150-985b25e99049 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.612095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f4a4b-38de-44a0-a150-985b25e99049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:12.614072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f4a4b-38de-44a0-a150-985b25e99049 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:12.631480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95849827-85df-43a2-b594-80b8cf58402f None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.631846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95849827-85df-43a2-b594-80b8cf58402f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.632131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95849827-85df-43a2-b594-80b8cf58402f None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.635624 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 982/1965] 10.222.0.20 () {54 vars in 921 bytes} [Wed Aug 24 17:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:18:12.646053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7922a-de7d-49c3-89c2-6839c7e7df15 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.646562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7922a-de7d-49c3-89c2-6839c7e7df15 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.646943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7922a-de7d-49c3-89c2-6839c7e7df15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.671040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-28e7922a-de7d-49c3-89c2-6839c7e7df15 None None] MFA Rules not processed for user `a698e566a46841cf83aa1711e83f8829`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:12.672601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-28e7922a-de7d-49c3-89c2-6839c7e7df15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:12.736813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 984/1966] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:12 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:12.745111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f4a4b-38de-44a0-a150-985b25e99049 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:12.760109 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f4a4b-38de-44a0-a150-985b25e99049 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:12.765330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf0d4f-0d17-4b56-ae20-4d2dba263cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:12.766030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf0d4f-0d17-4b56-ae20-4d2dba263cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.766302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf0d4f-0d17-4b56-ae20-4d2dba263cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.771459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf0d4f-0d17-4b56-ae20-4d2dba263cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.771459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf0d4f-0d17-4b56-ae20-4d2dba263cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:12.771459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf0d4f-0d17-4b56-ae20-4d2dba263cb7 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:12.779329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 985/1967] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:12.783808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf0d4f-0d17-4b56-ae20-4d2dba263cb7 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:12.786381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 983/1968] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Aug 24 17:18:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:12.794012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf0d4f-0d17-4b56-ae20-4d2dba263cb7 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:12.799668 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ba3c4-8691-480f-acb8-4824f714012a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:12.799804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7922a-de7d-49c3-89c2-6839c7e7df15 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:12.800371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba3c4-8691-480f-acb8-4824f714012a admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.800650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba3c4-8691-480f-acb8-4824f714012a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.801357 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ba3c4-8691-480f-acb8-4824f714012a admin admin] PATH_INFO: `/v3/projects/f5b1dbb117e9467ea0c843779dbe863d/users/c18fd862ea2949cc83b17c583d481570/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.802170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-28e7922a-de7d-49c3-89c2-6839c7e7df15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:12.823131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ba3c4-8691-480f-acb8-4824f714012a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b1dbb117e9467ea0c843779dbe863d, user_id=c18fd862ea2949cc83b17c583d481570, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:12.826340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ba3c4-8691-480f-acb8-4824f714012a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:12.827559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7922a-de7d-49c3-89c2-6839c7e7df15 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:12.843697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd095fc0-f94e-450c-8816-1aedef616381 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a698e566a46841cf83aa1711e83f8829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:12.843697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd095fc0-f94e-450c-8816-1aedef616381 service placement] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.843697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd095fc0-f94e-450c-8816-1aedef616381 service placement] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.843697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd095fc0-f94e-450c-8816-1aedef616381 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.856002 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd095fc0-f94e-450c-8816-1aedef616381 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:12.857722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd095fc0-f94e-450c-8816-1aedef616381 service placement] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:12.869969 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 984/1969] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:12.870846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd095fc0-f94e-450c-8816-1aedef616381 service placement] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:12.872406 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-cd095fc0-f94e-450c-8816-1aedef616381 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:12.889593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd095fc0-f94e-450c-8816-1aedef616381 service placement] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:12.899957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:12.899957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:12.899957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:12.899957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] PATH_INFO: `/v3/users/9a395f2e142643d7a8a22adf7355f960` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:12.901177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a395f2e142643d7a8a22adf7355f960)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:12.909320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:13.152992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 986/1970] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:12 2022] PUT /identity/v3/projects/f5b1dbb117e9467ea0c843779dbe863d/users/c18fd862ea2949cc83b17c583d481570/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:13.157480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ba3c4-8691-480f-acb8-4824f714012a admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:13.221321 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ba3c4-8691-480f-acb8-4824f714012a admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:13.226110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fa9da-1959-42e2-ad9d-0976cb9c1379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:13.226815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fa9da-1959-42e2-ad9d-0976cb9c1379 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:13.227215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fa9da-1959-42e2-ad9d-0976cb9c1379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:13.227568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fa9da-1959-42e2-ad9d-0976cb9c1379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:13.228317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fa9da-1959-42e2-ad9d-0976cb9c1379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:13.230001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fa9da-1959-42e2-ad9d-0976cb9c1379 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:13.242097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 987/1971] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:18:13.247087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fa9da-1959-42e2-ad9d-0976cb9c1379 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:13.258907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fa9da-1959-42e2-ad9d-0976cb9c1379 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:13.263812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191ad72-e7ac-4160-9373-38c88887cf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:13.264505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ad72-e7ac-4160-9373-38c88887cf2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:13.264999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ad72-e7ac-4160-9373-38c88887cf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:13.265443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ad72-e7ac-4160-9373-38c88887cf2a admin admin] PATH_INFO: `/v3/projects/f5b1dbb117e9467ea0c843779dbe863d/users/c18fd862ea2949cc83b17c583d481570/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:13.267600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191ad72-e7ac-4160-9373-38c88887cf2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b1dbb117e9467ea0c843779dbe863d, user_id=c18fd862ea2949cc83b17c583d481570, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:13.270254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191ad72-e7ac-4160-9373-38c88887cf2a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:13.284194 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 988/1972] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:13 2022] PUT /identity/v3/projects/f5b1dbb117e9467ea0c843779dbe863d/users/c18fd862ea2949cc83b17c583d481570/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:13.294295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29c59b-854c-4fc5-85b8-0927030851ea None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:13.295377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29c59b-854c-4fc5-85b8-0927030851ea None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:13.301234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29c59b-854c-4fc5-85b8-0927030851ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:13.325589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-2b29c59b-854c-4fc5-85b8-0927030851ea None None] MFA Rules not processed for user `c18fd862ea2949cc83b17c583d481570`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:13.326894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2b29c59b-854c-4fc5-85b8-0927030851ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:13.382463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a395f2e142643d7a8a22adf7355f960'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:13.384676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a395f2e142643d7a8a22adf7355f960'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:13.393684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a395f2e142643d7a8a22adf7355f960'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:13.394383 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a395f2e142643d7a8a22adf7355f960'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:13.407367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a395f2e142643d7a8a22adf7355f960'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:13.409919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 989/1973] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:13.420550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29c59b-854c-4fc5-85b8-0927030851ea None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:13.423409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2b29c59b-854c-4fc5-85b8-0927030851ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:13.483101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29c59b-854c-4fc5-85b8-0927030851ea None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:13.487395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7391-f491-4391-a899-8c6f28b402ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:13.488014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7391-f491-4391-a899-8c6f28b402ee service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:13.488326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7391-f491-4391-a899-8c6f28b402ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:13.488599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7391-f491-4391-a899-8c6f28b402ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:13.497721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da7391-f491-4391-a899-8c6f28b402ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:13.499864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da7391-f491-4391-a899-8c6f28b402ee service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:13.509587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 990/1974] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:18:13.518803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:13.525234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 985/1975] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:12 2022] DELETE /identity/v3/users/9a395f2e142643d7a8a22adf7355f960 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:13.635900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7391-f491-4391-a899-8c6f28b402ee service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:13.646360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7391-f491-4391-a899-8c6f28b402ee service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:13.704426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7db7e8-fa60-49b2-9163-8fced335df4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:13.705096 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7db7e8-fa60-49b2-9163-8fced335df4b service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:13.705377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7db7e8-fa60-49b2-9163-8fced335df4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:13.705652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7db7e8-fa60-49b2-9163-8fced335df4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:13.708509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3d7db7e8-fa60-49b2-9163-8fced335df4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:13.770340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7db7e8-fa60-49b2-9163-8fced335df4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:13.772030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7db7e8-fa60-49b2-9163-8fced335df4b service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:13.782388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 991/1976] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:13.810259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:13.816210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:13.914058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:13.988657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c3d6f-0557-4170-8144-f717ebc6b3da admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:14.005518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:14.006228 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:14.006511 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:14.006791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] PATH_INFO: `/v3/projects/220d1a241b9842d09eed73372999a5c2` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:14.009635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=220d1a241b9842d09eed73372999a5c2)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:14.016931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:14.200673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220d1a241b9842d09eed73372999a5c2', 'request_id': 'req-aa957afd-0684-4714-a849-51edb1074a40'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:14.256389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220d1a241b9842d09eed73372999a5c2', 'request_id': 'req-aa957afd-0684-4714-a849-51edb1074a40'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:14.282787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220d1a241b9842d09eed73372999a5c2', 'request_id': 'req-aa957afd-0684-4714-a849-51edb1074a40'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:14.302104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] The token cache is being invalidate because project 220d1a241b9842d09eed73372999a5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:14.302422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:14.303094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-aa957afd-0684-4714-a849-51edb1074a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:14.304879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 986/1977] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:13 2022] DELETE /identity/v3/projects/220d1a241b9842d09eed73372999a5c2 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:14.310664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4d7f9-6d19-42fd-b52b-a7d0f412b41b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:14.311126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4d7f9-6d19-42fd-b52b-a7d0f412b41b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:14.311366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4d7f9-6d19-42fd-b52b-a7d0f412b41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:14.334174 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-d1d4d7f9-6d19-42fd-b52b-a7d0f412b41b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:14.335601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d1d4d7f9-6d19-42fd-b52b-a7d0f412b41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:14.400334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67175-3239-421b-b768-ad6f2f15a8da None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:14.400798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67175-3239-421b-b768-ad6f2f15a8da None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:14.400989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67175-3239-421b-b768-ad6f2f15a8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:14.403805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 992/1978] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:14.412607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c24599-513a-42c1-839a-60e70f2f7431 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:14.412896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c24599-513a-42c1-839a-60e70f2f7431 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:14.413183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c24599-513a-42c1-839a-60e70f2f7431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:14.432835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-bab67175-3239-421b-b768-ad6f2f15a8da None None] MFA Rules not processed for user `fa4f396fb563434188c1d6c16ec7746b`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:14.434045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-96c24599-513a-42c1-839a-60e70f2f7431 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:14.434579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bab67175-3239-421b-b768-ad6f2f15a8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:14.435236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-96c24599-513a-42c1-839a-60e70f2f7431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:14.459782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 993/1979] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:14.464217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c24599-513a-42c1-839a-60e70f2f7431 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:14.475857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c24599-513a-42c1-839a-60e70f2f7431 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:14.481651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d329-889e-4be4-a210-a30413f6ad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:14.482654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d329-889e-4be4-a210-a30413f6ad1d admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:14.483210 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d329-889e-4be4-a210-a30413f6ad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:14.484267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d329-889e-4be4-a210-a30413f6ad1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:14.485137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40d329-889e-4be4-a210-a30413f6ad1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:14.485679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40d329-889e-4be4-a210-a30413f6ad1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:14.487495 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40d329-889e-4be4-a210-a30413f6ad1d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:14.501125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 994/1980] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:18:14.505676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d329-889e-4be4-a210-a30413f6ad1d admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:14.516691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d329-889e-4be4-a210-a30413f6ad1d admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:14.521417 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5eac1-f3e9-4bdd-964f-0ff86e020d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:14.522018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5eac1-f3e9-4bdd-964f-0ff86e020d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:14.522296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5eac1-f3e9-4bdd-964f-0ff86e020d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:14.522572 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5eac1-f3e9-4bdd-964f-0ff86e020d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:14.523205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5eac1-f3e9-4bdd-964f-0ff86e020d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:14.525112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5eac1-f3e9-4bdd-964f-0ff86e020d89 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:14.533165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 987/1981] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:14.589520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab67175-3239-421b-b768-ad6f2f15a8da None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:14.590934 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bab67175-3239-421b-b768-ad6f2f15a8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:14.649712 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab67175-3239-421b-b768-ad6f2f15a8da None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:14.653369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4fe48-94f2-4803-8a4e-445923eef1a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:14.653980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4fe48-94f2-4803-8a4e-445923eef1a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:14.654257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4fe48-94f2-4803-8a4e-445923eef1a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:14.654520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4fe48-94f2-4803-8a4e-445923eef1a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:14.661454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 995/1982] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:14 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:14.662556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5eac1-f3e9-4bdd-964f-0ff86e020d89 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:14.664706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4fe48-94f2-4803-8a4e-445923eef1a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:14.666397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4fe48-94f2-4803-8a4e-445923eef1a9 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:14.677150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 988/1983] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:14.742594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5eac1-f3e9-4bdd-964f-0ff86e020d89 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:14.748627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e263e9d-7ed7-4092-b623-c60fc38deffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:14.749306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e263e9d-7ed7-4092-b623-c60fc38deffc admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:14.752919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e263e9d-7ed7-4092-b623-c60fc38deffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:14.752919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e263e9d-7ed7-4092-b623-c60fc38deffc admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:14.752919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e263e9d-7ed7-4092-b623-c60fc38deffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:14.752919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e263e9d-7ed7-4092-b623-c60fc38deffc admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:14.850350 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 996/1984] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:14 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:14.854394 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4fe48-94f2-4803-8a4e-445923eef1a9 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:14.865596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4fe48-94f2-4803-8a4e-445923eef1a9 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:14.870516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d707f1-9007-4ea6-8327-ca29c8db0b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:14.871129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d707f1-9007-4ea6-8327-ca29c8db0b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:14.871415 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d707f1-9007-4ea6-8327-ca29c8db0b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:14.871676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d707f1-9007-4ea6-8327-ca29c8db0b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:14.872355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d707f1-9007-4ea6-8327-ca29c8db0b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:14.874060 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d707f1-9007-4ea6-8327-ca29c8db0b18 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:14.884888 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 989/1985] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:14.889238 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e263e9d-7ed7-4092-b623-c60fc38deffc admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:14.903682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e263e9d-7ed7-4092-b623-c60fc38deffc admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:14.907215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa48fe-3810-4f7f-bb99-78209b00088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:14.907215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa48fe-3810-4f7f-bb99-78209b00088c admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:14.907215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa48fe-3810-4f7f-bb99-78209b00088c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:14.907215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa48fe-3810-4f7f-bb99-78209b00088c admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:14.907864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa48fe-3810-4f7f-bb99-78209b00088c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:14.909623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa48fe-3810-4f7f-bb99-78209b00088c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:14.920711 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 997/1986] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:14.925229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d707f1-9007-4ea6-8327-ca29c8db0b18 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:14.935829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d707f1-9007-4ea6-8327-ca29c8db0b18 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:14.940989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4b549-e013-4fe1-8d0b-42ffaade147f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:14.941624 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4b549-e013-4fe1-8d0b-42ffaade147f admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:14.941884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4b549-e013-4fe1-8d0b-42ffaade147f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:14.942161 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4b549-e013-4fe1-8d0b-42ffaade147f admin admin] PATH_INFO: `/v3/projects/d127edd049aa455099ed61b84784de8c/users/0d81fc7442b84d5385868ac17908b64c/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:14.960590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4b549-e013-4fe1-8d0b-42ffaade147f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d127edd049aa455099ed61b84784de8c, user_id=0d81fc7442b84d5385868ac17908b64c, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:14.963518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4b549-e013-4fe1-8d0b-42ffaade147f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:14.981782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:15.092521 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 990/1987] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:14 2022] PUT /identity/v3/projects/d127edd049aa455099ed61b84784de8c/users/0d81fc7442b84d5385868ac17908b64c/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:15.103330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d469ef-717d-4bb6-a909-9e83b5b29814 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:15.103618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d469ef-717d-4bb6-a909-9e83b5b29814 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:15.103895 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d469ef-717d-4bb6-a909-9e83b5b29814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:15.132926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-f2d469ef-717d-4bb6-a909-9e83b5b29814 None None] MFA Rules not processed for user `0d81fc7442b84d5385868ac17908b64c`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:15.134144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f2d469ef-717d-4bb6-a909-9e83b5b29814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:15.211663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 998/1988] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:15.227321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4b549-e013-4fe1-8d0b-42ffaade147f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:15.229188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f7a4b549-e013-4fe1-8d0b-42ffaade147f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:15.308898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4b549-e013-4fe1-8d0b-42ffaade147f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:15.315701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba3bcc-2530-471a-b326-4e3849a71e86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:15.316357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3bcc-2530-471a-b326-4e3849a71e86 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:15.321361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3bcc-2530-471a-b326-4e3849a71e86 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:15.321361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3bcc-2530-471a-b326-4e3849a71e86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:15.324872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba3bcc-2530-471a-b326-4e3849a71e86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:15.326490 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba3bcc-2530-471a-b326-4e3849a71e86 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:15.336206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 991/1989] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:15.478024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:15.969382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:16.552854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:17.089910 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:17.600542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8f066-1358-42b8-bdbd-e4bd48439577 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:17.600816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8f066-1358-42b8-bdbd-e4bd48439577 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:17.601092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8f066-1358-42b8-bdbd-e4bd48439577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:17.621190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-9fc8f066-1358-42b8-bdbd-e4bd48439577 None None] MFA Rules not processed for user `fa4f396fb563434188c1d6c16ec7746b`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:17.622479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9fc8f066-1358-42b8-bdbd-e4bd48439577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:17.681075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 999/1990] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:18.347098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba3bcc-2530-471a-b326-4e3849a71e86 service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:18.348602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-61ba3bcc-2530-471a-b326-4e3849a71e86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:18.441332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba3bcc-2530-471a-b326-4e3849a71e86 service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:18.456449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:18.456449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:18.456449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:18.456449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] PATH_INFO: `/v3/users/5f2bb8528dad4dfcb29add17e42c8afe` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:18.458155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2bb8528dad4dfcb29add17e42c8afe)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:18.460988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:18.660836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:18.663004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2bb8528dad4dfcb29add17e42c8afe'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:18.664683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2bb8528dad4dfcb29add17e42c8afe'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:18.672899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2bb8528dad4dfcb29add17e42c8afe'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:18.673759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2bb8528dad4dfcb29add17e42c8afe'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:18.688898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2bb8528dad4dfcb29add17e42c8afe'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:18.775752 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 992/1991] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:18 2022] DELETE /identity/v3/users/5f2bb8528dad4dfcb29add17e42c8afe => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:18.782588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d79d2-6357-48ba-a373-ee9a34b81b33 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:18.783746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d79d2-6357-48ba-a373-ee9a34b81b33 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:18.783890 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d79d2-6357-48ba-a373-ee9a34b81b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:18.803703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5c8d79d2-6357-48ba-a373-ee9a34b81b33 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:18.805139 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5c8d79d2-6357-48ba-a373-ee9a34b81b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:18.871692 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1000/1992] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:18.882300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:18.883952 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:18.948579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad8684-80cf-446e-9d95-c05701b03e10 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:18.952401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e19d8-9e09-4519-8e4d-79c7aa3fb602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:18.953013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e19d8-9e09-4519-8e4d-79c7aa3fb602 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:18.953291 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e19d8-9e09-4519-8e4d-79c7aa3fb602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:18.953612 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e19d8-9e09-4519-8e4d-79c7aa3fb602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:18.965131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e19d8-9e09-4519-8e4d-79c7aa3fb602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:18.966651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e19d8-9e09-4519-8e4d-79c7aa3fb602 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:18.978989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 993/1993] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:19.456773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d79d2-6357-48ba-a373-ee9a34b81b33 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:19.458515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5c8d79d2-6357-48ba-a373-ee9a34b81b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:19.471704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d79d2-6357-48ba-a373-ee9a34b81b33 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:19.477406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:19.478134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:19.478577 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:19.478805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] PATH_INFO: `/v3/projects/3b27a79819c74ae09e601325111456fa` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:19.481163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b27a79819c74ae09e601325111456fa)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:19.484372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:19.592023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b27a79819c74ae09e601325111456fa', 'request_id': 'req-f42c339d-035f-47c4-8671-3108e9058433'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:19.666771 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b27a79819c74ae09e601325111456fa', 'request_id': 'req-f42c339d-035f-47c4-8671-3108e9058433'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:19.674578 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b27a79819c74ae09e601325111456fa', 'request_id': 'req-f42c339d-035f-47c4-8671-3108e9058433'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:19.676885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:19.687837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] The token cache is being invalidate because project 3b27a79819c74ae09e601325111456fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:19.688128 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:19.688865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:19.690532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1001/1994] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:19 2022] DELETE /identity/v3/projects/3b27a79819c74ae09e601325111456fa => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:19.695470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e19d8-9e09-4519-8e4d-79c7aa3fb602 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:19.705613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e19d8-9e09-4519-8e4d-79c7aa3fb602 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:19.771856 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3e590-a501-42ef-98a6-a67d4753cb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:19.772575 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3e590-a501-42ef-98a6-a67d4753cb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:19.772797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3e590-a501-42ef-98a6-a67d4753cb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:19.773222 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3e590-a501-42ef-98a6-a67d4753cb85 admin admin] PATH_INFO: `/v3/users/c18fd862ea2949cc83b17c583d481570` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:19.774502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3e590-a501-42ef-98a6-a67d4753cb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18fd862ea2949cc83b17c583d481570)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:19.776762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3e590-a501-42ef-98a6-a67d4753cb85 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:20.169407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-06b3e590-a501-42ef-98a6-a67d4753cb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18fd862ea2949cc83b17c583d481570'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:20.170078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-06b3e590-a501-42ef-98a6-a67d4753cb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18fd862ea2949cc83b17c583d481570'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:20.177565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-06b3e590-a501-42ef-98a6-a67d4753cb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18fd862ea2949cc83b17c583d481570'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:20.178479 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-06b3e590-a501-42ef-98a6-a67d4753cb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18fd862ea2949cc83b17c583d481570'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:20.187137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:20.192116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-06b3e590-a501-42ef-98a6-a67d4753cb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18fd862ea2949cc83b17c583d481570'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:20.307260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 994/1995] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:19 2022] DELETE /identity/v3/users/c18fd862ea2949cc83b17c583d481570 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:21.279524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:21.281057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:21.304758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c339d-035f-47c4-8671-3108e9058433 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:21.368391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:21.369076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:21.369353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:21.369631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] PATH_INFO: `/v3/projects/f5b1dbb117e9467ea0c843779dbe863d` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:21.370785 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b1dbb117e9467ea0c843779dbe863d)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:21.372703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:21.492608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b1dbb117e9467ea0c843779dbe863d', 'request_id': 'req-99276969-74c2-4b19-a700-b48fe03e3291'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:21.568774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b1dbb117e9467ea0c843779dbe863d', 'request_id': 'req-99276969-74c2-4b19-a700-b48fe03e3291'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:21.575815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b1dbb117e9467ea0c843779dbe863d', 'request_id': 'req-99276969-74c2-4b19-a700-b48fe03e3291'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:21.587518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] The token cache is being invalidate because project f5b1dbb117e9467ea0c843779dbe863d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:21.587808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:21.588511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-99276969-74c2-4b19-a700-b48fe03e3291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:21.590203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1002/1996] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:21 2022] DELETE /identity/v3/projects/f5b1dbb117e9467ea0c843779dbe863d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:21.594950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd619d-bde1-4ef1-8bf7-6fc77ded50bc None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:21.596076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd619d-bde1-4ef1-8bf7-6fc77ded50bc None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:21.596176 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd619d-bde1-4ef1-8bf7-6fc77ded50bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:21.618409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-f0cd619d-bde1-4ef1-8bf7-6fc77ded50bc None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:21.619659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f0cd619d-bde1-4ef1-8bf7-6fc77ded50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:21.682508 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 995/1997] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:21.690608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30349984-990d-48ce-a67a-d9ecae0299bd None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:21.690889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30349984-990d-48ce-a67a-d9ecae0299bd None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:21.691163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30349984-990d-48ce-a67a-d9ecae0299bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:21.713239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-30349984-990d-48ce-a67a-d9ecae0299bd None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:21.714485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-30349984-990d-48ce-a67a-d9ecae0299bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:21.724046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1003/1998] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:21.728733 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd619d-bde1-4ef1-8bf7-6fc77ded50bc None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:21.739197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd619d-bde1-4ef1-8bf7-6fc77ded50bc None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:21.743904 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c911d7-254c-4b9d-bc68-ac87d4a5bd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:21.744516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c911d7-254c-4b9d-bc68-ac87d4a5bd57 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:21.744796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c911d7-254c-4b9d-bc68-ac87d4a5bd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:21.745098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c911d7-254c-4b9d-bc68-ac87d4a5bd57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:21.745743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c911d7-254c-4b9d-bc68-ac87d4a5bd57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:21.746046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c911d7-254c-4b9d-bc68-ac87d4a5bd57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:21.747686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c911d7-254c-4b9d-bc68-ac87d4a5bd57 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:21.762355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 996/1999] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:18:21.778253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30349984-990d-48ce-a67a-d9ecae0299bd None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:21.795694 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30349984-990d-48ce-a67a-d9ecae0299bd None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:21.806241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d17836-e7d3-4b40-981f-038e3d1eaea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:21.806876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d17836-e7d3-4b40-981f-038e3d1eaea0 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:21.807404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d17836-e7d3-4b40-981f-038e3d1eaea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:21.808744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d17836-e7d3-4b40-981f-038e3d1eaea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:21.810156 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d17836-e7d3-4b40-981f-038e3d1eaea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:21.815831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d17836-e7d3-4b40-981f-038e3d1eaea0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:21.925550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c911d7-254c-4b9d-bc68-ac87d4a5bd57 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:21.927046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-35c911d7-254c-4b9d-bc68-ac87d4a5bd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:21.940804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c911d7-254c-4b9d-bc68-ac87d4a5bd57 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:21.945693 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0d63e-5649-4a82-ad7b-887be5af3035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:21.946314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0d63e-5649-4a82-ad7b-887be5af3035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:21.946591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0d63e-5649-4a82-ad7b-887be5af3035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:21.946979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0d63e-5649-4a82-ad7b-887be5af3035 admin admin] PATH_INFO: `/v3/users/0d81fc7442b84d5385868ac17908b64c` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:21.948109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0d63e-5649-4a82-ad7b-887be5af3035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d81fc7442b84d5385868ac17908b64c)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:21.950113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0d63e-5649-4a82-ad7b-887be5af3035 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:22.040343 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1004/2000] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:21 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:22.044585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d17836-e7d3-4b40-981f-038e3d1eaea0 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:22.108098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:22.122714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d17836-e7d3-4b40-981f-038e3d1eaea0 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:22.128425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64087736-ae7d-4cb6-be45-dbbaa99b73d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:22.129037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64087736-ae7d-4cb6-be45-dbbaa99b73d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:22.129315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64087736-ae7d-4cb6-be45-dbbaa99b73d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:22.129586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64087736-ae7d-4cb6-be45-dbbaa99b73d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:22.130223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64087736-ae7d-4cb6-be45-dbbaa99b73d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:22.132122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64087736-ae7d-4cb6-be45-dbbaa99b73d6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:22.191817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e4a0d63e-5649-4a82-ad7b-887be5af3035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d81fc7442b84d5385868ac17908b64c'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:22.192699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e4a0d63e-5649-4a82-ad7b-887be5af3035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d81fc7442b84d5385868ac17908b64c'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:22.201608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e4a0d63e-5649-4a82-ad7b-887be5af3035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d81fc7442b84d5385868ac17908b64c'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:22.202462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e4a0d63e-5649-4a82-ad7b-887be5af3035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d81fc7442b84d5385868ac17908b64c'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:22.204426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1005/2001] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:22 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:22.209308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64087736-ae7d-4cb6-be45-dbbaa99b73d6 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:22.210973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-64087736-ae7d-4cb6-be45-dbbaa99b73d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:22.224942 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64087736-ae7d-4cb6-be45-dbbaa99b73d6 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:22.229883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd682f4-8ada-490c-8346-ba2538df7dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:22.230654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd682f4-8ada-490c-8346-ba2538df7dcd admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:22.230837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd682f4-8ada-490c-8346-ba2538df7dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:22.231494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd682f4-8ada-490c-8346-ba2538df7dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:22.231835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd682f4-8ada-490c-8346-ba2538df7dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:22.232668 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e4a0d63e-5649-4a82-ad7b-887be5af3035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d81fc7442b84d5385868ac17908b64c'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:22.233735 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd682f4-8ada-490c-8346-ba2538df7dcd admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:22.246264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1006/2002] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:22.257306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd682f4-8ada-490c-8346-ba2538df7dcd admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:22.270366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd682f4-8ada-490c-8346-ba2538df7dcd admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:22.275884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e87c8-99fe-43ea-8ebd-ead717691691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:22.276715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e87c8-99fe-43ea-8ebd-ead717691691 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:22.277130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e87c8-99fe-43ea-8ebd-ead717691691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:22.277533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e87c8-99fe-43ea-8ebd-ead717691691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:22.278318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e87c8-99fe-43ea-8ebd-ead717691691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:22.280545 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e87c8-99fe-43ea-8ebd-ead717691691 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:22.294959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1007/2003] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:22.308032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 997/2004] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:21 2022] DELETE /identity/v3/users/0d81fc7442b84d5385868ac17908b64c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:22.308464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e87c8-99fe-43ea-8ebd-ead717691691 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:22.313010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d35e2-d227-444d-b585-c9e6e6b7045b None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:22.313347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d35e2-d227-444d-b585-c9e6e6b7045b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:22.313595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d35e2-d227-444d-b585-c9e6e6b7045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:22.321743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e87c8-99fe-43ea-8ebd-ead717691691 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:22.334413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-799d35e2-d227-444d-b585-c9e6e6b7045b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:22.335761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-799d35e2-d227-444d-b585-c9e6e6b7045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:22.390522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:22.397262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4bfa7-0519-4205-8fcd-0e0383a43f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:22.397519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4bfa7-0519-4205-8fcd-0e0383a43f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:22.397802 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4bfa7-0519-4205-8fcd-0e0383a43f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:22.398472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4bfa7-0519-4205-8fcd-0e0383a43f04 admin admin] PATH_INFO: `/v3/projects/c11d82f0bd5149e8aee16118c167882b/users/ba07d403f6134274803fef2cecdf575b/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:22.415863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 998/2005] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:22.417532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4bfa7-0519-4205-8fcd-0e0383a43f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11d82f0bd5149e8aee16118c167882b, user_id=ba07d403f6134274803fef2cecdf575b, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:22.420385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4bfa7-0519-4205-8fcd-0e0383a43f04 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:22.427465 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d35e2-d227-444d-b585-c9e6e6b7045b None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:22.428998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-799d35e2-d227-444d-b585-c9e6e6b7045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:22.491691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d35e2-d227-444d-b585-c9e6e6b7045b None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:22.503768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1008/2006] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:22 2022] PUT /identity/v3/projects/c11d82f0bd5149e8aee16118c167882b/users/ba07d403f6134274803fef2cecdf575b/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:22.506722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e11e14-d835-4885-b5c4-54563ffbabb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:22.507732 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11e14-d835-4885-b5c4-54563ffbabb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:22.508110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11e14-d835-4885-b5c4-54563ffbabb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:22.508619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11e14-d835-4885-b5c4-54563ffbabb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:22.515096 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4566-e043-4636-be37-c750e38a9571 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:22.515434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4566-e043-4636-be37-c750e38a9571 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:22.515714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a4566-e043-4636-be37-c750e38a9571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:22.519739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e11e14-d835-4885-b5c4-54563ffbabb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:22.522547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e11e14-d835-4885-b5c4-54563ffbabb0 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:22.535081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 999/2007] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:18:22.547424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-7e6a4566-e043-4636-be37-c750e38a9571 None None] MFA Rules not processed for user `ba07d403f6134274803fef2cecdf575b`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:22.549703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7e6a4566-e043-4636-be37-c750e38a9571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:22.648194 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1009/2008] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:22.652753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e11e14-d835-4885-b5c4-54563ffbabb0 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:22.666797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e11e14-d835-4885-b5c4-54563ffbabb0 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:22.736679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32116b88-76de-4de6-b52a-115539316fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:22.737631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32116b88-76de-4de6-b52a-115539316fec admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:22.738937 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32116b88-76de-4de6-b52a-115539316fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:22.739339 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32116b88-76de-4de6-b52a-115539316fec admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:22.740117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32116b88-76de-4de6-b52a-115539316fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:22.742390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32116b88-76de-4de6-b52a-115539316fec admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:22.864317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1000/2009] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:22 2022] POST /identity/v3/projects => generated 385 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:22.869830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a4566-e043-4636-be37-c750e38a9571 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:22.881662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a4566-e043-4636-be37-c750e38a9571 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:22.917450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:22.955949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b5edd-a328-45b7-8d35-9d7ef64b8cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:22.955949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5edd-a328-45b7-8d35-9d7ef64b8cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:22.955949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5edd-a328-45b7-8d35-9d7ef64b8cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:22.955949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b5edd-a328-45b7-8d35-9d7ef64b8cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:22.956370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b5edd-a328-45b7-8d35-9d7ef64b8cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:22.964476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b5edd-a328-45b7-8d35-9d7ef64b8cf3 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:23.006003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32116b88-76de-4de6-b52a-115539316fec admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:23.007465 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-32116b88-76de-4de6-b52a-115539316fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:23.028962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32116b88-76de-4de6-b52a-115539316fec admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:23.034894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:23.036346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.037515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.037789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] PATH_INFO: `/v3/projects/d127edd049aa455099ed61b84784de8c` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.039452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d127edd049aa455099ed61b84784de8c)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:23.041527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:23.060648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1010/2010] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:22 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:23.061943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b5edd-a328-45b7-8d35-9d7ef64b8cf3 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:23.072690 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b5edd-a328-45b7-8d35-9d7ef64b8cf3 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:23.077742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe20d3-7522-4ad0-892c-598879871793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:23.078356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe20d3-7522-4ad0-892c-598879871793 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.078635 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe20d3-7522-4ad0-892c-598879871793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.078953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe20d3-7522-4ad0-892c-598879871793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.079610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe20d3-7522-4ad0-892c-598879871793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:23.081914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe20d3-7522-4ad0-892c-598879871793 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:23.096454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1011/2011] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:23.098516 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe20d3-7522-4ad0-892c-598879871793 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:23.118357 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe20d3-7522-4ad0-892c-598879871793 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:23.123812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b38867-38ce-4a5e-8339-aff7800d2b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:23.124536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b38867-38ce-4a5e-8339-aff7800d2b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.124859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b38867-38ce-4a5e-8339-aff7800d2b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.125134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b38867-38ce-4a5e-8339-aff7800d2b64 admin admin] PATH_INFO: `/v3/projects/cbade2c5ff9448dbb5210f3550aa6d25/users/d71cc90b563b424781456d15f8ebd76f/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.155074 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b38867-38ce-4a5e-8339-aff7800d2b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbade2c5ff9448dbb5210f3550aa6d25, user_id=d71cc90b563b424781456d15f8ebd76f, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:23.160928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b38867-38ce-4a5e-8339-aff7800d2b64 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:23.168787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd127edd049aa455099ed61b84784de8c', 'request_id': 'req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:23.227607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1012/2012] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:23 2022] PUT /identity/v3/projects/cbade2c5ff9448dbb5210f3550aa6d25/users/d71cc90b563b424781456d15f8ebd76f/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:23.231428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b38867-38ce-4a5e-8339-aff7800d2b64 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:23.249481 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd127edd049aa455099ed61b84784de8c', 'request_id': 'req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:23.262119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd127edd049aa455099ed61b84784de8c', 'request_id': 'req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:23.275604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:23.295827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] The token cache is being invalidate because project d127edd049aa455099ed61b84784de8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:23.296128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:23.297548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9eb046ab-f13f-4f19-8e98-a9bcc27ca160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:23.299652 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1001/2013] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:23 2022] DELETE /identity/v3/projects/d127edd049aa455099ed61b84784de8c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:23.304979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8d0f4-4ba8-48ff-99cc-dc33a70cbf40 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.306736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8d0f4-4ba8-48ff-99cc-dc33a70cbf40 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.307545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8d0f4-4ba8-48ff-99cc-dc33a70cbf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.325621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b38867-38ce-4a5e-8339-aff7800d2b64 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:23.332457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0b533-c60c-444d-92b1-a8361abb1b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:23.333153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b533-c60c-444d-92b1-a8361abb1b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.333430 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b533-c60c-444d-92b1-a8361abb1b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.333705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0b533-c60c-444d-92b1-a8361abb1b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.333863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-01e8d0f4-4ba8-48ff-99cc-dc33a70cbf40 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:23.334353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0b533-c60c-444d-92b1-a8361abb1b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:23.335818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-01e8d0f4-4ba8-48ff-99cc-dc33a70cbf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:23.335994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0b533-c60c-444d-92b1-a8361abb1b86 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:23.348358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1002/2014] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:23.349904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1013/2015] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:18:23.353759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0b533-c60c-444d-92b1-a8361abb1b86 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:23.354451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcd3cf-4a04-44fa-810b-7299b5e5e13f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.354867 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcd3cf-4a04-44fa-810b-7299b5e5e13f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.355275 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcd3cf-4a04-44fa-810b-7299b5e5e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.355822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-77b0b533-c60c-444d-92b1-a8361abb1b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:23.373024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0b533-c60c-444d-92b1-a8361abb1b86 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:23.380598 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12648249-8272-4639-a11a-35889c8f759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:23.383533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12648249-8272-4639-a11a-35889c8f759c admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.383533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12648249-8272-4639-a11a-35889c8f759c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.383533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12648249-8272-4639-a11a-35889c8f759c admin admin] PATH_INFO: `/v3/projects/cbade2c5ff9448dbb5210f3550aa6d25/users/d71cc90b563b424781456d15f8ebd76f/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.385168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-6cdcd3cf-4a04-44fa-810b-7299b5e5e13f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:23.385168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6cdcd3cf-4a04-44fa-810b-7299b5e5e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:23.385337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12648249-8272-4639-a11a-35889c8f759c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbade2c5ff9448dbb5210f3550aa6d25, user_id=d71cc90b563b424781456d15f8ebd76f, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:23.388179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12648249-8272-4639-a11a-35889c8f759c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:23.403697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1003/2016] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:23.418330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1014/2017] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:23 2022] PUT /identity/v3/projects/cbade2c5ff9448dbb5210f3550aa6d25/users/d71cc90b563b424781456d15f8ebd76f/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:23.421784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12648249-8272-4639-a11a-35889c8f759c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:23.428696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5190ec-8dab-4005-8fea-ca067fdca672 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.429077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5190ec-8dab-4005-8fea-ca067fdca672 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.429532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5190ec-8dab-4005-8fea-ca067fdca672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.466442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-3f5190ec-8dab-4005-8fea-ca067fdca672 None None] MFA Rules not processed for user `d71cc90b563b424781456d15f8ebd76f`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:23.467768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3f5190ec-8dab-4005-8fea-ca067fdca672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:23.504817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12648249-8272-4639-a11a-35889c8f759c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:23.513014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa435d-26e2-4f34-9ff4-00fee15e5700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:23.513910 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa435d-26e2-4f34-9ff4-00fee15e5700 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.514260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa435d-26e2-4f34-9ff4-00fee15e5700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.514548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa435d-26e2-4f34-9ff4-00fee15e5700 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.515113 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa435d-26e2-4f34-9ff4-00fee15e5700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:23.515419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa435d-26e2-4f34-9ff4-00fee15e5700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:23.517082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa435d-26e2-4f34-9ff4-00fee15e5700 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:23.541509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1015/2018] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:18:23.546234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa435d-26e2-4f34-9ff4-00fee15e5700 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:23.565391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa435d-26e2-4f34-9ff4-00fee15e5700 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:23.572290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1543daa-9b79-4f2a-a3f9-7af10ce3b40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:23.573737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543daa-9b79-4f2a-a3f9-7af10ce3b40a admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.574180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543daa-9b79-4f2a-a3f9-7af10ce3b40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.574764 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1543daa-9b79-4f2a-a3f9-7af10ce3b40a admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.575674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1543daa-9b79-4f2a-a3f9-7af10ce3b40a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:23.578112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1543daa-9b79-4f2a-a3f9-7af10ce3b40a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:23.581723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1004/2019] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:23.594317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5190ec-8dab-4005-8fea-ca067fdca672 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:23.595675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3f5190ec-8dab-4005-8fea-ca067fdca672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:23.665426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5190ec-8dab-4005-8fea-ca067fdca672 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:23.669591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81248257-416e-40c9-a02b-ad43c9ba88d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:23.670249 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248257-416e-40c9-a02b-ad43c9ba88d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.670610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248257-416e-40c9-a02b-ad43c9ba88d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.670956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81248257-416e-40c9-a02b-ad43c9ba88d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.682868 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81248257-416e-40c9-a02b-ad43c9ba88d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:23.684367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81248257-416e-40c9-a02b-ad43c9ba88d3 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:23.699548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1005/2020] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:18:23.856733 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1016/2021] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:23 2022] POST /identity/v3/projects => generated 363 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:23.913592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81248257-416e-40c9-a02b-ad43c9ba88d3 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:23.929257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81248257-416e-40c9-a02b-ad43c9ba88d3 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:23.997679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb398f3-410a-4359-bf6e-4a2ebb7f56f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:23.998563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb398f3-410a-4359-bf6e-4a2ebb7f56f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.998911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb398f3-410a-4359-bf6e-4a2ebb7f56f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.999301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb398f3-410a-4359-bf6e-4a2ebb7f56f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:24.001116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb398f3-410a-4359-bf6e-4a2ebb7f56f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:24.002890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb398f3-410a-4359-bf6e-4a2ebb7f56f3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:24.333706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1006/2022] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:23 2022] POST /identity/v3/users => generated 282 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:24.336510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1543daa-9b79-4f2a-a3f9-7af10ce3b40a admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:24.351606 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1543daa-9b79-4f2a-a3f9-7af10ce3b40a admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:24.356939 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b60e30-748a-4bb9-8e6f-c636a33301e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:24.357319 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60e30-748a-4bb9-8e6f-c636a33301e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:24.357593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60e30-748a-4bb9-8e6f-c636a33301e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:24.357868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b60e30-748a-4bb9-8e6f-c636a33301e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:24.358515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b60e30-748a-4bb9-8e6f-c636a33301e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:24.360100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b60e30-748a-4bb9-8e6f-c636a33301e4 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:24.371352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1017/2023] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:24.375655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb398f3-410a-4359-bf6e-4a2ebb7f56f3 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:24.386493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb398f3-410a-4359-bf6e-4a2ebb7f56f3 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:24.391607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67e0ef-f78d-4936-b8e3-59b633a3c54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:24.392203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67e0ef-f78d-4936-b8e3-59b633a3c54c admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:24.392529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67e0ef-f78d-4936-b8e3-59b633a3c54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:24.392982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67e0ef-f78d-4936-b8e3-59b633a3c54c admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:24.393739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67e0ef-f78d-4936-b8e3-59b633a3c54c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:24.395347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67e0ef-f78d-4936-b8e3-59b633a3c54c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:24.406072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1007/2024] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:24.410977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b60e30-748a-4bb9-8e6f-c636a33301e4 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:24.422262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b60e30-748a-4bb9-8e6f-c636a33301e4 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:24.427620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cf5ed-6e71-4049-bba1-d14921c3c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:24.428356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cf5ed-6e71-4049-bba1-d14921c3c06a admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:24.428661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cf5ed-6e71-4049-bba1-d14921c3c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:24.428915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cf5ed-6e71-4049-bba1-d14921c3c06a admin admin] PATH_INFO: `/v3/projects/744e6b04794f4a968700055d47f1d113/users/8f1b96eefa994e8095ca428e363acb5d/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:24.446030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cf5ed-6e71-4049-bba1-d14921c3c06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=744e6b04794f4a968700055d47f1d113, user_id=8f1b96eefa994e8095ca428e363acb5d, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:24.449048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cf5ed-6e71-4049-bba1-d14921c3c06a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:24.455185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:24.553337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1018/2025] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:24 2022] PUT /identity/v3/projects/744e6b04794f4a968700055d47f1d113/users/8f1b96eefa994e8095ca428e363acb5d/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:24.565314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45a779-740a-4959-9e9d-b6436697b901 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:24.565602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45a779-740a-4959-9e9d-b6436697b901 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:24.565893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45a779-740a-4959-9e9d-b6436697b901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:24.597424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ef45a779-740a-4959-9e9d-b6436697b901 None None] MFA Rules not processed for user `8f1b96eefa994e8095ca428e363acb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:24.598711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ef45a779-740a-4959-9e9d-b6436697b901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:24.685859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1008/2026] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:24.694533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cf5ed-6e71-4049-bba1-d14921c3c06a admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:24.760309 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cf5ed-6e71-4049-bba1-d14921c3c06a admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:24.765381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09a302-4181-4f98-9bb4-78a4cad0fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:24.765988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09a302-4181-4f98-9bb4-78a4cad0fba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:24.766263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09a302-4181-4f98-9bb4-78a4cad0fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:24.766530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09a302-4181-4f98-9bb4-78a4cad0fba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:24.767209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09a302-4181-4f98-9bb4-78a4cad0fba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:24.769354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09a302-4181-4f98-9bb4-78a4cad0fba7 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:24.890302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1019/2027] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:24 2022] POST /identity/v3/projects => generated 365 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:24.894431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45a779-740a-4959-9e9d-b6436697b901 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:24.905563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45a779-740a-4959-9e9d-b6436697b901 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:24.965966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f22253-9c50-451c-a742-24df8d16f8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:24.966503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f22253-9c50-451c-a742-24df8d16f8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:24.966784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f22253-9c50-451c-a742-24df8d16f8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:24.967090 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f22253-9c50-451c-a742-24df8d16f8bf admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:24.967780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f22253-9c50-451c-a742-24df8d16f8bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:24.969869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f22253-9c50-451c-a742-24df8d16f8bf admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:25.084023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1009/2028] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:24 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:25.088609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09a302-4181-4f98-9bb4-78a4cad0fba7 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:25.099482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09a302-4181-4f98-9bb4-78a4cad0fba7 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:25.104319 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd80bd1-c2d8-4d34-a5d8-1fb2eefd8d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:25.105417 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80bd1-c2d8-4d34-a5d8-1fb2eefd8d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:25.105923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80bd1-c2d8-4d34-a5d8-1fb2eefd8d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:25.106477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd80bd1-c2d8-4d34-a5d8-1fb2eefd8d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:25.107760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd80bd1-c2d8-4d34-a5d8-1fb2eefd8d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:25.109750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd80bd1-c2d8-4d34-a5d8-1fb2eefd8d41 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:25.124983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1020/2029] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:25.133155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f22253-9c50-451c-a742-24df8d16f8bf admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:25.145055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f22253-9c50-451c-a742-24df8d16f8bf admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:25.150203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb119ba-f5a6-4ca1-95c4-1c08bdea2f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:25.150955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb119ba-f5a6-4ca1-95c4-1c08bdea2f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:25.151234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb119ba-f5a6-4ca1-95c4-1c08bdea2f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:25.151505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb119ba-f5a6-4ca1-95c4-1c08bdea2f94 admin admin] PATH_INFO: `/v3/projects/fe143ef77adb48df960217e875e13cba/users/afe2ae2f0c404a258a9e0523b22d6c58/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:25.167678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb119ba-f5a6-4ca1-95c4-1c08bdea2f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe143ef77adb48df960217e875e13cba, user_id=afe2ae2f0c404a258a9e0523b22d6c58, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:25.170453 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb119ba-f5a6-4ca1-95c4-1c08bdea2f94 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:25.227248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1010/2030] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:25 2022] PUT /identity/v3/projects/fe143ef77adb48df960217e875e13cba/users/afe2ae2f0c404a258a9e0523b22d6c58/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:25.231507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd80bd1-c2d8-4d34-a5d8-1fb2eefd8d41 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:25.242844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd80bd1-c2d8-4d34-a5d8-1fb2eefd8d41 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:25.307193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:25.307905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427ae13-bb08-45ca-bc30-48c5b3402a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:25.308624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ae13-bb08-45ca-bc30-48c5b3402a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:25.308909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ae13-bb08-45ca-bc30-48c5b3402a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:25.309187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427ae13-bb08-45ca-bc30-48c5b3402a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:25.309847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427ae13-bb08-45ca-bc30-48c5b3402a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:25.311499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427ae13-bb08-45ca-bc30-48c5b3402a82 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:25.322151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1021/2031] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:25.326269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb119ba-f5a6-4ca1-95c4-1c08bdea2f94 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:25.337255 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb119ba-f5a6-4ca1-95c4-1c08bdea2f94 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:25.342044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28da1-ec41-4b97-829e-de7efeb7256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:25.342707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28da1-ec41-4b97-829e-de7efeb7256e admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:25.342983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28da1-ec41-4b97-829e-de7efeb7256e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:25.343251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28da1-ec41-4b97-829e-de7efeb7256e admin admin] PATH_INFO: `/v3/projects/fe143ef77adb48df960217e875e13cba/users/afe2ae2f0c404a258a9e0523b22d6c58/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:25.345206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed28da1-ec41-4b97-829e-de7efeb7256e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe143ef77adb48df960217e875e13cba, user_id=afe2ae2f0c404a258a9e0523b22d6c58, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:25.350316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed28da1-ec41-4b97-829e-de7efeb7256e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:25.361553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1011/2032] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:25 2022] PUT /identity/v3/projects/fe143ef77adb48df960217e875e13cba/users/afe2ae2f0c404a258a9e0523b22d6c58/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:25.372758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8135-19fa-4415-ae5d-80c29e5f47b7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:25.373337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8135-19fa-4415-ae5d-80c29e5f47b7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:25.373337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8135-19fa-4415-ae5d-80c29e5f47b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:25.405408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28da1-ec41-4b97-829e-de7efeb7256e admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:25.410530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-060b8135-19fa-4415-ae5d-80c29e5f47b7 None None] MFA Rules not processed for user `afe2ae2f0c404a258a9e0523b22d6c58`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:25.410530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-060b8135-19fa-4415-ae5d-80c29e5f47b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:25.415814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:25.469933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28da1-ec41-4b97-829e-de7efeb7256e admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:25.475898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:25.476744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:25.476954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:25.477227 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] PATH_INFO: `/v3/users/ba07d403f6134274803fef2cecdf575b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:25.478477 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba07d403f6134274803fef2cecdf575b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:25.480365 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:25.485063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1022/2033] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:25.495441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b8135-19fa-4415-ae5d-80c29e5f47b7 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:25.519095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:25.557662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b8135-19fa-4415-ae5d-80c29e5f47b7 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:25.561974 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e052094-6ef3-4b8d-ad2c-9edfdff6fd2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:25.565528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052094-6ef3-4b8d-ad2c-9edfdff6fd2c service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:25.565528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052094-6ef3-4b8d-ad2c-9edfdff6fd2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:25.565528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e052094-6ef3-4b8d-ad2c-9edfdff6fd2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:25.573431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e052094-6ef3-4b8d-ad2c-9edfdff6fd2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:25.574848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e052094-6ef3-4b8d-ad2c-9edfdff6fd2c service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:25.585888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1023/2034] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:25.692095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba07d403f6134274803fef2cecdf575b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:25.693124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba07d403f6134274803fef2cecdf575b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:25.700589 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba07d403f6134274803fef2cecdf575b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:25.701253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba07d403f6134274803fef2cecdf575b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:25.717319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba07d403f6134274803fef2cecdf575b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:25.836570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1012/2035] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:25 2022] DELETE /identity/v3/users/ba07d403f6134274803fef2cecdf575b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:25.841902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c13fd-d7a5-474c-8129-5faaccde1b82 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:25.842330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c13fd-d7a5-474c-8129-5faaccde1b82 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:25.842788 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c13fd-d7a5-474c-8129-5faaccde1b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:25.853244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:25.856022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:25.884351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-326c13fd-d7a5-474c-8129-5faaccde1b82 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:25.886844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-326c13fd-d7a5-474c-8129-5faaccde1b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:25.940783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072e83f-584e-4255-8a7e-f4f4a45c19ba admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:25.947638 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700f420-e572-4bab-9910-a91d4f01ac1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:25.949169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700f420-e572-4bab-9910-a91d4f01ac1e service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:25.949965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700f420-e572-4bab-9910-a91d4f01ac1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:25.950463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700f420-e572-4bab-9910-a91d4f01ac1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:25.953511 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1700f420-e572-4bab-9910-a91d4f01ac1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:25.985696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1024/2036] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:25.995738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c13fd-d7a5-474c-8129-5faaccde1b82 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:25.997252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-326c13fd-d7a5-474c-8129-5faaccde1b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:26.032542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700f420-e572-4bab-9910-a91d4f01ac1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:26.034912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700f420-e572-4bab-9910-a91d4f01ac1e service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:26.046364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1013/2037] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:18:26.056966 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:26.068358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c13fd-d7a5-474c-8129-5faaccde1b82 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:26.069000 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37025212-9b5e-46e3-b27b-23fe50cbee6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:26.069629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37025212-9b5e-46e3-b27b-23fe50cbee6c service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:26.069915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37025212-9b5e-46e3-b27b-23fe50cbee6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:26.070201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37025212-9b5e-46e3-b27b-23fe50cbee6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:26.080809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37025212-9b5e-46e3-b27b-23fe50cbee6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:26.082943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37025212-9b5e-46e3-b27b-23fe50cbee6c service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:26.097206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1025/2038] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:18:26.612081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700f420-e572-4bab-9910-a91d4f01ac1e service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:26.613890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1700f420-e572-4bab-9910-a91d4f01ac1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:26.624278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:26.635841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700f420-e572-4bab-9910-a91d4f01ac1e service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:26.641713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:26.642321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:26.642601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:26.642872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] PATH_INFO: `/v3/projects/c11d82f0bd5149e8aee16118c167882b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:26.644074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11d82f0bd5149e8aee16118c167882b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:26.646244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:26.767670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11d82f0bd5149e8aee16118c167882b', 'request_id': 'req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:26.878438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11d82f0bd5149e8aee16118c167882b', 'request_id': 'req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:26.885733 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11d82f0bd5149e8aee16118c167882b', 'request_id': 'req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:26.899608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] The token cache is being invalidate because project c11d82f0bd5149e8aee16118c167882b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:26.899973 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:26.900684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:26.902307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1014/2039] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:26 2022] DELETE /identity/v3/projects/c11d82f0bd5149e8aee16118c167882b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:26.907094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37025212-9b5e-46e3-b27b-23fe50cbee6c service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:26.918526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37025212-9b5e-46e3-b27b-23fe50cbee6c service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:26.980707 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9026ed8-1051-443d-b96b-23ff9d098ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:26.981589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9026ed8-1051-443d-b96b-23ff9d098ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:26.982251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9026ed8-1051-443d-b96b-23ff9d098ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:26.982251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9026ed8-1051-443d-b96b-23ff9d098ecf admin admin] PATH_INFO: `/v3/users/d71cc90b563b424781456d15f8ebd76f` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:26.983714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9026ed8-1051-443d-b96b-23ff9d098ecf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d71cc90b563b424781456d15f8ebd76f)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:26.986677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9026ed8-1051-443d-b96b-23ff9d098ecf admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:27.228177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d9026ed8-1051-443d-b96b-23ff9d098ecf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd71cc90b563b424781456d15f8ebd76f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:27.228871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d9026ed8-1051-443d-b96b-23ff9d098ecf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd71cc90b563b424781456d15f8ebd76f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:27.229523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d9026ed8-1051-443d-b96b-23ff9d098ecf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd71cc90b563b424781456d15f8ebd76f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:27.244393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d9026ed8-1051-443d-b96b-23ff9d098ecf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd71cc90b563b424781456d15f8ebd76f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:27.380985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d9026ed8-1051-443d-b96b-23ff9d098ecf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd71cc90b563b424781456d15f8ebd76f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:27.395857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1026/2040] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:26 2022] DELETE /identity/v3/users/d71cc90b563b424781456d15f8ebd76f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:27.811525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:27.813059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:27.830418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7143e-4d5a-4548-aeaf-deb4a7ea768c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:27.900770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:27.901426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:27.901723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:27.901972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] PATH_INFO: `/v3/projects/cbade2c5ff9448dbb5210f3550aa6d25` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:27.903130 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbade2c5ff9448dbb5210f3550aa6d25)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:27.906298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:28.052703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbade2c5ff9448dbb5210f3550aa6d25', 'request_id': 'req-d792ac8f-b4d5-4636-ac88-7960ef0f0085'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:28.128953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbade2c5ff9448dbb5210f3550aa6d25', 'request_id': 'req-d792ac8f-b4d5-4636-ac88-7960ef0f0085'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:28.136108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbade2c5ff9448dbb5210f3550aa6d25', 'request_id': 'req-d792ac8f-b4d5-4636-ac88-7960ef0f0085'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:28.148528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] The token cache is being invalidate because project cbade2c5ff9448dbb5210f3550aa6d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:28.148528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:28.149089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d792ac8f-b4d5-4636-ac88-7960ef0f0085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:28.150966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1015/2041] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:27 2022] DELETE /identity/v3/projects/cbade2c5ff9448dbb5210f3550aa6d25 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:28.155972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156f5ba-f037-4ca4-9e7c-2e5a5e86ae08 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.156474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156f5ba-f037-4ca4-9e7c-2e5a5e86ae08 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.156673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156f5ba-f037-4ca4-9e7c-2e5a5e86ae08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:28.182807 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-f156f5ba-f037-4ca4-9e7c-2e5a5e86ae08 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:28.184116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f156f5ba-f037-4ca4-9e7c-2e5a5e86ae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:28.265047 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1027/2042] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:28.267410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156f5ba-f037-4ca4-9e7c-2e5a5e86ae08 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:28.267933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc4262-ebe6-45ae-a8d5-287552d55ec6 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.268372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc4262-ebe6-45ae-a8d5-287552d55ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.269215 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc4262-ebe6-45ae-a8d5-287552d55ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:28.270577 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f156f5ba-f037-4ca4-9e7c-2e5a5e86ae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:28.294162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156f5ba-f037-4ca4-9e7c-2e5a5e86ae08 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:28.304482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b2606-f803-44d4-a216-6858438937a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:28.313314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b2606-f803-44d4-a216-6858438937a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.313314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b2606-f803-44d4-a216-6858438937a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.313314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b2606-f803-44d4-a216-6858438937a8 admin admin] PATH_INFO: `/v3/users/57aacfe7bcfb486697ac4323aa2c5c7f` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:28.313314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b2606-f803-44d4-a216-6858438937a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57aacfe7bcfb486697ac4323aa2c5c7f)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:28.313314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b2606-f803-44d4-a216-6858438937a8 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:28.319759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:28.320507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-15bc4262-ebe6-45ae-a8d5-287552d55ec6 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:28.321814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-15bc4262-ebe6-45ae-a8d5-287552d55ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:28.332844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1016/2043] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:28.337194 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc4262-ebe6-45ae-a8d5-287552d55ec6 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:28.349265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc4262-ebe6-45ae-a8d5-287552d55ec6 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:28.354151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51127d11-f04e-426a-8924-ae9ff5d59bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:28.354897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51127d11-f04e-426a-8924-ae9ff5d59bee admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.355301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51127d11-f04e-426a-8924-ae9ff5d59bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.355674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51127d11-f04e-426a-8924-ae9ff5d59bee admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:28.356512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51127d11-f04e-426a-8924-ae9ff5d59bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:28.356885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51127d11-f04e-426a-8924-ae9ff5d59bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:28.358597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51127d11-f04e-426a-8924-ae9ff5d59bee admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:28.367730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:28.378078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1017/2044] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:18:28.379608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51127d11-f04e-426a-8924-ae9ff5d59bee admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:28.390140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51127d11-f04e-426a-8924-ae9ff5d59bee admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:28.397134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2172ba-46f5-4812-b351-4a1646e9995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:28.397758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2172ba-46f5-4812-b351-4a1646e9995f admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.398039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2172ba-46f5-4812-b351-4a1646e9995f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.398430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2172ba-46f5-4812-b351-4a1646e9995f admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:28.399065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2172ba-46f5-4812-b351-4a1646e9995f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:28.401179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2172ba-46f5-4812-b351-4a1646e9995f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:28.509258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1018/2045] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:28 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:28.513577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2172ba-46f5-4812-b351-4a1646e9995f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:28.549759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c85b2606-f803-44d4-a216-6858438937a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57aacfe7bcfb486697ac4323aa2c5c7f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:28.551032 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c85b2606-f803-44d4-a216-6858438937a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57aacfe7bcfb486697ac4323aa2c5c7f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:28.552804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c85b2606-f803-44d4-a216-6858438937a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57aacfe7bcfb486697ac4323aa2c5c7f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:28.566836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c85b2606-f803-44d4-a216-6858438937a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57aacfe7bcfb486697ac4323aa2c5c7f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:28.591558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2172ba-46f5-4812-b351-4a1646e9995f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:28.596490 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bee8de-45b9-4f6e-bef9-3d7dfaee16ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:28.597796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee8de-45b9-4f6e-bef9-3d7dfaee16ba admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.598172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee8de-45b9-4f6e-bef9-3d7dfaee16ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.598415 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bee8de-45b9-4f6e-bef9-3d7dfaee16ba admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:28.599076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bee8de-45b9-4f6e-bef9-3d7dfaee16ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:28.601105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bee8de-45b9-4f6e-bef9-3d7dfaee16ba admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:28.639332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c85b2606-f803-44d4-a216-6858438937a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57aacfe7bcfb486697ac4323aa2c5c7f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:28.654700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1028/2046] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:28 2022] DELETE /identity/v3/users/57aacfe7bcfb486697ac4323aa2c5c7f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:28.659091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847cf60-5f0f-4f06-8495-8621c38cd5dd None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.659503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847cf60-5f0f-4f06-8495-8621c38cd5dd None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.660040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847cf60-5f0f-4f06-8495-8621c38cd5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:28.682440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b847cf60-5f0f-4f06-8495-8621c38cd5dd None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:28.683656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b847cf60-5f0f-4f06-8495-8621c38cd5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:28.737703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1019/2047] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:28 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:28.738579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bee8de-45b9-4f6e-bef9-3d7dfaee16ba admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:28.740146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-02bee8de-45b9-4f6e-bef9-3d7dfaee16ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:28.745198 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1029/2048] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:28.752697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bee8de-45b9-4f6e-bef9-3d7dfaee16ba admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:28.756544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847cf60-5f0f-4f06-8495-8621c38cd5dd None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:28.757921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b847cf60-5f0f-4f06-8495-8621c38cd5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:28.759708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b40819-24b2-409d-8665-a9376b61cf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:28.760357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40819-24b2-409d-8665-a9376b61cf1f admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.760693 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40819-24b2-409d-8665-a9376b61cf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.760904 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b40819-24b2-409d-8665-a9376b61cf1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:28.761713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b40819-24b2-409d-8665-a9376b61cf1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:28.763689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b40819-24b2-409d-8665-a9376b61cf1f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:28.774798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1020/2049] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:28.779133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b40819-24b2-409d-8665-a9376b61cf1f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:28.789248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b40819-24b2-409d-8665-a9376b61cf1f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:28.796531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f8124-5da3-4225-8431-32e0cf9c788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:28.797412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f8124-5da3-4225-8431-32e0cf9c788e admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.797853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f8124-5da3-4225-8431-32e0cf9c788e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.798270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f8124-5da3-4225-8431-32e0cf9c788e admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:28.799369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f8124-5da3-4225-8431-32e0cf9c788e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:28.802261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f8124-5da3-4225-8431-32e0cf9c788e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:28.813618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1021/2050] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:18:28.818615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f8124-5da3-4225-8431-32e0cf9c788e admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:28.821363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847cf60-5f0f-4f06-8495-8621c38cd5dd None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:28.825231 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69c3b4-7c4b-46f9-8f05-60ad5f02957c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:28.841889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c3b4-7c4b-46f9-8f05-60ad5f02957c service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.841889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c3b4-7c4b-46f9-8f05-60ad5f02957c service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.841889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c3b4-7c4b-46f9-8f05-60ad5f02957c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:28.842214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f8124-5da3-4225-8431-32e0cf9c788e admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:28.842214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac2ef3-4b48-4373-b68e-4bc63c4495d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:28.842214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac2ef3-4b48-4373-b68e-4bc63c4495d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.842214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac2ef3-4b48-4373-b68e-4bc63c4495d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.842556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac2ef3-4b48-4373-b68e-4bc63c4495d4 admin admin] PATH_INFO: `/v3/projects/c9bf7b3b638c48a1a302e6fad0be4b47/users/2847ca90f7c84d7b83b9bdc0d8bef117/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:28.842640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69c3b4-7c4b-46f9-8f05-60ad5f02957c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:28.842640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a69c3b4-7c4b-46f9-8f05-60ad5f02957c service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:28.849717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1030/2051] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:28.853792 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac2ef3-4b48-4373-b68e-4bc63c4495d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bf7b3b638c48a1a302e6fad0be4b47, user_id=2847ca90f7c84d7b83b9bdc0d8bef117, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:28.856512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac2ef3-4b48-4373-b68e-4bc63c4495d4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:28.975561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1022/2052] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:28 2022] PUT /identity/v3/projects/c9bf7b3b638c48a1a302e6fad0be4b47/users/2847ca90f7c84d7b83b9bdc0d8bef117/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:28.986493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0de1-70ef-4d2b-8aaa-8e2bfb895add None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:28.986779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0de1-70ef-4d2b-8aaa-8e2bfb895add None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:28.987073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0de1-70ef-4d2b-8aaa-8e2bfb895add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.017413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-f9ce0de1-70ef-4d2b-8aaa-8e2bfb895add None None] MFA Rules not processed for user `2847ca90f7c84d7b83b9bdc0d8bef117`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:29.018726 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f9ce0de1-70ef-4d2b-8aaa-8e2bfb895add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:29.030826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:29.088060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1031/2053] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:29.092532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac2ef3-4b48-4373-b68e-4bc63c4495d4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:29.167346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac2ef3-4b48-4373-b68e-4bc63c4495d4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:29.172076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d379a2-943c-43bd-8858-b6657dc287aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:29.172725 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d379a2-943c-43bd-8858-b6657dc287aa admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:29.173034 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d379a2-943c-43bd-8858-b6657dc287aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:29.173307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d379a2-943c-43bd-8858-b6657dc287aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.173937 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d379a2-943c-43bd-8858-b6657dc287aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:29.176881 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d379a2-943c-43bd-8858-b6657dc287aa admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:29.263406 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1023/2054] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:29 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:29.267451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0de1-70ef-4d2b-8aaa-8e2bfb895add None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:29.278535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0de1-70ef-4d2b-8aaa-8e2bfb895add None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:29.292779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d379a2-943c-43bd-8858-b6657dc287aa admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:29.294637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f6d379a2-943c-43bd-8858-b6657dc287aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:29.301952 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:29.349595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f257ca-aaf0-4b4a-abf1-c1f43e2fdd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:29.350215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f257ca-aaf0-4b4a-abf1-c1f43e2fdd77 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:29.350779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f257ca-aaf0-4b4a-abf1-c1f43e2fdd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:29.350913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f257ca-aaf0-4b4a-abf1-c1f43e2fdd77 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.351509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f257ca-aaf0-4b4a-abf1-c1f43e2fdd77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:29.353429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f257ca-aaf0-4b4a-abf1-c1f43e2fdd77 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:29.376091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d379a2-943c-43bd-8858-b6657dc287aa admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:29.381459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:29.382145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:29.382406 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:29.382681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] PATH_INFO: `/v3/projects/84230e6c4bda40ff93b1dbbbede6df85` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.383822 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84230e6c4bda40ff93b1dbbbede6df85)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:29.385841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:29.479306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1032/2055] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:29 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:29.483390 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f257ca-aaf0-4b4a-abf1-c1f43e2fdd77 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:29.494993 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f257ca-aaf0-4b4a-abf1-c1f43e2fdd77 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:29.500986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656607b2-4a0b-4c62-aac5-07de3cfb8055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:29.501684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656607b2-4a0b-4c62-aac5-07de3cfb8055 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:29.502043 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656607b2-4a0b-4c62-aac5-07de3cfb8055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:29.502391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656607b2-4a0b-4c62-aac5-07de3cfb8055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.503174 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656607b2-4a0b-4c62-aac5-07de3cfb8055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:29.504944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656607b2-4a0b-4c62-aac5-07de3cfb8055 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:29.522487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1033/2056] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:29.528053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656607b2-4a0b-4c62-aac5-07de3cfb8055 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:29.532273 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84230e6c4bda40ff93b1dbbbede6df85', 'request_id': 'req-2a34a88b-1909-4662-add0-8f2ff1620529'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:29.549047 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656607b2-4a0b-4c62-aac5-07de3cfb8055 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:29.620700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541c8a-6b2d-4f27-8933-db795b4c5c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:29.621240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541c8a-6b2d-4f27-8933-db795b4c5c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:29.621521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541c8a-6b2d-4f27-8933-db795b4c5c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:29.621796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541c8a-6b2d-4f27-8933-db795b4c5c90 admin admin] PATH_INFO: `/v3/projects/93e7000ad2c94327bf242b843dfa6d1f/users/82c3247921db452784dab59a4b8b9ed3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.638104 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97541c8a-6b2d-4f27-8933-db795b4c5c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e7000ad2c94327bf242b843dfa6d1f, user_id=82c3247921db452784dab59a4b8b9ed3, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:29.641242 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97541c8a-6b2d-4f27-8933-db795b4c5c90 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:29.666785 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84230e6c4bda40ff93b1dbbbede6df85', 'request_id': 'req-2a34a88b-1909-4662-add0-8f2ff1620529'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:29.692305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84230e6c4bda40ff93b1dbbbede6df85', 'request_id': 'req-2a34a88b-1909-4662-add0-8f2ff1620529'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:29.692305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] The token cache is being invalidate because project 84230e6c4bda40ff93b1dbbbede6df85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:29.692305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:29.692305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-2a34a88b-1909-4662-add0-8f2ff1620529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:29.692305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1024/2057] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:29 2022] DELETE /identity/v3/projects/84230e6c4bda40ff93b1dbbbede6df85 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:29.694809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6213c23-af44-434e-b01b-7f9c2622385d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:29.695074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6213c23-af44-434e-b01b-7f9c2622385d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:29.695344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6213c23-af44-434e-b01b-7f9c2622385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.718550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c6213c23-af44-434e-b01b-7f9c2622385d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:29.719830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c6213c23-af44-434e-b01b-7f9c2622385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:29.734380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1025/2058] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:29.745685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49b6c-94f4-458a-8c45-33741227bb97 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:29.745685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49b6c-94f4-458a-8c45-33741227bb97 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:29.745685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49b6c-94f4-458a-8c45-33741227bb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.770252 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b1f49b6c-94f4-458a-8c45-33741227bb97 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:29.771353 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b1f49b6c-94f4-458a-8c45-33741227bb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:29.780843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1026/2059] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:29.785705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49b6c-94f4-458a-8c45-33741227bb97 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:29.795126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49b6c-94f4-458a-8c45-33741227bb97 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:29.801526 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae96a11-18cb-4082-a2ba-f84da8118c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:29.802179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae96a11-18cb-4082-a2ba-f84da8118c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:29.802454 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae96a11-18cb-4082-a2ba-f84da8118c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:29.803275 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae96a11-18cb-4082-a2ba-f84da8118c23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.803899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae96a11-18cb-4082-a2ba-f84da8118c23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:29.804215 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae96a11-18cb-4082-a2ba-f84da8118c23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:29.805988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae96a11-18cb-4082-a2ba-f84da8118c23 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:29.823017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1027/2060] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:18:29.823937 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae96a11-18cb-4082-a2ba-f84da8118c23 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:29.827816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1034/2061] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:29 2022] PUT /identity/v3/projects/93e7000ad2c94327bf242b843dfa6d1f/users/82c3247921db452784dab59a4b8b9ed3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:29.831921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541c8a-6b2d-4f27-8933-db795b4c5c90 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:29.833808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-97541c8a-6b2d-4f27-8933-db795b4c5c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:29.836489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae96a11-18cb-4082-a2ba-f84da8118c23 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:29.907657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541c8a-6b2d-4f27-8933-db795b4c5c90 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:29.910640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b942ddc-3302-4f32-9438-e2db38afb94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:29.911430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b942ddc-3302-4f32-9438-e2db38afb94c admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:29.911717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b942ddc-3302-4f32-9438-e2db38afb94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:29.912033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b942ddc-3302-4f32-9438-e2db38afb94c admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.912609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656bd8a-8e29-428f-bf96-55b913c9f136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:29.912736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b942ddc-3302-4f32-9438-e2db38afb94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:29.913221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656bd8a-8e29-428f-bf96-55b913c9f136 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:29.913508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656bd8a-8e29-428f-bf96-55b913c9f136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:29.913780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656bd8a-8e29-428f-bf96-55b913c9f136 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.914421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656bd8a-8e29-428f-bf96-55b913c9f136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:29.914596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b942ddc-3302-4f32-9438-e2db38afb94c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:29.916000 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656bd8a-8e29-428f-bf96-55b913c9f136 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:29.930583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1035/2062] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:29.930583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656bd8a-8e29-428f-bf96-55b913c9f136 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:29.931969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6656bd8a-8e29-428f-bf96-55b913c9f136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:29.946216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656bd8a-8e29-428f-bf96-55b913c9f136 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:29.951555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:29.952895 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:29.952895 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:29.953114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] PATH_INFO: `/v3/users/8f1b96eefa994e8095ca428e363acb5d` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:29.954556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1b96eefa994e8095ca428e363acb5d)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:29.956849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:30.010337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1028/2063] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:29 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:30.011305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b942ddc-3302-4f32-9438-e2db38afb94c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:30.073544 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b942ddc-3302-4f32-9438-e2db38afb94c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:30.073810 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:30.078408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5259e-fd7a-4a8a-b4b7-152dc2ddb7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:30.079039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5259e-fd7a-4a8a-b4b7-152dc2ddb7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.079346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5259e-fd7a-4a8a-b4b7-152dc2ddb7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.079621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5259e-fd7a-4a8a-b4b7-152dc2ddb7f2 admin admin] PATH_INFO: `/v3/projects/93e7000ad2c94327bf242b843dfa6d1f/users/82c3247921db452784dab59a4b8b9ed3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.081981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5259e-fd7a-4a8a-b4b7-152dc2ddb7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e7000ad2c94327bf242b843dfa6d1f, user_id=82c3247921db452784dab59a4b8b9ed3, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:30.084651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5259e-fd7a-4a8a-b4b7-152dc2ddb7f2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:30.094690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1029/2064] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:30 2022] PUT /identity/v3/projects/93e7000ad2c94327bf242b843dfa6d1f/users/82c3247921db452784dab59a4b8b9ed3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:30.095453 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5259e-fd7a-4a8a-b4b7-152dc2ddb7f2 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:30.157524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5259e-fd7a-4a8a-b4b7-152dc2ddb7f2 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:30.163232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ccb17-a9d8-41dd-b48b-b77ad7f53e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:30.163832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ccb17-a9d8-41dd-b48b-b77ad7f53e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.164111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ccb17-a9d8-41dd-b48b-b77ad7f53e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.164417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ccb17-a9d8-41dd-b48b-b77ad7f53e06 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.165044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ccb17-a9d8-41dd-b48b-b77ad7f53e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:30.166938 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ccb17-a9d8-41dd-b48b-b77ad7f53e06 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:30.189018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1b96eefa994e8095ca428e363acb5d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:30.200948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1b96eefa994e8095ca428e363acb5d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:30.200948 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1b96eefa994e8095ca428e363acb5d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:30.201889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1b96eefa994e8095ca428e363acb5d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:30.255904 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1030/2065] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:30 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:30.257241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b10809-79ea-4608-ba82-25d573750400 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.257524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b10809-79ea-4608-ba82-25d573750400 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.257797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b10809-79ea-4608-ba82-25d573750400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.278291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1b96eefa994e8095ca428e363acb5d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:30.288198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-46b10809-79ea-4608-ba82-25d573750400 None None] MFA Rules not processed for user `82c3247921db452784dab59a4b8b9ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:30.289492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-46b10809-79ea-4608-ba82-25d573750400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:30.295157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1036/2066] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:29 2022] DELETE /identity/v3/users/8f1b96eefa994e8095ca428e363acb5d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:30.295157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:30.296581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:30.366419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0019026-bc1d-4a94-baf1-961095e3547c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:30.368567 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1031/2067] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:30.370150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd28abb-06dd-445a-91fc-7388f0d60709 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.370574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd28abb-06dd-445a-91fc-7388f0d60709 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.370901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd28abb-06dd-445a-91fc-7388f0d60709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.376850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4054b-81ed-4041-8fd3-b08a5c518e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:30.377479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4054b-81ed-4041-8fd3-b08a5c518e70 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.377777 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4054b-81ed-4041-8fd3-b08a5c518e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.378552 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4054b-81ed-4041-8fd3-b08a5c518e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.379351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4054b-81ed-4041-8fd3-b08a5c518e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:30.381077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4054b-81ed-4041-8fd3-b08a5c518e70 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:30.396605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-5bd28abb-06dd-445a-91fc-7388f0d60709 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:30.396797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1037/2068] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:30.396797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4054b-81ed-4041-8fd3-b08a5c518e70 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:30.396972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5bd28abb-06dd-445a-91fc-7388f0d60709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:30.398580 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-edf4054b-81ed-4041-8fd3-b08a5c518e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:30.406623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1032/2069] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:30.406623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd28abb-06dd-445a-91fc-7388f0d60709 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:30.418334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd28abb-06dd-445a-91fc-7388f0d60709 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:30.423440 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f4ee2-621d-4dc7-bcfe-17b2f7290d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:30.424141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f4ee2-621d-4dc7-bcfe-17b2f7290d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.424492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f4ee2-621d-4dc7-bcfe-17b2f7290d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.427309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f4ee2-621d-4dc7-bcfe-17b2f7290d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.428391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f4ee2-621d-4dc7-bcfe-17b2f7290d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:30.430085 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f4ee2-621d-4dc7-bcfe-17b2f7290d96 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:30.440713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1033/2070] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:30.441697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f4ee2-621d-4dc7-bcfe-17b2f7290d96 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:30.444671 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:30.446303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-589f4ee2-621d-4dc7-bcfe-17b2f7290d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:30.476989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4054b-81ed-4041-8fd3-b08a5c518e70 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:30.480718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7ed50-3dc5-44df-9555-8710341757a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:30.481327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7ed50-3dc5-44df-9555-8710341757a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.481611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7ed50-3dc5-44df-9555-8710341757a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.481881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7ed50-3dc5-44df-9555-8710341757a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.492119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7ed50-3dc5-44df-9555-8710341757a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:30.493629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7ed50-3dc5-44df-9555-8710341757a7 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:30.503961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1038/2071] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:30.505056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7ed50-3dc5-44df-9555-8710341757a7 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:30.519850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7ed50-3dc5-44df-9555-8710341757a7 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:30.525689 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5e280-4cad-4622-b982-0cf30fd223b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:30.528367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5e280-4cad-4622-b982-0cf30fd223b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.528367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5e280-4cad-4622-b982-0cf30fd223b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.528367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5e280-4cad-4622-b982-0cf30fd223b5 admin admin] PATH_INFO: `/v3/projects/c42e9d9aa7c64c2cb78d30c3f5d472fe/users/5300c898f29d49b391025581a98dc65d/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.528659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f4ee2-621d-4dc7-bcfe-17b2f7290d96 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:30.533053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42939cee-7dc1-45e0-8cf3-a12c31f2564b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:30.533899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42939cee-7dc1-45e0-8cf3-a12c31f2564b service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.535020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42939cee-7dc1-45e0-8cf3-a12c31f2564b service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.535422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42939cee-7dc1-45e0-8cf3-a12c31f2564b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.545352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5e280-4cad-4622-b982-0cf30fd223b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42e9d9aa7c64c2cb78d30c3f5d472fe, user_id=5300c898f29d49b391025581a98dc65d, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:30.551390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42939cee-7dc1-45e0-8cf3-a12c31f2564b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:30.551390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42939cee-7dc1-45e0-8cf3-a12c31f2564b service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:30.551615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5e280-4cad-4622-b982-0cf30fd223b5 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:30.561084 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1034/2072] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:30.649301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1039/2073] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:30 2022] PUT /identity/v3/projects/c42e9d9aa7c64c2cb78d30c3f5d472fe/users/5300c898f29d49b391025581a98dc65d/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:30.662198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb18706-09c7-4a1b-abd8-650d11fc202f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.662682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb18706-09c7-4a1b-abd8-650d11fc202f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.663028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb18706-09c7-4a1b-abd8-650d11fc202f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.696506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-cbb18706-09c7-4a1b-abd8-650d11fc202f None None] MFA Rules not processed for user `5300c898f29d49b391025581a98dc65d`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:30.697841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-cbb18706-09c7-4a1b-abd8-650d11fc202f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:30.730044 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5e280-4cad-4622-b982-0cf30fd223b5 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:30.782093 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1035/2074] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:30.798277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb18706-09c7-4a1b-abd8-650d11fc202f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:30.799522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-cbb18706-09c7-4a1b-abd8-650d11fc202f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:30.810207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5e280-4cad-4622-b982-0cf30fd223b5 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:30.817201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b8886-fa84-4322-b743-f2471968b6a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:30.818222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b8886-fa84-4322-b743-f2471968b6a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.818222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b8886-fa84-4322-b743-f2471968b6a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.818502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b8886-fa84-4322-b743-f2471968b6a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.819723 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb18706-09c7-4a1b-abd8-650d11fc202f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:30.821324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-2a8b8886-fa84-4322-b743-f2471968b6a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:30.849742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afc880-48a1-4ed7-897d-7e12432b712d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:30.849742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc880-48a1-4ed7-897d-7e12432b712d service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:30.849742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc880-48a1-4ed7-897d-7e12432b712d service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:30.849742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc880-48a1-4ed7-897d-7e12432b712d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:30.851635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afc880-48a1-4ed7-897d-7e12432b712d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:30.851635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afc880-48a1-4ed7-897d-7e12432b712d service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:30.851635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1036/2075] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:30.908366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b8886-fa84-4322-b743-f2471968b6a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:30.910500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b8886-fa84-4322-b743-f2471968b6a5 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:30.921151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1040/2076] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:18:31.119776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afc880-48a1-4ed7-897d-7e12432b712d service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:31.121347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a8afc880-48a1-4ed7-897d-7e12432b712d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:31.177940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:31.232576 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afc880-48a1-4ed7-897d-7e12432b712d service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:31.239036 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:31.239683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:31.240019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:31.240271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] PATH_INFO: `/v3/projects/744e6b04794f4a968700055d47f1d113` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:31.241396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744e6b04794f4a968700055d47f1d113)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:31.243429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:31.387218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744e6b04794f4a968700055d47f1d113', 'request_id': 'req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:31.506226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744e6b04794f4a968700055d47f1d113', 'request_id': 'req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:31.513546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744e6b04794f4a968700055d47f1d113', 'request_id': 'req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:31.525595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] The token cache is being invalidate because project 744e6b04794f4a968700055d47f1d113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:31.526070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:31.526746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:31.528529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1037/2077] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:31 2022] DELETE /identity/v3/projects/744e6b04794f4a968700055d47f1d113 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:31.532616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b8886-fa84-4322-b743-f2471968b6a5 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:31.543872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b8886-fa84-4322-b743-f2471968b6a5 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:31.603370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8741bb-95da-4f49-a259-05f60284183a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:31.604068 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8741bb-95da-4f49-a259-05f60284183a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:31.604347 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8741bb-95da-4f49-a259-05f60284183a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:31.604616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8741bb-95da-4f49-a259-05f60284183a admin admin] PATH_INFO: `/v3/users/afe2ae2f0c404a258a9e0523b22d6c58` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:31.605732 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8741bb-95da-4f49-a259-05f60284183a admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe2ae2f0c404a258a9e0523b22d6c58)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:31.607673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8741bb-95da-4f49-a259-05f60284183a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:31.816216 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:31.843672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-0a8741bb-95da-4f49-a259-05f60284183a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe2ae2f0c404a258a9e0523b22d6c58'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:31.843672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-0a8741bb-95da-4f49-a259-05f60284183a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe2ae2f0c404a258a9e0523b22d6c58'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:31.844812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-0a8741bb-95da-4f49-a259-05f60284183a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe2ae2f0c404a258a9e0523b22d6c58'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:31.870765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-0a8741bb-95da-4f49-a259-05f60284183a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe2ae2f0c404a258a9e0523b22d6c58'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:31.995476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:31.997183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:32.012143 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacadc6-4d31-419f-9f41-bf0dce35f7b4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:32.019301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:32.021208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:32.021500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:32.021809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] PATH_INFO: `/v3/users/2847ca90f7c84d7b83b9bdc0d8bef117` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:32.022259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-0a8741bb-95da-4f49-a259-05f60284183a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe2ae2f0c404a258a9e0523b22d6c58'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:32.023751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2847ca90f7c84d7b83b9bdc0d8bef117)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:32.026752 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:32.055341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1041/2078] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:31 2022] DELETE /identity/v3/users/afe2ae2f0c404a258a9e0523b22d6c58 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:32.312924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2847ca90f7c84d7b83b9bdc0d8bef117'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:32.313664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2847ca90f7c84d7b83b9bdc0d8bef117'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:32.325717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2847ca90f7c84d7b83b9bdc0d8bef117'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:32.327031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2847ca90f7c84d7b83b9bdc0d8bef117'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:32.342013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2847ca90f7c84d7b83b9bdc0d8bef117'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:32.403465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:32.411520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1038/2079] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:31 2022] DELETE /identity/v3/users/2847ca90f7c84d7b83b9bdc0d8bef117 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:32.413548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2083a5c-ad2b-4010-9a3d-31a52fcb1551 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:32.413837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2083a5c-ad2b-4010-9a3d-31a52fcb1551 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:32.414127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2083a5c-ad2b-4010-9a3d-31a52fcb1551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:32.433288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b2083a5c-ad2b-4010-9a3d-31a52fcb1551 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:32.434581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b2083a5c-ad2b-4010-9a3d-31a52fcb1551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:32.502555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1042/2080] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:32.512913 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:32.514631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:32.571681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77020e10-9e67-4eba-aa68-d03ad447ba24 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:32.575841 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97587040-ab7d-4cac-b61e-1d129f5f6231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:32.576498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587040-ab7d-4cac-b61e-1d129f5f6231 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:32.576776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587040-ab7d-4cac-b61e-1d129f5f6231 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:32.577045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587040-ab7d-4cac-b61e-1d129f5f6231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:32.583819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2083a5c-ad2b-4010-9a3d-31a52fcb1551 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:32.586215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b2083a5c-ad2b-4010-9a3d-31a52fcb1551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:32.588209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97587040-ab7d-4cac-b61e-1d129f5f6231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:32.589692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97587040-ab7d-4cac-b61e-1d129f5f6231 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:32.600755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2083a5c-ad2b-4010-9a3d-31a52fcb1551 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:32.601326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1039/2081] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:32.606159 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:32.606890 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:32.607339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:32.607613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] PATH_INFO: `/v3/projects/fe143ef77adb48df960217e875e13cba` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:32.609663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe143ef77adb48df960217e875e13cba)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:32.611732 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:32.726437 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe143ef77adb48df960217e875e13cba', 'request_id': 'req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:32.787901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe143ef77adb48df960217e875e13cba', 'request_id': 'req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:32.806203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe143ef77adb48df960217e875e13cba', 'request_id': 'req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:32.828713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] The token cache is being invalidate because project fe143ef77adb48df960217e875e13cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:32.829001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:32.830003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9f7ef49e-b9bb-41a3-8fdc-6c5d075b8c86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:32.832308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1043/2082] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:32 2022] DELETE /identity/v3/projects/fe143ef77adb48df960217e875e13cba => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:32.836975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8aee1-61c3-4183-8a53-bc3cc5298e72 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:32.841370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8aee1-61c3-4183-8a53-bc3cc5298e72 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:32.841370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8aee1-61c3-4183-8a53-bc3cc5298e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:32.870312 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:32.871573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-62a8aee1-61c3-4183-8a53-bc3cc5298e72 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:32.880537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-62a8aee1-61c3-4183-8a53-bc3cc5298e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:32.952105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1040/2083] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:32.961400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef14730-a6cd-42a8-a1da-8ccae3d9db4b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:32.961681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef14730-a6cd-42a8-a1da-8ccae3d9db4b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:32.961957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef14730-a6cd-42a8-a1da-8ccae3d9db4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:32.982338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0ef14730-a6cd-42a8-a1da-8ccae3d9db4b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:32.983570 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0ef14730-a6cd-42a8-a1da-8ccae3d9db4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:32.992774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1044/2084] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:32.997154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8aee1-61c3-4183-8a53-bc3cc5298e72 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:33.007790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8aee1-61c3-4183-8a53-bc3cc5298e72 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:33.012478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb94d7-78f5-4595-9fac-27b342c37cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:33.019258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb94d7-78f5-4595-9fac-27b342c37cba admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:33.019258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb94d7-78f5-4595-9fac-27b342c37cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:33.019258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb94d7-78f5-4595-9fac-27b342c37cba admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:33.019258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb94d7-78f5-4595-9fac-27b342c37cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:33.019258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb94d7-78f5-4595-9fac-27b342c37cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:33.019258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb94d7-78f5-4595-9fac-27b342c37cba admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:33.029075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1041/2085] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:18:33.033710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef14730-a6cd-42a8-a1da-8ccae3d9db4b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:33.043036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef14730-a6cd-42a8-a1da-8ccae3d9db4b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:33.047779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafb8e9-1d11-4dcb-9272-f7294049e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:33.048409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafb8e9-1d11-4dcb-9272-f7294049e3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:33.048690 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafb8e9-1d11-4dcb-9272-f7294049e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:33.048966 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafb8e9-1d11-4dcb-9272-f7294049e3d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:33.049601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafb8e9-1d11-4dcb-9272-f7294049e3d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:33.052094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafb8e9-1d11-4dcb-9272-f7294049e3d2 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:33.172420 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb94d7-78f5-4595-9fac-27b342c37cba admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:33.175852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-59fb94d7-78f5-4595-9fac-27b342c37cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:33.201003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb94d7-78f5-4595-9fac-27b342c37cba admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:33.204483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1045/2086] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:33 2022] POST /identity/v3/projects => generated 409 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:33.209159 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafb8e9-1d11-4dcb-9272-f7294049e3d2 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:33.212438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:33.213096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:33.213565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:33.214000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] PATH_INFO: `/v3/projects/c9bf7b3b638c48a1a302e6fad0be4b47` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:33.215496 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9bf7b3b638c48a1a302e6fad0be4b47)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:33.219335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:33.287302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafb8e9-1d11-4dcb-9272-f7294049e3d2 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:33.296297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352265c9-8b22-4266-b056-7674e338a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:33.302132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352265c9-8b22-4266-b056-7674e338a1ca admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:33.302432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352265c9-8b22-4266-b056-7674e338a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:33.302714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352265c9-8b22-4266-b056-7674e338a1ca admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:33.303599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352265c9-8b22-4266-b056-7674e338a1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:33.305751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352265c9-8b22-4266-b056-7674e338a1ca admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:33.377872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9bf7b3b638c48a1a302e6fad0be4b47', 'request_id': 'req-b265db71-0371-4012-96b2-87fc82e1721d'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:33.391647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1046/2087] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:33 2022] POST /identity/v3/users => generated 305 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:33.396371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352265c9-8b22-4266-b056-7674e338a1ca admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:33.406671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352265c9-8b22-4266-b056-7674e338a1ca admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:33.466928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9bf7b3b638c48a1a302e6fad0be4b47', 'request_id': 'req-b265db71-0371-4012-96b2-87fc82e1721d'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:33.475663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b29d0-c5c0-4865-93c8-9430c9e138b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:33.476518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b29d0-c5c0-4865-93c8-9430c9e138b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:33.476840 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b29d0-c5c0-4865-93c8-9430c9e138b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:33.478834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b29d0-c5c0-4865-93c8-9430c9e138b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:33.478834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b29d0-c5c0-4865-93c8-9430c9e138b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:33.479803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b29d0-c5c0-4865-93c8-9430c9e138b0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:33.479976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:33.481056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9bf7b3b638c48a1a302e6fad0be4b47', 'request_id': 'req-b265db71-0371-4012-96b2-87fc82e1721d'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:33.493022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1047/2088] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:18:33.494980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] The token cache is being invalidate because project c9bf7b3b638c48a1a302e6fad0be4b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:33.496826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:33.496826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:33.497191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b29d0-c5c0-4865-93c8-9430c9e138b0 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:33.497605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1042/2089] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:33 2022] DELETE /identity/v3/projects/c9bf7b3b638c48a1a302e6fad0be4b47 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:33.501525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:33.501718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-294b29d0-c5c0-4865-93c8-9430c9e138b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:33.502894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:33.515505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b29d0-c5c0-4865-93c8-9430c9e138b0 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:33.517800 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265db71-0371-4012-96b2-87fc82e1721d admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:33.521591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe2b5b-0c21-4e0c-9006-7579f6b35ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:33.522968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe2b5b-0c21-4e0c-9006-7579f6b35ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:33.524185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe2b5b-0c21-4e0c-9006-7579f6b35ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:33.524330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:33.524547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fe2b5b-0c21-4e0c-9006-7579f6b35ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:33.525055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:33.525335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:33.525435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe2b5b-0c21-4e0c-9006-7579f6b35ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:33.525608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] PATH_INFO: `/v3/users/82c3247921db452784dab59a4b8b9ed3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:33.526930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c3247921db452784dab59a4b8b9ed3)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:33.527734 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fe2b5b-0c21-4e0c-9006-7579f6b35ab9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:33.528929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:33.544037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1048/2090] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:18:33.549002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe2b5b-0c21-4e0c-9006-7579f6b35ab9 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:33.561546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fe2b5b-0c21-4e0c-9006-7579f6b35ab9 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:33.567226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f300528-717e-450b-b9dc-32c3ead06a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:33.571553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300528-717e-450b-b9dc-32c3ead06a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:33.571553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300528-717e-450b-b9dc-32c3ead06a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:33.571553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f300528-717e-450b-b9dc-32c3ead06a2e admin admin] PATH_INFO: `/v3/projects/47dfdab26853473fbf8503f7048ef7de/users/492a65ceeac949ca9b0f4f80954b7bc3/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:33.587464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f300528-717e-450b-b9dc-32c3ead06a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47dfdab26853473fbf8503f7048ef7de, user_id=492a65ceeac949ca9b0f4f80954b7bc3, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:33.590195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f300528-717e-450b-b9dc-32c3ead06a2e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:33.594953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:33.731001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1049/2091] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:33 2022] PUT /identity/v3/projects/47dfdab26853473fbf8503f7048ef7de/users/492a65ceeac949ca9b0f4f80954b7bc3/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:33.739280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c3247921db452784dab59a4b8b9ed3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:33.739969 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c3247921db452784dab59a4b8b9ed3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:33.742037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c96ed-7b37-4cb2-92df-fbdbbba7bc07 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:33.742395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c96ed-7b37-4cb2-92df-fbdbbba7bc07 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:33.742682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c96ed-7b37-4cb2-92df-fbdbbba7bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:33.747524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c3247921db452784dab59a4b8b9ed3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:33.748209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c3247921db452784dab59a4b8b9ed3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:33.762630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c3247921db452784dab59a4b8b9ed3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:33.773563 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-575c96ed-7b37-4cb2-92df-fbdbbba7bc07 None None] MFA Rules not processed for user `492a65ceeac949ca9b0f4f80954b7bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:33.774832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-575c96ed-7b37-4cb2-92df-fbdbbba7bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:33.845209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1050/2092] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:33 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:33.850258 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c96ed-7b37-4cb2-92df-fbdbbba7bc07 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:33.851598 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-575c96ed-7b37-4cb2-92df-fbdbbba7bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:33.867696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1043/2093] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:33 2022] DELETE /identity/v3/users/82c3247921db452784dab59a4b8b9ed3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:33.925384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c96ed-7b37-4cb2-92df-fbdbbba7bc07 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:33.989480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e0220-1f34-472d-9552-d97eed4209b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:33.990094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e0220-1f34-472d-9552-d97eed4209b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:33.990374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e0220-1f34-472d-9552-d97eed4209b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:33.990647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e0220-1f34-472d-9552-d97eed4209b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:33.991278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e0220-1f34-472d-9552-d97eed4209b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:33.993247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e0220-1f34-472d-9552-d97eed4209b2 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:34.145062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1051/2094] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:33 2022] POST /identity/v3/projects => generated 407 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:34.149784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:34.161243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7ba66-3c38-42bb-a0e9-435596f3aaa8 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:34.261076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7fb66-ed50-4bdd-8107-7c8d92c37501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:34.262609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7fb66-ed50-4bdd-8107-7c8d92c37501 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:34.263371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7fb66-ed50-4bdd-8107-7c8d92c37501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:34.263995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7fb66-ed50-4bdd-8107-7c8d92c37501 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:34.265142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7fb66-ed50-4bdd-8107-7c8d92c37501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:34.269952 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7fb66-ed50-4bdd-8107-7c8d92c37501 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:34.364325 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1044/2095] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:34 2022] POST /identity/v3/users => generated 310 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:34.366252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e0220-1f34-472d-9552-d97eed4209b2 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:34.376354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7fb66-ed50-4bdd-8107-7c8d92c37501 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:34.387433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-51f7fb66-ed50-4bdd-8107-7c8d92c37501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:34.388535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e0220-1f34-472d-9552-d97eed4209b2 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:34.415372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7fb66-ed50-4bdd-8107-7c8d92c37501 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:34.418370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9723bd-be87-4406-8437-eb7dc470437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:34.427408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:34.429456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9723bd-be87-4406-8437-eb7dc470437d admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:34.429456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9723bd-be87-4406-8437-eb7dc470437d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:34.429456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9723bd-be87-4406-8437-eb7dc470437d admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:34.430026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:34.430026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:34.430026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] PATH_INFO: `/v3/projects/93e7000ad2c94327bf242b843dfa6d1f` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:34.431331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e7000ad2c94327bf242b843dfa6d1f)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:34.432521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9723bd-be87-4406-8437-eb7dc470437d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:34.434487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9723bd-be87-4406-8437-eb7dc470437d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:34.445430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:34.448312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1052/2096] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:34.449401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9723bd-be87-4406-8437-eb7dc470437d admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:34.452554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6e9723bd-be87-4406-8437-eb7dc470437d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:34.494533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9723bd-be87-4406-8437-eb7dc470437d admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:34.506648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:34.507226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:34.507505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:34.507775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] PATH_INFO: `/v3/users/5300c898f29d49b391025581a98dc65d` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:34.509583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5300c898f29d49b391025581a98dc65d)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:34.511550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:34.564082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e7000ad2c94327bf242b843dfa6d1f', 'request_id': 'req-7e72b45d-9e94-4b65-84f2-d3947ddf1856'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:34.735471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e7000ad2c94327bf242b843dfa6d1f', 'request_id': 'req-7e72b45d-9e94-4b65-84f2-d3947ddf1856'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:34.744004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e7000ad2c94327bf242b843dfa6d1f', 'request_id': 'req-7e72b45d-9e94-4b65-84f2-d3947ddf1856'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:34.755004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] The token cache is being invalidate because project 93e7000ad2c94327bf242b843dfa6d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:34.755310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:34.755959 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:34.761375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1045/2097] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:34 2022] DELETE /identity/v3/projects/93e7000ad2c94327bf242b843dfa6d1f => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:34.761375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:34.761375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:34.834473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72b45d-9e94-4b65-84f2-d3947ddf1856 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:34.840374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aaaa2-98b6-4dec-b6a9-16c6064e757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:34.841099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aaaa2-98b6-4dec-b6a9-16c6064e757e admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:34.841382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aaaa2-98b6-4dec-b6a9-16c6064e757e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:34.841662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aaaa2-98b6-4dec-b6a9-16c6064e757e admin admin] PATH_INFO: `/v3/projects/8fb9b2e034dc47bb8d7ad28ff95c2c67/users/29b6f530c04245fb98e7d95e5aa082bd/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:34.857542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aaaa2-98b6-4dec-b6a9-16c6064e757e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb9b2e034dc47bb8d7ad28ff95c2c67, user_id=29b6f530c04245fb98e7d95e5aa082bd, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:34.860727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aaaa2-98b6-4dec-b6a9-16c6064e757e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:34.875827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5300c898f29d49b391025581a98dc65d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:34.876515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5300c898f29d49b391025581a98dc65d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:34.877130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5300c898f29d49b391025581a98dc65d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:34.889761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5300c898f29d49b391025581a98dc65d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:35.066103 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5300c898f29d49b391025581a98dc65d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:35.069681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1046/2098] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:34 2022] PUT /identity/v3/projects/8fb9b2e034dc47bb8d7ad28ff95c2c67/users/29b6f530c04245fb98e7d95e5aa082bd/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:35.072948 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a06d-5897-42a8-a194-4d0617edec53 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.072948 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a06d-5897-42a8-a194-4d0617edec53 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.072948 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1a06d-5897-42a8-a194-4d0617edec53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.086318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1053/2099] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:34 2022] DELETE /identity/v3/users/5300c898f29d49b391025581a98dc65d => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:35.086318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:35.088390 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:35.094142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-faf1a06d-5897-42a8-a194-4d0617edec53 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:35.095062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-faf1a06d-5897-42a8-a194-4d0617edec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:35.152021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:35.164106 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa8c11-f14c-4d38-a787-ffb0c7e7593c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:35.180213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1047/2100] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:35.180213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cce9e9-392c-4354-a21b-28cc1adabe6e None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.180213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cce9e9-392c-4354-a21b-28cc1adabe6e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.180213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cce9e9-392c-4354-a21b-28cc1adabe6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.190166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-38cce9e9-392c-4354-a21b-28cc1adabe6e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:35.191448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-38cce9e9-392c-4354-a21b-28cc1adabe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:35.193276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6a966-644c-4f4b-aa00-468ca25399a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:35.194501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6a966-644c-4f4b-aa00-468ca25399a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.195158 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6a966-644c-4f4b-aa00-468ca25399a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.195746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6a966-644c-4f4b-aa00-468ca25399a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.196714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6a966-644c-4f4b-aa00-468ca25399a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:35.199268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6a966-644c-4f4b-aa00-468ca25399a5 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:35.201972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1048/2101] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:35.220148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1054/2102] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:35.231064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cce9e9-392c-4354-a21b-28cc1adabe6e None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:35.232622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6a966-644c-4f4b-aa00-468ca25399a5 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:35.237096 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-80d6a966-644c-4f4b-aa00-468ca25399a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:35.243125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cce9e9-392c-4354-a21b-28cc1adabe6e None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:35.260349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1996b1f-7c1c-4fe0-a49d-f5320dc3f665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:35.260349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996b1f-7c1c-4fe0-a49d-f5320dc3f665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.260349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996b1f-7c1c-4fe0-a49d-f5320dc3f665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.260349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996b1f-7c1c-4fe0-a49d-f5320dc3f665 admin admin] PATH_INFO: `/v3/projects/8fb9b2e034dc47bb8d7ad28ff95c2c67/users/29b6f530c04245fb98e7d95e5aa082bd/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.260742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1996b1f-7c1c-4fe0-a49d-f5320dc3f665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb9b2e034dc47bb8d7ad28ff95c2c67, user_id=29b6f530c04245fb98e7d95e5aa082bd, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:35.260742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1996b1f-7c1c-4fe0-a49d-f5320dc3f665 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:35.280964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1049/2103] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:35 2022] PUT /identity/v3/projects/8fb9b2e034dc47bb8d7ad28ff95c2c67/users/29b6f530c04245fb98e7d95e5aa082bd/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:35.280964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775100-d097-41e9-a462-f09ea57a3e03 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.280964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775100-d097-41e9-a462-f09ea57a3e03 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.280964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36775100-d097-41e9-a462-f09ea57a3e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.302630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6a966-644c-4f4b-aa00-468ca25399a5 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:35.310038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-36775100-d097-41e9-a462-f09ea57a3e03 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:35.313763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-36775100-d097-41e9-a462-f09ea57a3e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:35.334208 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:35.363590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c8568-f593-4d78-9bef-daa4f980d682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:35.364283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c8568-f593-4d78-9bef-daa4f980d682 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.364569 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c8568-f593-4d78-9bef-daa4f980d682 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.364838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c8568-f593-4d78-9bef-daa4f980d682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.388566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1050/2104] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:35.389846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13652b2-3641-4fa7-b2fe-4a565a809d6e None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.390035 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13652b2-3641-4fa7-b2fe-4a565a809d6e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.390455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13652b2-3641-4fa7-b2fe-4a565a809d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.421807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b13652b2-3641-4fa7-b2fe-4a565a809d6e None None] MFA Rules not processed for user `29b6f530c04245fb98e7d95e5aa082bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:35.423028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b13652b2-3641-4fa7-b2fe-4a565a809d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:35.439873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c8568-f593-4d78-9bef-daa4f980d682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:35.441636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c8568-f593-4d78-9bef-daa4f980d682 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:35.453131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1055/2105] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:35.453912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c8568-f593-4d78-9bef-daa4f980d682 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:35.464591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c8568-f593-4d78-9bef-daa4f980d682 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:35.470814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f29cd-b0e2-4948-a0ee-b58c41ac165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:35.471442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f29cd-b0e2-4948-a0ee-b58c41ac165d admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.472391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f29cd-b0e2-4948-a0ee-b58c41ac165d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.472669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f29cd-b0e2-4948-a0ee-b58c41ac165d admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.473327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f29cd-b0e2-4948-a0ee-b58c41ac165d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:35.473636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f29cd-b0e2-4948-a0ee-b58c41ac165d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:35.475335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f29cd-b0e2-4948-a0ee-b58c41ac165d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:35.494894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1056/2106] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:18:35.504969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f29cd-b0e2-4948-a0ee-b58c41ac165d admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:35.509845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f29cd-b0e2-4948-a0ee-b58c41ac165d admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:35.517265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64e0fd-5b59-4f14-92da-5fd8beaaaa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:35.517695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64e0fd-5b59-4f14-92da-5fd8beaaaa9b admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.517984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64e0fd-5b59-4f14-92da-5fd8beaaaa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.518259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64e0fd-5b59-4f14-92da-5fd8beaaaa9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.519262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64e0fd-5b59-4f14-92da-5fd8beaaaa9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:35.522284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1051/2107] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:35 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:35.522669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64e0fd-5b59-4f14-92da-5fd8beaaaa9b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:35.535666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13652b2-3641-4fa7-b2fe-4a565a809d6e None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:35.538251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b13652b2-3641-4fa7-b2fe-4a565a809d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:35.615837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13652b2-3641-4fa7-b2fe-4a565a809d6e None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:35.620344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299d11-e48d-43e6-be28-b841106c001c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:35.621459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299d11-e48d-43e6-be28-b841106c001c service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.621459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299d11-e48d-43e6-be28-b841106c001c service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.621663 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299d11-e48d-43e6-be28-b841106c001c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.633399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f299d11-e48d-43e6-be28-b841106c001c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:35.635295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f299d11-e48d-43e6-be28-b841106c001c service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:35.649642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1057/2108] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:35 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:35.653752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64e0fd-5b59-4f14-92da-5fd8beaaaa9b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:35.660887 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1052/2109] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:35 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:35.713882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:35.763357 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64e0fd-5b59-4f14-92da-5fd8beaaaa9b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:35.779737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f14b83-74ec-4411-a420-821d4cc19906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:35.787114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14b83-74ec-4411-a420-821d4cc19906 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.787114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14b83-74ec-4411-a420-821d4cc19906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.787114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f14b83-74ec-4411-a420-821d4cc19906 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.787411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:INSERT=5,keystone:DELETE=8,keystone:SELECT=87 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:35.787496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f14b83-74ec-4411-a420-821d4cc19906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:35.787496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f14b83-74ec-4411-a420-821d4cc19906 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:35.973876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1058/2110] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:35 2022] POST /identity/v3/users => generated 287 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:35.975016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299d11-e48d-43e6-be28-b841106c001c service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:35.985371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299d11-e48d-43e6-be28-b841106c001c service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:35.990543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85329500-31e0-4858-8c22-5461195a4d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:35.991262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85329500-31e0-4858-8c22-5461195a4d9b admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:35.991541 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85329500-31e0-4858-8c22-5461195a4d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:35.991810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85329500-31e0-4858-8c22-5461195a4d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:35.992477 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85329500-31e0-4858-8c22-5461195a4d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:35.994057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85329500-31e0-4858-8c22-5461195a4d9b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:36.010877 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1053/2111] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:36.014844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f14b83-74ec-4411-a420-821d4cc19906 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:36.015064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85329500-31e0-4858-8c22-5461195a4d9b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:36.016842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c7f14b83-74ec-4411-a420-821d4cc19906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:36.028111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85329500-31e0-4858-8c22-5461195a4d9b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:36.033804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b21fe-b293-458e-a85d-20ac4f2ef9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:36.035422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b21fe-b293-458e-a85d-20ac4f2ef9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.035422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b21fe-b293-458e-a85d-20ac4f2ef9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.035899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b21fe-b293-458e-a85d-20ac4f2ef9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.037150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b21fe-b293-458e-a85d-20ac4f2ef9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:36.040818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b21fe-b293-458e-a85d-20ac4f2ef9e2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:36.040953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f14b83-74ec-4411-a420-821d4cc19906 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:36.054403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1054/2112] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:36.054587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:36.054587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.054587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.054587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] PATH_INFO: `/v3/projects/c42e9d9aa7c64c2cb78d30c3f5d472fe` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.054944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42e9d9aa7c64c2cb78d30c3f5d472fe)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:36.055595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b21fe-b293-458e-a85d-20ac4f2ef9e2 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:36.055744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:36.065677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b21fe-b293-458e-a85d-20ac4f2ef9e2 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:36.071450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953e1af-0240-4a8c-90cb-169087beb460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:36.072284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953e1af-0240-4a8c-90cb-169087beb460 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.072602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953e1af-0240-4a8c-90cb-169087beb460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.072874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953e1af-0240-4a8c-90cb-169087beb460 admin admin] PATH_INFO: `/v3/projects/bfa2dfaf8f6a4258a69ae7e26330bb13/users/5810898fa93a4462b84308b2cc9efc3b/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.092919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953e1af-0240-4a8c-90cb-169087beb460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa2dfaf8f6a4258a69ae7e26330bb13, user_id=5810898fa93a4462b84308b2cc9efc3b, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:36.094394 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953e1af-0240-4a8c-90cb-169087beb460 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:36.246076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1055/2113] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:36 2022] PUT /identity/v3/projects/bfa2dfaf8f6a4258a69ae7e26330bb13/users/5810898fa93a4462b84308b2cc9efc3b/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:36.257478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4fe54-cd6c-4e93-9d99-88a646d58ff1 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.257830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4fe54-cd6c-4e93-9d99-88a646d58ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.258037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4fe54-cd6c-4e93-9d99-88a646d58ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.261477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42e9d9aa7c64c2cb78d30c3f5d472fe', 'request_id': 'req-9ebf4528-e614-4167-919c-08205471f3fe'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:36.300584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-4ee4fe54-cd6c-4e93-9d99-88a646d58ff1 None None] MFA Rules not processed for user `5810898fa93a4462b84308b2cc9efc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:36.301921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4ee4fe54-cd6c-4e93-9d99-88a646d58ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:36.329666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42e9d9aa7c64c2cb78d30c3f5d472fe', 'request_id': 'req-9ebf4528-e614-4167-919c-08205471f3fe'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:36.342603 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42e9d9aa7c64c2cb78d30c3f5d472fe', 'request_id': 'req-9ebf4528-e614-4167-919c-08205471f3fe'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:36.367179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] The token cache is being invalidate because project c42e9d9aa7c64c2cb78d30c3f5d472fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:36.368977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:36.370701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:36.374658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1059/2114] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:36 2022] DELETE /identity/v3/projects/c42e9d9aa7c64c2cb78d30c3f5d472fe => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:36.380727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:36.382177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:36.383901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1056/2115] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:36.385559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71949463-a959-4e53-af7e-2aa4f034ac0a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.385918 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71949463-a959-4e53-af7e-2aa4f034ac0a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.386699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71949463-a959-4e53-af7e-2aa4f034ac0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.414155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-71949463-a959-4e53-af7e-2aa4f034ac0a None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:36.415781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-71949463-a959-4e53-af7e-2aa4f034ac0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:36.495404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf4528-e614-4167-919c-08205471f3fe admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:36.499180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a92fb-396a-4731-be90-729067eb6a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:36.499727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a92fb-396a-4731-be90-729067eb6a3e service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.500005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a92fb-396a-4731-be90-729067eb6a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.500314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a92fb-396a-4731-be90-729067eb6a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.501295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1057/2116] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:36.502281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71949463-a959-4e53-af7e-2aa4f034ac0a None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:36.502412 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d20a92fb-396a-4731-be90-729067eb6a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:36.504338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-71949463-a959-4e53-af7e-2aa4f034ac0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:36.521853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71949463-a959-4e53-af7e-2aa4f034ac0a None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:36.525353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:36.525845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd08ed5-e960-4625-bc7b-a13251dcb41a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:36.526587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd08ed5-e960-4625-bc7b-a13251dcb41a service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.526789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd08ed5-e960-4625-bc7b-a13251dcb41a service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.527065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd08ed5-e960-4625-bc7b-a13251dcb41a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.528821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fcd08ed5-e960-4625-bc7b-a13251dcb41a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:36.540251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd08ed5-e960-4625-bc7b-a13251dcb41a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:36.541839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd08ed5-e960-4625-bc7b-a13251dcb41a service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:36.553807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:36.554050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1058/2117] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:36.556337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea52e9-ff38-4ccd-bf86-a30618226058 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.562066 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea52e9-ff38-4ccd-bf86-a30618226058 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.562066 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea52e9-ff38-4ccd-bf86-a30618226058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.576360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a92fb-396a-4731-be90-729067eb6a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:36.577759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a92fb-396a-4731-be90-729067eb6a3e service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:36.589195 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0eea52e9-ff38-4ccd-bf86-a30618226058 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:36.589879 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1060/2118] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:36 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:36.590573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0eea52e9-ff38-4ccd-bf86-a30618226058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:36.590749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a92fb-396a-4731-be90-729067eb6a3e service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:36.591957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d20a92fb-396a-4731-be90-729067eb6a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:36.604450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1059/2119] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:36.605553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea52e9-ff38-4ccd-bf86-a30618226058 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:36.607812 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a92fb-396a-4731-be90-729067eb6a3e service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:36.615461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b483d2-ae11-470f-8b05-2aa451b5382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:36.616511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b483d2-ae11-470f-8b05-2aa451b5382e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.617191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b483d2-ae11-470f-8b05-2aa451b5382e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.617999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b483d2-ae11-470f-8b05-2aa451b5382e admin admin] PATH_INFO: `/v3/users/5810898fa93a4462b84308b2cc9efc3b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.619456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b483d2-ae11-470f-8b05-2aa451b5382e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5810898fa93a4462b84308b2cc9efc3b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:36.620193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea52e9-ff38-4ccd-bf86-a30618226058 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:36.621615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b483d2-ae11-470f-8b05-2aa451b5382e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:36.626532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323421-2eb7-4507-8e7b-0e600f6ae3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:36.628896 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323421-2eb7-4507-8e7b-0e600f6ae3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.629255 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323421-2eb7-4507-8e7b-0e600f6ae3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.629604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323421-2eb7-4507-8e7b-0e600f6ae3a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.630370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb323421-2eb7-4507-8e7b-0e600f6ae3a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:36.630802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb323421-2eb7-4507-8e7b-0e600f6ae3a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:36.632548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb323421-2eb7-4507-8e7b-0e600f6ae3a1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:36.650682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1060/2120] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:18:36.656405 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323421-2eb7-4507-8e7b-0e600f6ae3a1 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:36.667157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323421-2eb7-4507-8e7b-0e600f6ae3a1 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:36.672692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5408dba-1485-45c5-9ea6-fbd8f37f2b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:36.673445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5408dba-1485-45c5-9ea6-fbd8f37f2b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.673732 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5408dba-1485-45c5-9ea6-fbd8f37f2b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.674013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5408dba-1485-45c5-9ea6-fbd8f37f2b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.675393 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5408dba-1485-45c5-9ea6-fbd8f37f2b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:36.677651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5408dba-1485-45c5-9ea6-fbd8f37f2b82 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:36.771550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:36.778582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1061/2121] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:36 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:36.783162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5408dba-1485-45c5-9ea6-fbd8f37f2b82 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:36.842556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-e7b483d2-ae11-470f-8b05-2aa451b5382e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5810898fa93a4462b84308b2cc9efc3b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:36.843540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-e7b483d2-ae11-470f-8b05-2aa451b5382e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5810898fa93a4462b84308b2cc9efc3b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:36.844506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-e7b483d2-ae11-470f-8b05-2aa451b5382e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5810898fa93a4462b84308b2cc9efc3b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:36.852590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5408dba-1485-45c5-9ea6-fbd8f37f2b82 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:36.860321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66989f-c328-4961-9a3b-9da444a712f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:36.864862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66989f-c328-4961-9a3b-9da444a712f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:36.864862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66989f-c328-4961-9a3b-9da444a712f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:36.864862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66989f-c328-4961-9a3b-9da444a712f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:36.864862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66989f-c328-4961-9a3b-9da444a712f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:36.865659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-e7b483d2-ae11-470f-8b05-2aa451b5382e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5810898fa93a4462b84308b2cc9efc3b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:36.867811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66989f-c328-4961-9a3b-9da444a712f6 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:36.873123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:37.004218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-e7b483d2-ae11-470f-8b05-2aa451b5382e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5810898fa93a4462b84308b2cc9efc3b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:37.015415 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1062/2122] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:36 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:37.019782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66989f-c328-4961-9a3b-9da444a712f6 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:37.020617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1061/2123] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:36 2022] DELETE /identity/v3/users/5810898fa93a4462b84308b2cc9efc3b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:37.023388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2d66989f-c328-4961-9a3b-9da444a712f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:37.025052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ac5e1-6058-4bea-8a54-62d3c01f2403 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:37.025410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ac5e1-6058-4bea-8a54-62d3c01f2403 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:37.025680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ac5e1-6058-4bea-8a54-62d3c01f2403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:37.038516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66989f-c328-4961-9a3b-9da444a712f6 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:37.046032 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-dd6ac5e1-6058-4bea-8a54-62d3c01f2403 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:37.052532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-dd6ac5e1-6058-4bea-8a54-62d3c01f2403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:37.099303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197e8d2-6480-4fc4-9443-14389459e36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:37.099924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197e8d2-6480-4fc4-9443-14389459e36d admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:37.100207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197e8d2-6480-4fc4-9443-14389459e36d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:37.100527 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197e8d2-6480-4fc4-9443-14389459e36d admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:37.101177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197e8d2-6480-4fc4-9443-14389459e36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:37.102782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b197e8d2-6480-4fc4-9443-14389459e36d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:37.115774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1063/2124] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:37.119725 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197e8d2-6480-4fc4-9443-14389459e36d admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:37.122779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1062/2125] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:37.132626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ac5e1-6058-4bea-8a54-62d3c01f2403 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:37.133114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197e8d2-6480-4fc4-9443-14389459e36d admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:37.135175 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-dd6ac5e1-6058-4bea-8a54-62d3c01f2403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:37.139824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3154f-9fb0-47ab-9572-c42854172bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:37.140494 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3154f-9fb0-47ab-9572-c42854172bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:37.140773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3154f-9fb0-47ab-9572-c42854172bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:37.141087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3154f-9fb0-47ab-9572-c42854172bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:37.141750 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3154f-9fb0-47ab-9572-c42854172bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:37.143495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3154f-9fb0-47ab-9572-c42854172bcc admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:37.149627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:37.157159 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1064/2126] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:37.170273 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3154f-9fb0-47ab-9572-c42854172bcc admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:37.181456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3154f-9fb0-47ab-9572-c42854172bcc admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:37.186423 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f18f-1cca-4afc-b2b6-85a8d2fcf507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:37.187100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f18f-1cca-4afc-b2b6-85a8d2fcf507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:37.187377 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f18f-1cca-4afc-b2b6-85a8d2fcf507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:37.187698 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f18f-1cca-4afc-b2b6-85a8d2fcf507 admin admin] PATH_INFO: `/v3/projects/439687ac6afd4e11852bd9bcdfabc8ad/users/d0eb891ac22a4b0e8ba024f9ae36b7e8/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:37.204610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18f18f-1cca-4afc-b2b6-85a8d2fcf507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=439687ac6afd4e11852bd9bcdfabc8ad, user_id=d0eb891ac22a4b0e8ba024f9ae36b7e8, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:37.207532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18f18f-1cca-4afc-b2b6-85a8d2fcf507 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:37.208860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ac5e1-6058-4bea-8a54-62d3c01f2403 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:37.212656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd2a01-3615-4620-bc43-ee916fd4ff65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:37.213400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd2a01-3615-4620-bc43-ee916fd4ff65 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:37.213683 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd2a01-3615-4620-bc43-ee916fd4ff65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:37.213953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd2a01-3615-4620-bc43-ee916fd4ff65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:37.224548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd2a01-3615-4620-bc43-ee916fd4ff65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:37.226183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd2a01-3615-4620-bc43-ee916fd4ff65 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:37.238162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1063/2127] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:37.261705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:37.343862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1065/2128] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:37 2022] PUT /identity/v3/projects/439687ac6afd4e11852bd9bcdfabc8ad/users/d0eb891ac22a4b0e8ba024f9ae36b7e8/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:37.348679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bbbb4-8bbb-40ab-95db-7d612a6eee47 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:37.348961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bbbb4-8bbb-40ab-95db-7d612a6eee47 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:37.349250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bbbb4-8bbb-40ab-95db-7d612a6eee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:37.384263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-002bbbb4-8bbb-40ab-95db-7d612a6eee47 None None] MFA Rules not processed for user `d0eb891ac22a4b0e8ba024f9ae36b7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:37.385391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-002bbbb4-8bbb-40ab-95db-7d612a6eee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:37.476003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1064/2129] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:37.485580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f18f-1cca-4afc-b2b6-85a8d2fcf507 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:37.491233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3e18f18f-1cca-4afc-b2b6-85a8d2fcf507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:37.573121 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f18f-1cca-4afc-b2b6-85a8d2fcf507 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:37.578221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adfbfd-9d92-4e1b-aa79-dc5d2c00a14d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1684abe7e6aa44a0873e43dfc146c1b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:37.579129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adfbfd-9d92-4e1b-aa79-dc5d2c00a14d service glance] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:37.580158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adfbfd-9d92-4e1b-aa79-dc5d2c00a14d service glance] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:37.580158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adfbfd-9d92-4e1b-aa79-dc5d2c00a14d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:37.591981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adfbfd-9d92-4e1b-aa79-dc5d2c00a14d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:37.593246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adfbfd-9d92-4e1b-aa79-dc5d2c00a14d service glance] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:37.605613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1066/2130] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:37.875564 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bbbb4-8bbb-40ab-95db-7d612a6eee47 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:37.877447 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-002bbbb4-8bbb-40ab-95db-7d612a6eee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:37.952839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bbbb4-8bbb-40ab-95db-7d612a6eee47 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:37.958915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:37.959550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:37.959822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:37.960089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] PATH_INFO: `/v3/projects/bfa2dfaf8f6a4258a69ae7e26330bb13` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:37.961313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa2dfaf8f6a4258a69ae7e26330bb13)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:37.963189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:38.101728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa2dfaf8f6a4258a69ae7e26330bb13', 'request_id': 'req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:38.210568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:38.211844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa2dfaf8f6a4258a69ae7e26330bb13', 'request_id': 'req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:38.218236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa2dfaf8f6a4258a69ae7e26330bb13', 'request_id': 'req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:38.230049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] The token cache is being invalidate because project bfa2dfaf8f6a4258a69ae7e26330bb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:38.230340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:38.231031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:38.232590 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1065/2131] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:37 2022] DELETE /identity/v3/projects/bfa2dfaf8f6a4258a69ae7e26330bb13 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:41.244322 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69fc37-0cf0-4e19-bf50-bb265593c617 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:41.244887 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69fc37-0cf0-4e19-bf50-bb265593c617 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:41.244887 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69fc37-0cf0-4e19-bf50-bb265593c617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:41.264441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-cf69fc37-0cf0-4e19-bf50-bb265593c617 None None] MFA Rules not processed for user `fa4f396fb563434188c1d6c16ec7746b`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:41.265649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-cf69fc37-0cf0-4e19-bf50-bb265593c617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:41.330558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1067/2132] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:44.359996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:44.361747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:44.431621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10b2bf-8aa8-4654-a063-0bd59d2c2e59 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:44.436522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:44.437170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:44.437483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:44.437750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] PATH_INFO: `/v3/users/492a65ceeac949ca9b0f4f80954b7bc3` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:44.438914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=492a65ceeac949ca9b0f4f80954b7bc3)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:44.442086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:44.699754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '492a65ceeac949ca9b0f4f80954b7bc3'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:44.700443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '492a65ceeac949ca9b0f4f80954b7bc3'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:44.701061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '492a65ceeac949ca9b0f4f80954b7bc3'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:44.715230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '492a65ceeac949ca9b0f4f80954b7bc3'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:44.850123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '492a65ceeac949ca9b0f4f80954b7bc3'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:44.852105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:44.870244 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1066/2133] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:44 2022] DELETE /identity/v3/users/492a65ceeac949ca9b0f4f80954b7bc3 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:44.874935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9319-6599-4a0a-8b25-fc5554a24d5d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:44.875417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9319-6599-4a0a-8b25-fc5554a24d5d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:44.875624 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba9319-6599-4a0a-8b25-fc5554a24d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:44.897500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-bcba9319-6599-4a0a-8b25-fc5554a24d5d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:44.898720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bcba9319-6599-4a0a-8b25-fc5554a24d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:44.993213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1068/2134] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:45.001432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:45.003994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:45.079031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd2f7d-fcd1-4577-bad1-056cf045ae1b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:45.083468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1acb9-9c88-4860-b897-4edccf97d54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:45.084084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1acb9-9c88-4860-b897-4edccf97d54e service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:45.084391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1acb9-9c88-4860-b897-4edccf97d54e service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:45.084666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1acb9-9c88-4860-b897-4edccf97d54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:45.094804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1acb9-9c88-4860-b897-4edccf97d54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:45.096261 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1acb9-9c88-4860-b897-4edccf97d54e service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:45.109170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1067/2135] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:45.623335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba9319-6599-4a0a-8b25-fc5554a24d5d None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:45.628923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bcba9319-6599-4a0a-8b25-fc5554a24d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:45.649266 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba9319-6599-4a0a-8b25-fc5554a24d5d None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:45.655840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:45.656514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:45.656796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:45.657086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] PATH_INFO: `/v3/projects/47dfdab26853473fbf8503f7048ef7de` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:45.658206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] RBAC: Authorizing `identity:delete_project(project_id=47dfdab26853473fbf8503f7048ef7de)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:45.660844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:45.691982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:45.811207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47dfdab26853473fbf8503f7048ef7de', 'request_id': 'req-8b72b934-cd90-4727-94c8-64fc323c085f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:45.896161 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47dfdab26853473fbf8503f7048ef7de', 'request_id': 'req-8b72b934-cd90-4727-94c8-64fc323c085f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:45.903784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47dfdab26853473fbf8503f7048ef7de', 'request_id': 'req-8b72b934-cd90-4727-94c8-64fc323c085f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:45.916177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] The token cache is being invalidate because project 47dfdab26853473fbf8503f7048ef7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:45.916721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:45.917265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:45.918764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1069/2136] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:45 2022] DELETE /identity/v3/projects/47dfdab26853473fbf8503f7048ef7de => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:45.922905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1acb9-9c88-4860-b897-4edccf97d54e service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:45.936048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1acb9-9c88-4860-b897-4edccf97d54e service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:45.998679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0e26-8ea4-4617-8f15-716cd5b1bd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:45.999969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0e26-8ea4-4617-8f15-716cd5b1bd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:45.999969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0e26-8ea4-4617-8f15-716cd5b1bd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:45.999969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0e26-8ea4-4617-8f15-716cd5b1bd00 admin admin] PATH_INFO: `/v3/users/29b6f530c04245fb98e7d95e5aa082bd` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:46.000970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba0e26-8ea4-4617-8f15-716cd5b1bd00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b6f530c04245fb98e7d95e5aa082bd)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:46.003539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba0e26-8ea4-4617-8f15-716cd5b1bd00 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:46.207997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-e5ba0e26-8ea4-4617-8f15-716cd5b1bd00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b6f530c04245fb98e7d95e5aa082bd'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:46.209169 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-e5ba0e26-8ea4-4617-8f15-716cd5b1bd00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b6f530c04245fb98e7d95e5aa082bd'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:46.209507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-e5ba0e26-8ea4-4617-8f15-716cd5b1bd00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b6f530c04245fb98e7d95e5aa082bd'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:46.231022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-e5ba0e26-8ea4-4617-8f15-716cd5b1bd00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b6f530c04245fb98e7d95e5aa082bd'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:46.307749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-e5ba0e26-8ea4-4617-8f15-716cd5b1bd00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b6f530c04245fb98e7d95e5aa082bd'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:46.337439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1068/2137] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:45 2022] DELETE /identity/v3/users/29b6f530c04245fb98e7d95e5aa082bd => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:46.880425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:46.881989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:46.900077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72b934-cd90-4727-94c8-64fc323c085f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:46.982632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:46.983272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:46.983552 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:46.983826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] PATH_INFO: `/v3/projects/8fb9b2e034dc47bb8d7ad28ff95c2c67` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:46.984986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb9b2e034dc47bb8d7ad28ff95c2c67)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:46.986880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:47.194713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb9b2e034dc47bb8d7ad28ff95c2c67', 'request_id': 'req-c60715fa-1a2a-41cc-a740-aaeca8b86e01'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:47.300727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb9b2e034dc47bb8d7ad28ff95c2c67', 'request_id': 'req-c60715fa-1a2a-41cc-a740-aaeca8b86e01'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:47.308467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb9b2e034dc47bb8d7ad28ff95c2c67', 'request_id': 'req-c60715fa-1a2a-41cc-a740-aaeca8b86e01'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:47.319960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] The token cache is being invalidate because project 8fb9b2e034dc47bb8d7ad28ff95c2c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:47.320289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:47.321019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c60715fa-1a2a-41cc-a740-aaeca8b86e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:47.322605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1070/2138] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:46 2022] DELETE /identity/v3/projects/8fb9b2e034dc47bb8d7ad28ff95c2c67 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:47.330234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae5723-c50d-46e2-983f-725550425efd None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:47.330234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae5723-c50d-46e2-983f-725550425efd None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:47.330234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae5723-c50d-46e2-983f-725550425efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:47.350328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-7aae5723-c50d-46e2-983f-725550425efd None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:47.351617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7aae5723-c50d-46e2-983f-725550425efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:47.357544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:47.418040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1069/2139] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:47.426632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510af0d7-7a4f-491c-a19c-32d74b746bc0 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:47.433029 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510af0d7-7a4f-491c-a19c-32d74b746bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:47.433029 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510af0d7-7a4f-491c-a19c-32d74b746bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:47.453297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-510af0d7-7a4f-491c-a19c-32d74b746bc0 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:47.454569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-510af0d7-7a4f-491c-a19c-32d74b746bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:47.463991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1071/2140] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:47.468526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae5723-c50d-46e2-983f-725550425efd None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:47.478221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aae5723-c50d-46e2-983f-725550425efd None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:47.486879 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a5ca7-4b98-4b49-bdb2-7eb786aeddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:47.487612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5ca7-4b98-4b49-bdb2-7eb786aeddb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:47.487891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5ca7-4b98-4b49-bdb2-7eb786aeddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:47.488163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a5ca7-4b98-4b49-bdb2-7eb786aeddb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:47.488868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a5ca7-4b98-4b49-bdb2-7eb786aeddb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:47.489172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a5ca7-4b98-4b49-bdb2-7eb786aeddb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:47.490798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a5ca7-4b98-4b49-bdb2-7eb786aeddb9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:47.505409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1070/2141] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:18:47.509709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510af0d7-7a4f-491c-a19c-32d74b746bc0 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:47.520657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510af0d7-7a4f-491c-a19c-32d74b746bc0 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:47.526796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb9e08-a772-4110-8d53-8f6d410e2408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:47.526796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9e08-a772-4110-8d53-8f6d410e2408 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:47.527141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9e08-a772-4110-8d53-8f6d410e2408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:47.527236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb9e08-a772-4110-8d53-8f6d410e2408 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:47.527848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb9e08-a772-4110-8d53-8f6d410e2408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:47.529842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb9e08-a772-4110-8d53-8f6d410e2408 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:47.609650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1072/2142] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:47 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:47.610842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a5ca7-4b98-4b49-bdb2-7eb786aeddb9 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:47.631662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a5ca7-4b98-4b49-bdb2-7eb786aeddb9 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:47.702474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebc197-6ba6-4bdf-8c2e-acf48d3f6767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:47.703540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc197-6ba6-4bdf-8c2e-acf48d3f6767 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:47.704081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc197-6ba6-4bdf-8c2e-acf48d3f6767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:47.704647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebc197-6ba6-4bdf-8c2e-acf48d3f6767 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:47.706501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebc197-6ba6-4bdf-8c2e-acf48d3f6767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:47.708717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebc197-6ba6-4bdf-8c2e-acf48d3f6767 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:47.793141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1071/2143] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:47 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:47.797571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb9e08-a772-4110-8d53-8f6d410e2408 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:47.810962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb9e08-a772-4110-8d53-8f6d410e2408 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:47.816619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae906a-c3e5-4777-824a-f9897d9e405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:47.817860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae906a-c3e5-4777-824a-f9897d9e405a admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:47.817860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae906a-c3e5-4777-824a-f9897d9e405a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:47.817860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae906a-c3e5-4777-824a-f9897d9e405a admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:47.818516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae906a-c3e5-4777-824a-f9897d9e405a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:47.820243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae906a-c3e5-4777-824a-f9897d9e405a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:47.822633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:47.831313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1073/2144] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:47.836140 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebc197-6ba6-4bdf-8c2e-acf48d3f6767 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:47.847985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebc197-6ba6-4bdf-8c2e-acf48d3f6767 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:47.852962 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e4d7f-4d68-4419-9804-126b86ef5568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:47.853649 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e4d7f-4d68-4419-9804-126b86ef5568 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:47.853935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e4d7f-4d68-4419-9804-126b86ef5568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:47.854209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e4d7f-4d68-4419-9804-126b86ef5568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:47.854867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e4d7f-4d68-4419-9804-126b86ef5568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:47.856503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e4d7f-4d68-4419-9804-126b86ef5568 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:47.869560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1072/2145] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:47.874135 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae906a-c3e5-4777-824a-f9897d9e405a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:47.885536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae906a-c3e5-4777-824a-f9897d9e405a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:47.891358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab785c-22e8-410a-8718-f993f82bfce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:47.892023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab785c-22e8-410a-8718-f993f82bfce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:47.892341 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab785c-22e8-410a-8718-f993f82bfce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:47.892655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab785c-22e8-410a-8718-f993f82bfce4 admin admin] PATH_INFO: `/v3/projects/c8b777f0c2924fde9232c486d1f416cb/users/55ba66311c254ffda926eb6fc08997d3/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:47.909763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab785c-22e8-410a-8718-f993f82bfce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b777f0c2924fde9232c486d1f416cb, user_id=55ba66311c254ffda926eb6fc08997d3, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:47.913250 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab785c-22e8-410a-8718-f993f82bfce4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:48.004659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1074/2146] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:47 2022] PUT /identity/v3/projects/c8b777f0c2924fde9232c486d1f416cb/users/55ba66311c254ffda926eb6fc08997d3/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:48.009657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a40f2-99fa-485b-baa7-cbe5dd92b6ed None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:48.009937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a40f2-99fa-485b-baa7-cbe5dd92b6ed None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:48.010211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a40f2-99fa-485b-baa7-cbe5dd92b6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:48.029788 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b25a40f2-99fa-485b-baa7-cbe5dd92b6ed None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:48.031124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b25a40f2-99fa-485b-baa7-cbe5dd92b6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:48.096264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1073/2147] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:48.106717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab785c-22e8-410a-8718-f993f82bfce4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:48.108524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4fab785c-22e8-410a-8718-f993f82bfce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:48.190879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab785c-22e8-410a-8718-f993f82bfce4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:48.201457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cf0e4-f2bb-4923-b6f7-5410cba5ef66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:48.201457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cf0e4-f2bb-4923-b6f7-5410cba5ef66 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:48.201457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cf0e4-f2bb-4923-b6f7-5410cba5ef66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:48.201457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cf0e4-f2bb-4923-b6f7-5410cba5ef66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:48.207070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cf0e4-f2bb-4923-b6f7-5410cba5ef66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:48.215208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cf0e4-f2bb-4923-b6f7-5410cba5ef66 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:48.227057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1075/2148] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:49.937744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f08cbb-eddd-454f-a2b5-a9a92863e02f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:49.938880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f08cbb-eddd-454f-a2b5-a9a92863e02f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:49.939589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f08cbb-eddd-454f-a2b5-a9a92863e02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:50.003467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-54f08cbb-eddd-454f-a2b5-a9a92863e02f None None] MFA Rules not processed for user `55ba66311c254ffda926eb6fc08997d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:50.005184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-54f08cbb-eddd-454f-a2b5-a9a92863e02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:50.016444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:50.088138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1074/2149] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:50.092592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cf0e4-f2bb-4923-b6f7-5410cba5ef66 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:50.105042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cf0e4-f2bb-4923-b6f7-5410cba5ef66 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:50.111363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6bd56-c345-430b-b262-203b320c90a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:50.112072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6bd56-c345-430b-b262-203b320c90a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:50.112443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6bd56-c345-430b-b262-203b320c90a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:50.113070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6bd56-c345-430b-b262-203b320c90a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:50.114125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6bd56-c345-430b-b262-203b320c90a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:50.117161 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6bd56-c345-430b-b262-203b320c90a4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:50.247351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1076/2150] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:50 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:50.250725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f08cbb-eddd-454f-a2b5-a9a92863e02f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:50.264342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f08cbb-eddd-454f-a2b5-a9a92863e02f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:50.332354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ad003-5a3e-4422-8c8d-cadf456813a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:50.332969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ad003-5a3e-4422-8c8d-cadf456813a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:50.333249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ad003-5a3e-4422-8c8d-cadf456813a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:50.333521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ad003-5a3e-4422-8c8d-cadf456813a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:50.334154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ad003-5a3e-4422-8c8d-cadf456813a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:50.336051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ad003-5a3e-4422-8c8d-cadf456813a8 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:50.446042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1075/2151] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:50 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:18:50.447744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6bd56-c345-430b-b262-203b320c90a4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:50.459143 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6bd56-c345-430b-b262-203b320c90a4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:50.465487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b27c6a-fcaf-4040-8d21-1a49f36dd2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:50.465487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b27c6a-fcaf-4040-8d21-1a49f36dd2be admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:50.465487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b27c6a-fcaf-4040-8d21-1a49f36dd2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:50.465487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b27c6a-fcaf-4040-8d21-1a49f36dd2be admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:50.466645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b27c6a-fcaf-4040-8d21-1a49f36dd2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:50.467853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b27c6a-fcaf-4040-8d21-1a49f36dd2be admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:50.482394 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1077/2152] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:18:50.486582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ad003-5a3e-4422-8c8d-cadf456813a8 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:50.501313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ad003-5a3e-4422-8c8d-cadf456813a8 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:50.507585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d196b-1627-4d25-aff6-b9ce912d8eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:50.508325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d196b-1627-4d25-aff6-b9ce912d8eab admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:50.508588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d196b-1627-4d25-aff6-b9ce912d8eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:50.509003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d196b-1627-4d25-aff6-b9ce912d8eab admin admin] PATH_INFO: `/v3/projects/86ecd22f18a34cb5aea212e27c3ffb5d/users/1b6bd8402f494a6da93d2b3a37f75ec3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:50.526640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d196b-1627-4d25-aff6-b9ce912d8eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ecd22f18a34cb5aea212e27c3ffb5d, user_id=1b6bd8402f494a6da93d2b3a37f75ec3, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:50.529439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d196b-1627-4d25-aff6-b9ce912d8eab admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:50.608739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1076/2153] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:50 2022] PUT /identity/v3/projects/86ecd22f18a34cb5aea212e27c3ffb5d/users/1b6bd8402f494a6da93d2b3a37f75ec3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:18:50.609955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b27c6a-fcaf-4040-8d21-1a49f36dd2be admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:50.620859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b27c6a-fcaf-4040-8d21-1a49f36dd2be admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:50.692635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563a04f-d47d-4cb6-923f-66c4f4a46a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:50.693350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a04f-d47d-4cb6-923f-66c4f4a46a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:50.693585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a04f-d47d-4cb6-923f-66c4f4a46a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:50.695521 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a04f-d47d-4cb6-923f-66c4f4a46a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:50.695521 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563a04f-d47d-4cb6-923f-66c4f4a46a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:50.696252 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563a04f-d47d-4cb6-923f-66c4f4a46a1c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:50.707432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1078/2154] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:50.711836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d196b-1627-4d25-aff6-b9ce912d8eab admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:50.725290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d196b-1627-4d25-aff6-b9ce912d8eab admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:50.730166 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f581e-a4c6-47b6-9f47-447cd41da332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:50.730834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f581e-a4c6-47b6-9f47-447cd41da332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:50.731124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f581e-a4c6-47b6-9f47-447cd41da332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:50.731369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f581e-a4c6-47b6-9f47-447cd41da332 admin admin] PATH_INFO: `/v3/projects/86ecd22f18a34cb5aea212e27c3ffb5d/users/1b6bd8402f494a6da93d2b3a37f75ec3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:50.733341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f581e-a4c6-47b6-9f47-447cd41da332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86ecd22f18a34cb5aea212e27c3ffb5d, user_id=1b6bd8402f494a6da93d2b3a37f75ec3, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:50.735952 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f581e-a4c6-47b6-9f47-447cd41da332 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:50.749055 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1077/2155] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:50 2022] PUT /identity/v3/projects/86ecd22f18a34cb5aea212e27c3ffb5d/users/1b6bd8402f494a6da93d2b3a37f75ec3/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:52.097779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe50c2-c055-404b-ada0-98c2a9813a72 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:52.098218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe50c2-c055-404b-ada0-98c2a9813a72 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:52.098218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe50c2-c055-404b-ada0-98c2a9813a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:52.128561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-49fe50c2-c055-404b-ada0-98c2a9813a72 None None] MFA Rules not processed for user `1b6bd8402f494a6da93d2b3a37f75ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:52.129919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-49fe50c2-c055-404b-ada0-98c2a9813a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:52.162846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:52.203765 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1079/2156] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:52.215240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c71a4b-445f-45d9-b172-c435b7f6235b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:52.215806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c71a4b-445f-45d9-b172-c435b7f6235b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:52.215806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c71a4b-445f-45d9-b172-c435b7f6235b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:52.235528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-18c71a4b-445f-45d9-b172-c435b7f6235b None None] MFA Rules not processed for user `55ba66311c254ffda926eb6fc08997d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:52.236714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-18c71a4b-445f-45d9-b172-c435b7f6235b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:52.294324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1078/2157] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:18:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:52.307509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe50c2-c055-404b-ada0-98c2a9813a72 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:52.309128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-49fe50c2-c055-404b-ada0-98c2a9813a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:52.384901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe50c2-c055-404b-ada0-98c2a9813a72 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:52.390864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7866c-6feb-41db-b4ba-35aad6df8153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:52.391611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7866c-6feb-41db-b4ba-35aad6df8153 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:52.391892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7866c-6feb-41db-b4ba-35aad6df8153 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:52.392163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7866c-6feb-41db-b4ba-35aad6df8153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:52.401230 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7866c-6feb-41db-b4ba-35aad6df8153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:52.402885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7866c-6feb-41db-b4ba-35aad6df8153 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:52.414495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1080/2158] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:02.287785 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:02.568896 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=50 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:06.357290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec7a0-7097-4902-bdbb-6c035cc167be None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:06.357870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec7a0-7097-4902-bdbb-6c035cc167be None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:06.357870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdec7a0-7097-4902-bdbb-6c035cc167be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:06.379336 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ecdec7a0-7097-4902-bdbb-6c035cc167be None None] MFA Rules not processed for user `751a93746a5248cb9ec450b315282f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:06.380866 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ecdec7a0-7097-4902-bdbb-6c035cc167be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:06.441701 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1079/2159] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:10.197266 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7866c-6feb-41db-b4ba-35aad6df8153 service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:10.198782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6ad7866c-6feb-41db-b4ba-35aad6df8153 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:10.271392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7866c-6feb-41db-b4ba-35aad6df8153 service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:10.279240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:10.279240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:10.279240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:10.279240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] PATH_INFO: `/v3/users/d0eb891ac22a4b0e8ba024f9ae36b7e8` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:10.279865 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0eb891ac22a4b0e8ba024f9ae36b7e8)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:10.298081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:10.484746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0eb891ac22a4b0e8ba024f9ae36b7e8'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:10.485550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0eb891ac22a4b0e8ba024f9ae36b7e8'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:10.494937 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0eb891ac22a4b0e8ba024f9ae36b7e8'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:10.496015 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0eb891ac22a4b0e8ba024f9ae36b7e8'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:10.508799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0eb891ac22a4b0e8ba024f9ae36b7e8'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:10.586469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1081/2160] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:19:10 2022] DELETE /identity/v3/users/d0eb891ac22a4b0e8ba024f9ae36b7e8 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:10.591152 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20595e3f-9f67-4166-87b5-beef95bbacf7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:10.591650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20595e3f-9f67-4166-87b5-beef95bbacf7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:10.591744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20595e3f-9f67-4166-87b5-beef95bbacf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:10.611459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-20595e3f-9f67-4166-87b5-beef95bbacf7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:10.612704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-20595e3f-9f67-4166-87b5-beef95bbacf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:10.677727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1080/2161] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:10.687381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:10.688924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:10.750700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71923e22-9ed6-4732-8971-242fd5cb0ba4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:10.754403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03059c39-e777-4705-8aa5-d1f7ecb6a979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:10.755619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03059c39-e777-4705-8aa5-d1f7ecb6a979 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:10.755900 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03059c39-e777-4705-8aa5-d1f7ecb6a979 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:10.756202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03059c39-e777-4705-8aa5-d1f7ecb6a979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:10.765707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03059c39-e777-4705-8aa5-d1f7ecb6a979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:10.769061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03059c39-e777-4705-8aa5-d1f7ecb6a979 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:10.777243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1082/2162] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:11.407655 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20595e3f-9f67-4166-87b5-beef95bbacf7 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:11.409135 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-20595e3f-9f67-4166-87b5-beef95bbacf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:11.422317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20595e3f-9f67-4166-87b5-beef95bbacf7 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:11.430143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:11.430143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:11.430143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:11.430143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] PATH_INFO: `/v3/projects/439687ac6afd4e11852bd9bcdfabc8ad` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:11.431169 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=439687ac6afd4e11852bd9bcdfabc8ad)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:11.432714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:11.560184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '439687ac6afd4e11852bd9bcdfabc8ad', 'request_id': 'req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:11.621623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '439687ac6afd4e11852bd9bcdfabc8ad', 'request_id': 'req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:11.634446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '439687ac6afd4e11852bd9bcdfabc8ad', 'request_id': 'req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:11.650737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] The token cache is being invalidate because project 439687ac6afd4e11852bd9bcdfabc8ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:19:11.651400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:11.652036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-362d0f60-c68e-49bb-8fc5-67f4b09c6e37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:11.653569 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1081/2163] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:19:11 2022] DELETE /identity/v3/projects/439687ac6afd4e11852bd9bcdfabc8ad => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:11.658794 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa4df-9b89-4dc2-87fc-355d9338e5c0 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:11.659385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa4df-9b89-4dc2-87fc-355d9338e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:11.659616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcffa4df-9b89-4dc2-87fc-355d9338e5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:11.680586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-bcffa4df-9b89-4dc2-87fc-355d9338e5c0 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:11.682068 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bcffa4df-9b89-4dc2-87fc-355d9338e5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:11.706368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:11.755976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1083/2164] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:11.764256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c8b6-8c5a-4a03-a4ff-26aa5ef5a8e6 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:11.764256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c8b6-8c5a-4a03-a4ff-26aa5ef5a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:11.764256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c8b6-8c5a-4a03-a4ff-26aa5ef5a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:11.765842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d41e4-0cde-48b8-9b6b-cea7b5d25d7c None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:11.766790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d41e4-0cde-48b8-9b6b-cea7b5d25d7c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:11.767194 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d41e4-0cde-48b8-9b6b-cea7b5d25d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:11.783845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-36a3c8b6-8c5a-4a03-a4ff-26aa5ef5a8e6 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:11.785181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-36a3c8b6-8c5a-4a03-a4ff-26aa5ef5a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:11.788888 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-1f0d41e4-0cde-48b8-9b6b-cea7b5d25d7c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:11.790175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1f0d41e4-0cde-48b8-9b6b-cea7b5d25d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:11.799091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1084/2165] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:19:11.803889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d41e4-0cde-48b8-9b6b-cea7b5d25d7c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:11.813254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d41e4-0cde-48b8-9b6b-cea7b5d25d7c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:11.813743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:11.818990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb26d6e-f0c1-4742-bf0d-64cfd1d7d26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:11.819625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb26d6e-f0c1-4742-bf0d-64cfd1d7d26b admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:11.819905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb26d6e-f0c1-4742-bf0d-64cfd1d7d26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:11.820180 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb26d6e-f0c1-4742-bf0d-64cfd1d7d26b admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:11.820947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb26d6e-f0c1-4742-bf0d-64cfd1d7d26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:19:11.821243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb26d6e-f0c1-4742-bf0d-64cfd1d7d26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:11.822849 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb26d6e-f0c1-4742-bf0d-64cfd1d7d26b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:11.837143 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1085/2166] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:19:11.841623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb26d6e-f0c1-4742-bf0d-64cfd1d7d26b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:11.850264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1082/2167] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:19:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:11.853641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb26d6e-f0c1-4742-bf0d-64cfd1d7d26b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:11.860644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f42f8b-4ecb-488e-8652-3ac9b504ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:11.861423 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f42f8b-4ecb-488e-8652-3ac9b504ec7e admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:11.861781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f42f8b-4ecb-488e-8652-3ac9b504ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:11.862130 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f42f8b-4ecb-488e-8652-3ac9b504ec7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:11.862827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f42f8b-4ecb-488e-8652-3ac9b504ec7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:11.865959 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f42f8b-4ecb-488e-8652-3ac9b504ec7e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:11.898625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3c8b6-8c5a-4a03-a4ff-26aa5ef5a8e6 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:11.900127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-36a3c8b6-8c5a-4a03-a4ff-26aa5ef5a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:11.982460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3c8b6-8c5a-4a03-a4ff-26aa5ef5a8e6 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:11.989027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b53f01-3497-43e1-90e9-4040508f6cfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:11.990825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53f01-3497-43e1-90e9-4040508f6cfe service swift] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:11.991379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53f01-3497-43e1-90e9-4040508f6cfe service swift] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:11.991880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53f01-3497-43e1-90e9-4040508f6cfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:12.003010 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b53f01-3497-43e1-90e9-4040508f6cfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:12.004706 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b53f01-3497-43e1-90e9-4040508f6cfe service swift] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:12.019366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1086/2168] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:19:11 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:19:12.020420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1083/2169] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:19:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 17:19:12.022719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f42f8b-4ecb-488e-8652-3ac9b504ec7e admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:12.132355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f42f8b-4ecb-488e-8652-3ac9b504ec7e admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:12.138736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998fd40-0f99-479f-81c8-b1c16df578f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:12.139385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998fd40-0f99-479f-81c8-b1c16df578f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:12.139664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998fd40-0f99-479f-81c8-b1c16df578f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:12.139937 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998fd40-0f99-479f-81c8-b1c16df578f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:12.140832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998fd40-0f99-479f-81c8-b1c16df578f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:12.144812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998fd40-0f99-479f-81c8-b1c16df578f7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:12.263548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1087/2170] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:19:12 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:19:12.265360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b53f01-3497-43e1-90e9-4040508f6cfe service swift] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:12.283708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b53f01-3497-43e1-90e9-4040508f6cfe service swift] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:12.289505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c16e-8956-48de-a6db-c8be31a57b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:12.291751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c16e-8956-48de-a6db-c8be31a57b1f admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:12.291751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c16e-8956-48de-a6db-c8be31a57b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:12.291751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c16e-8956-48de-a6db-c8be31a57b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:12.291751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322c16e-8956-48de-a6db-c8be31a57b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:12.294739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322c16e-8956-48de-a6db-c8be31a57b1f admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:12.320455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1084/2171] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:19:12.323896 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998fd40-0f99-479f-81c8-b1c16df578f7 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:12.351434 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998fd40-0f99-479f-81c8-b1c16df578f7 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:12.368073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a1ca8-32e5-498c-b4e3-78557c0adc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:12.369249 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a1ca8-32e5-498c-b4e3-78557c0adc9c admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:12.369740 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a1ca8-32e5-498c-b4e3-78557c0adc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:12.370112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a1ca8-32e5-498c-b4e3-78557c0adc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:12.371030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a1ca8-32e5-498c-b4e3-78557c0adc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:12.373082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a1ca8-32e5-498c-b4e3-78557c0adc9c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:12.416177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1088/2172] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:19:12.420789 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c16e-8956-48de-a6db-c8be31a57b1f admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:12.467581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c16e-8956-48de-a6db-c8be31a57b1f admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:12.490035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46dac5-9d06-4c94-a3ef-db922e8621a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:12.490035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46dac5-9d06-4c94-a3ef-db922e8621a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:12.490709 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46dac5-9d06-4c94-a3ef-db922e8621a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:12.492439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46dac5-9d06-4c94-a3ef-db922e8621a5 admin admin] PATH_INFO: `/v3/projects/381091a266174387b925259fca3f7807/users/8d9354c3a83641ae974e857d476ed993/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:12.522492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46dac5-9d06-4c94-a3ef-db922e8621a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381091a266174387b925259fca3f7807, user_id=8d9354c3a83641ae974e857d476ed993, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:12.528678 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46dac5-9d06-4c94-a3ef-db922e8621a5 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:12.641970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1085/2173] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:19:12 2022] PUT /identity/v3/projects/381091a266174387b925259fca3f7807/users/8d9354c3a83641ae974e857d476ed993/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:12.647421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597b928-b79e-4b1d-add8-4c86ead32234 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:12.647711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597b928-b79e-4b1d-add8-4c86ead32234 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:12.648287 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597b928-b79e-4b1d-add8-4c86ead32234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:12.679989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-6597b928-b79e-4b1d-add8-4c86ead32234 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:12.682045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6597b928-b79e-4b1d-add8-4c86ead32234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:12.796689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:12.808373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1089/2174] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:19:12.821743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46dac5-9d06-4c94-a3ef-db922e8621a5 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:12.823542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-aa46dac5-9d06-4c94-a3ef-db922e8621a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:12.962211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46dac5-9d06-4c94-a3ef-db922e8621a5 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:12.968125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df18ca-562d-491e-9998-42514e5dd9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:12.968453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df18ca-562d-491e-9998-42514e5dd9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:12.968741 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df18ca-562d-491e-9998-42514e5dd9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:12.969017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df18ca-562d-491e-9998-42514e5dd9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:12.980810 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df18ca-562d-491e-9998-42514e5dd9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:12.982382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df18ca-562d-491e-9998-42514e5dd9d9 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:12.994945 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1086/2175] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:15.459315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597b928-b79e-4b1d-add8-4c86ead32234 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:15.461272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6597b928-b79e-4b1d-add8-4c86ead32234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:15.529943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597b928-b79e-4b1d-add8-4c86ead32234 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:15.534299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53548a6-d7ea-435f-b2ad-7d2404e6c4e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:15.534732 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53548a6-d7ea-435f-b2ad-7d2404e6c4e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:15.535340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53548a6-d7ea-435f-b2ad-7d2404e6c4e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:15.535684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53548a6-d7ea-435f-b2ad-7d2404e6c4e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:15.552720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e53548a6-d7ea-435f-b2ad-7d2404e6c4e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:15.656642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53548a6-d7ea-435f-b2ad-7d2404e6c4e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:15.658469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53548a6-d7ea-435f-b2ad-7d2404e6c4e4 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:15.673063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1090/2176] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:21.051432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594e03-af3d-4909-9733-2fa9a24d8d80 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:21.052254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594e03-af3d-4909-9733-2fa9a24d8d80 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:21.052254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9594e03-af3d-4909-9733-2fa9a24d8d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:21.091326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a9594e03-af3d-4909-9733-2fa9a24d8d80 None None] MFA Rules not processed for user `8d9354c3a83641ae974e857d476ed993`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:21.093089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a9594e03-af3d-4909-9733-2fa9a24d8d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:21.119525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:21.196414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1087/2177] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:21.197787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53548a6-d7ea-435f-b2ad-7d2404e6c4e4 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:21.289636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53548a6-d7ea-435f-b2ad-7d2404e6c4e4 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:21.301316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e946f-733e-4d8c-8c56-dfdf6c6c48f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:21.303189 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e946f-733e-4d8c-8c56-dfdf6c6c48f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:21.303564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e946f-733e-4d8c-8c56-dfdf6c6c48f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:21.303931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e946f-733e-4d8c-8c56-dfdf6c6c48f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:21.305865 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e946f-733e-4d8c-8c56-dfdf6c6c48f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:21.308154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e946f-733e-4d8c-8c56-dfdf6c6c48f6 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:21.418641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1091/2178] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:19:21 2022] POST /identity/v3/projects => generated 371 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:19:21.424271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594e03-af3d-4909-9733-2fa9a24d8d80 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:21.437285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9594e03-af3d-4909-9733-2fa9a24d8d80 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:21.553773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595d867-0ea7-4938-b458-7a4e40132ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:21.554401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d867-0ea7-4938-b458-7a4e40132ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:21.554679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d867-0ea7-4938-b458-7a4e40132ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:21.554992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595d867-0ea7-4938-b458-7a4e40132ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:21.555891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595d867-0ea7-4938-b458-7a4e40132ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:21.558168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595d867-0ea7-4938-b458-7a4e40132ca8 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:21.700467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1088/2179] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:19:21 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:19:21.701683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e946f-733e-4d8c-8c56-dfdf6c6c48f6 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:21.740196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e946f-733e-4d8c-8c56-dfdf6c6c48f6 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:21.745819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb289a9-ce48-4425-b895-a578df1f257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:21.746685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb289a9-ce48-4425-b895-a578df1f257b admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:21.747151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb289a9-ce48-4425-b895-a578df1f257b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:21.747612 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb289a9-ce48-4425-b895-a578df1f257b admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:21.748546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb289a9-ce48-4425-b895-a578df1f257b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:21.751281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb289a9-ce48-4425-b895-a578df1f257b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:21.775873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595d867-0ea7-4938-b458-7a4e40132ca8 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:21.782676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1092/2180] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:19:21.791508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595d867-0ea7-4938-b458-7a4e40132ca8 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:21.805432 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15658-ed1d-48b0-a85e-951b61b413aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:21.810442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15658-ed1d-48b0-a85e-951b61b413aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:21.813736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15658-ed1d-48b0-a85e-951b61b413aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:21.815409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15658-ed1d-48b0-a85e-951b61b413aa admin admin] PATH_INFO: `/v3/projects/eed60fcd8ff049ed9f35075e7a332d87/users/b3e5341b2bbd4983a334bf72530ef0d9/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:21.882148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf15658-ed1d-48b0-a85e-951b61b413aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed60fcd8ff049ed9f35075e7a332d87, user_id=b3e5341b2bbd4983a334bf72530ef0d9, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:21.886376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf15658-ed1d-48b0-a85e-951b61b413aa admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:21.991509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1089/2181] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:19:21 2022] PUT /identity/v3/projects/eed60fcd8ff049ed9f35075e7a332d87/users/b3e5341b2bbd4983a334bf72530ef0d9/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:21.993115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb289a9-ce48-4425-b895-a578df1f257b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:22.009282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb289a9-ce48-4425-b895-a578df1f257b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:22.122308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8057aa1-3306-4e95-a0b9-5b9ca729146a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:22.124316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057aa1-3306-4e95-a0b9-5b9ca729146a admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:22.124316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057aa1-3306-4e95-a0b9-5b9ca729146a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:22.124316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8057aa1-3306-4e95-a0b9-5b9ca729146a admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:22.124316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8057aa1-3306-4e95-a0b9-5b9ca729146a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:22.125754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8057aa1-3306-4e95-a0b9-5b9ca729146a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:22.138760 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1093/2182] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:19:22.144433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15658-ed1d-48b0-a85e-951b61b413aa admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:22.162485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15658-ed1d-48b0-a85e-951b61b413aa admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:22.170092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0cfcf-cf8c-477a-ad85-4aec14d8416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:22.170092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0cfcf-cf8c-477a-ad85-4aec14d8416c admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:22.170092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0cfcf-cf8c-477a-ad85-4aec14d8416c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:22.170092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0cfcf-cf8c-477a-ad85-4aec14d8416c admin admin] PATH_INFO: `/v3/projects/eed60fcd8ff049ed9f35075e7a332d87/users/b3e5341b2bbd4983a334bf72530ef0d9/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:22.171571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0cfcf-cf8c-477a-ad85-4aec14d8416c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eed60fcd8ff049ed9f35075e7a332d87, user_id=b3e5341b2bbd4983a334bf72530ef0d9, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:22.174702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0cfcf-cf8c-477a-ad85-4aec14d8416c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:22.204093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1090/2183] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:19:22 2022] PUT /identity/v3/projects/eed60fcd8ff049ed9f35075e7a332d87/users/b3e5341b2bbd4983a334bf72530ef0d9/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:32.133425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:32.181924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d139d95-4a00-4d6e-856e-21948a4cd0c2 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:32.182207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d139d95-4a00-4d6e-856e-21948a4cd0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:32.182481 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d139d95-4a00-4d6e-856e-21948a4cd0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:32.199069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:32.217611 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0d139d95-4a00-4d6e-856e-21948a4cd0c2 None None] MFA Rules not processed for user `b3e5341b2bbd4983a334bf72530ef0d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:32.218834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0d139d95-4a00-4d6e-856e-21948a4cd0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:32.342866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1094/2184] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:19:32.351991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0cfcf-cf8c-477a-ad85-4aec14d8416c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:32.354601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d1a0cfcf-cf8c-477a-ad85-4aec14d8416c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:32.572843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0cfcf-cf8c-477a-ad85-4aec14d8416c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:32.580162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea1ed5-7ac8-4270-af4e-f64bb038fa59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:32.580965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1ed5-7ac8-4270-af4e-f64bb038fa59 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:32.581362 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1ed5-7ac8-4270-af4e-f64bb038fa59 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:32.581731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1ed5-7ac8-4270-af4e-f64bb038fa59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:32.698772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea1ed5-7ac8-4270-af4e-f64bb038fa59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:32.700630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea1ed5-7ac8-4270-af4e-f64bb038fa59 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:32.725503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1091/2185] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:35.915339 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc751c13-bf61-4b0f-b48f-57bc759f0513 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:35.915902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc751c13-bf61-4b0f-b48f-57bc759f0513 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:35.915902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc751c13-bf61-4b0f-b48f-57bc759f0513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:35.940660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-dc751c13-bf61-4b0f-b48f-57bc759f0513 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:35.942056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-dc751c13-bf61-4b0f-b48f-57bc759f0513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:36.009714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1095/2186] 10.222.0.20 () {58 vars in 967 bytes} [Wed Aug 24 17:19:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:36.023853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea1ed5-7ac8-4270-af4e-f64bb038fa59 service nova] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:36.110473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea1ed5-7ac8-4270-af4e-f64bb038fa59 service nova] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:36.117270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24748404-6ee9-47bb-a938-86906aba651c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:36.118270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24748404-6ee9-47bb-a938-86906aba651c service swift] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:36.118787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24748404-6ee9-47bb-a938-86906aba651c service swift] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:36.119260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24748404-6ee9-47bb-a938-86906aba651c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:36.128466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24748404-6ee9-47bb-a938-86906aba651c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:36.130717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24748404-6ee9-47bb-a938-86906aba651c service swift] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:36.144717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1092/2187] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:19:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:19:36.377445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ee131-f3b7-4ec8-923b-8ad3fddbdfa1 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:36.380033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ee131-f3b7-4ec8-923b-8ad3fddbdfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:36.380033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ee131-f3b7-4ec8-923b-8ad3fddbdfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:36.399777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-996ee131-f3b7-4ec8-923b-8ad3fddbdfa1 None None] MFA Rules not processed for user `8d9354c3a83641ae974e857d476ed993`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:36.401081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-996ee131-f3b7-4ec8-923b-8ad3fddbdfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:36.408392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1096/2188] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:39.297234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24748404-6ee9-47bb-a938-86906aba651c service swift] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:39.298763 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-24748404-6ee9-47bb-a938-86906aba651c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:39.336493 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:39.376754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24748404-6ee9-47bb-a938-86906aba651c service swift] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:39.381901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec94ec-fc6e-44b0-a214-7fb59d894ae3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a698e566a46841cf83aa1711e83f8829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:39.382543 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec94ec-fc6e-44b0-a214-7fb59d894ae3 service placement] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:39.383084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec94ec-fc6e-44b0-a214-7fb59d894ae3 service placement] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:39.383206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec94ec-fc6e-44b0-a214-7fb59d894ae3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:39.385114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-afec94ec-fc6e-44b0-a214-7fb59d894ae3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:39.398631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec94ec-fc6e-44b0-a214-7fb59d894ae3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:39.400261 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec94ec-fc6e-44b0-a214-7fb59d894ae3 service placement] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:39.407915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12d61c-9ce1-4c6d-99cd-89f172355c20 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:39.408451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12d61c-9ce1-4c6d-99cd-89f172355c20 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:39.408724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12d61c-9ce1-4c6d-99cd-89f172355c20 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:39.410543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1097/2189] 10.222.0.20 () {54 vars in 921 bytes} [Wed Aug 24 17:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:19:39.412533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1093/2190] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:39.423370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1494719-bd85-4a39-a754-f7b1cdb346e0 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:39.424187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1494719-bd85-4a39-a754-f7b1cdb346e0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:39.424632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1494719-bd85-4a39-a754-f7b1cdb346e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:39.461414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-e1494719-bd85-4a39-a754-f7b1cdb346e0 None None] MFA Rules not processed for user `a698e566a46841cf83aa1711e83f8829`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:39.462978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e1494719-bd85-4a39-a754-f7b1cdb346e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:39.473267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1098/2191] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Aug 24 17:19:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:39.488130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec94ec-fc6e-44b0-a214-7fb59d894ae3 service placement] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:39.495170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-afec94ec-fc6e-44b0-a214-7fb59d894ae3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:39.533407 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec94ec-fc6e-44b0-a214-7fb59d894ae3 service placement] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:39.544453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40ba18-b561-4b12-b11c-2cd8386b161a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a698e566a46841cf83aa1711e83f8829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:39.545713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40ba18-b561-4b12-b11c-2cd8386b161a service placement] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:39.546168 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40ba18-b561-4b12-b11c-2cd8386b161a service placement] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:39.546799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40ba18-b561-4b12-b11c-2cd8386b161a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:39.574978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40ba18-b561-4b12-b11c-2cd8386b161a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:39.578321 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40ba18-b561-4b12-b11c-2cd8386b161a service placement] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:39.602921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1494719-bd85-4a39-a754-f7b1cdb346e0 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:39.607154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e1494719-bd85-4a39-a754-f7b1cdb346e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:39.609431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1094/2192] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:39.685601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1494719-bd85-4a39-a754-f7b1cdb346e0 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:39.690134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d6dd7-b789-4d72-939b-769ca6a190c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:39.690775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6dd7-b789-4d72-939b-769ca6a190c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:39.691563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6dd7-b789-4d72-939b-769ca6a190c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:39.691563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d6dd7-b789-4d72-939b-769ca6a190c2 admin admin] PATH_INFO: `/v3/users/fa4f396fb563434188c1d6c16ec7746b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:39.692836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d6dd7-b789-4d72-939b-769ca6a190c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4f396fb563434188c1d6c16ec7746b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:39.704382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d6dd7-b789-4d72-939b-769ca6a190c2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:39.720414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:39.999698 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-fb4d6dd7-b789-4d72-939b-769ca6a190c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4f396fb563434188c1d6c16ec7746b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:40.000590 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-fb4d6dd7-b789-4d72-939b-769ca6a190c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4f396fb563434188c1d6c16ec7746b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:40.009045 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-fb4d6dd7-b789-4d72-939b-769ca6a190c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4f396fb563434188c1d6c16ec7746b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:40.010057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-fb4d6dd7-b789-4d72-939b-769ca6a190c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4f396fb563434188c1d6c16ec7746b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:40.024134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-fb4d6dd7-b789-4d72-939b-769ca6a190c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4f396fb563434188c1d6c16ec7746b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:40.099943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1099/2193] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:19:39 2022] DELETE /identity/v3/users/fa4f396fb563434188c1d6c16ec7746b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:40.380604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40ba18-b561-4b12-b11c-2cd8386b161a service placement] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:40.392416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40ba18-b561-4b12-b11c-2cd8386b161a service placement] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:40.455286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:40.455931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:40.456209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:40.456516 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] PATH_INFO: `/v3/projects/6178066eed1a49a5b0ff99b44ba0f921` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:40.457711 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6178066eed1a49a5b0ff99b44ba0f921)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:40.460544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:40.596698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6178066eed1a49a5b0ff99b44ba0f921', 'request_id': 'req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:40.660662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6178066eed1a49a5b0ff99b44ba0f921', 'request_id': 'req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:40.667891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6178066eed1a49a5b0ff99b44ba0f921', 'request_id': 'req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:40.678705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] The token cache is being invalidate because project 6178066eed1a49a5b0ff99b44ba0f921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:19:40.679069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:40.679726 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4cc709bb-c5d9-4d94-b3f2-978eb4369c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:40.681350 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1095/2194] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:19:40 2022] DELETE /identity/v3/projects/6178066eed1a49a5b0ff99b44ba0f921 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:40.686426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c8002-7b3e-4470-a0bb-2af77d965ef3 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:40.686891 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c8002-7b3e-4470-a0bb-2af77d965ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:40.687147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c8002-7b3e-4470-a0bb-2af77d965ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:40.710226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-426c8002-7b3e-4470-a0bb-2af77d965ef3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:40.711514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-426c8002-7b3e-4470-a0bb-2af77d965ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:40.785387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1100/2195] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:40.792932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46241b93-d2a7-4ac1-8414-06e994f5b48c None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:40.793246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46241b93-d2a7-4ac1-8414-06e994f5b48c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:40.793520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46241b93-d2a7-4ac1-8414-06e994f5b48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:40.814124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-46241b93-d2a7-4ac1-8414-06e994f5b48c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:40.815369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-46241b93-d2a7-4ac1-8414-06e994f5b48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:40.824785 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1096/2196] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:19:40.829068 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c8002-7b3e-4470-a0bb-2af77d965ef3 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:40.842059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c8002-7b3e-4470-a0bb-2af77d965ef3 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:40.846875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264ee81-9db8-4624-8a90-993ba8b2b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:40.847546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264ee81-9db8-4624-8a90-993ba8b2b826 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:40.847827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264ee81-9db8-4624-8a90-993ba8b2b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:40.848101 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264ee81-9db8-4624-8a90-993ba8b2b826 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:40.848869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264ee81-9db8-4624-8a90-993ba8b2b826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:19:40.849180 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264ee81-9db8-4624-8a90-993ba8b2b826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:40.850861 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264ee81-9db8-4624-8a90-993ba8b2b826 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:40.866072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1101/2197] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:19:40.872951 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46241b93-d2a7-4ac1-8414-06e994f5b48c None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:40.883411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46241b93-d2a7-4ac1-8414-06e994f5b48c None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:40.889179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd302e93-35b7-44bf-b98a-b1c50cb86fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:40.889791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302e93-35b7-44bf-b98a-b1c50cb86fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:40.890069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302e93-35b7-44bf-b98a-b1c50cb86fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:40.890341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd302e93-35b7-44bf-b98a-b1c50cb86fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:40.890978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd302e93-35b7-44bf-b98a-b1c50cb86fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:40.892902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd302e93-35b7-44bf-b98a-b1c50cb86fa6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:41.003330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1097/2198] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:19:40 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:19:41.008222 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264ee81-9db8-4624-8a90-993ba8b2b826 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:41.018879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264ee81-9db8-4624-8a90-993ba8b2b826 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:41.088544 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4929d77-b1bc-4ed0-ad6a-97fb61c1d182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:41.089166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4929d77-b1bc-4ed0-ad6a-97fb61c1d182 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:41.089466 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4929d77-b1bc-4ed0-ad6a-97fb61c1d182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:41.089737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4929d77-b1bc-4ed0-ad6a-97fb61c1d182 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:41.090425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4929d77-b1bc-4ed0-ad6a-97fb61c1d182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:41.092467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4929d77-b1bc-4ed0-ad6a-97fb61c1d182 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:41.242996 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1102/2199] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:19:41 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:19:41.247210 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd302e93-35b7-44bf-b98a-b1c50cb86fa6 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:41.254828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:41.259850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd302e93-35b7-44bf-b98a-b1c50cb86fa6 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:41.264854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86c13-c475-4049-9a1f-c9c38d8f3391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:41.265464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86c13-c475-4049-9a1f-c9c38d8f3391 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:41.265737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86c13-c475-4049-9a1f-c9c38d8f3391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:41.266007 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86c13-c475-4049-9a1f-c9c38d8f3391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:41.266648 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f86c13-c475-4049-9a1f-c9c38d8f3391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:41.268246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f86c13-c475-4049-9a1f-c9c38d8f3391 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:41.279129 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1098/2200] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:19:41.293897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4929d77-b1bc-4ed0-ad6a-97fb61c1d182 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:41.306860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4929d77-b1bc-4ed0-ad6a-97fb61c1d182 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:41.312542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c5561-0425-4c49-b5c6-462d0170dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:41.313160 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c5561-0425-4c49-b5c6-462d0170dcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:41.313579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c5561-0425-4c49-b5c6-462d0170dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:41.313897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c5561-0425-4c49-b5c6-462d0170dcb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:41.314628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c5561-0425-4c49-b5c6-462d0170dcb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:41.316279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c5561-0425-4c49-b5c6-462d0170dcb8 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:41.328661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1103/2201] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:19:41.333690 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86c13-c475-4049-9a1f-c9c38d8f3391 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:41.343746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86c13-c475-4049-9a1f-c9c38d8f3391 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:41.348636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9a20-049d-4129-bd77-2e491a1cd098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:41.350072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9a20-049d-4129-bd77-2e491a1cd098 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:41.350221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9a20-049d-4129-bd77-2e491a1cd098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:41.350406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe9a20-049d-4129-bd77-2e491a1cd098 admin admin] PATH_INFO: `/v3/projects/fc52ad9fd7044928bc782a8e9e8ffa3c/users/b82957c28fd4475fa726f460ef7f5219/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:41.367898 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9a20-049d-4129-bd77-2e491a1cd098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc52ad9fd7044928bc782a8e9e8ffa3c, user_id=b82957c28fd4475fa726f460ef7f5219, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:41.370803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe9a20-049d-4129-bd77-2e491a1cd098 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:41.444555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1099/2202] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:19:41 2022] PUT /identity/v3/projects/fc52ad9fd7044928bc782a8e9e8ffa3c/users/b82957c28fd4475fa726f460ef7f5219/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:41.450010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238821d-c30f-4f4f-a076-af2d11c76144 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:41.450338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238821d-c30f-4f4f-a076-af2d11c76144 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:41.451451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238821d-c30f-4f4f-a076-af2d11c76144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:41.460540 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:41.473033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c238821d-c30f-4f4f-a076-af2d11c76144 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:41.474817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c238821d-c30f-4f4f-a076-af2d11c76144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:41.554573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1104/2203] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:41.571660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9a20-049d-4129-bd77-2e491a1cd098 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:41.573806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-babe9a20-049d-4129-bd77-2e491a1cd098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:41.636074 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe9a20-049d-4129-bd77-2e491a1cd098 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:41.640704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62072f-b1ce-4fb7-993b-43d3ca8f3ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:41.641309 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62072f-b1ce-4fb7-993b-43d3ca8f3ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:41.641778 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62072f-b1ce-4fb7-993b-43d3ca8f3ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:41.641898 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62072f-b1ce-4fb7-993b-43d3ca8f3ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:41.652729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62072f-b1ce-4fb7-993b-43d3ca8f3ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:41.654199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62072f-b1ce-4fb7-993b-43d3ca8f3ee0 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:41.664661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1100/2204] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:19:43.376809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397b060-86ec-478c-8dea-a434a9cd2060 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:43.377406 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397b060-86ec-478c-8dea-a434a9cd2060 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:43.377406 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397b060-86ec-478c-8dea-a434a9cd2060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:43.407238 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-d397b060-86ec-478c-8dea-a434a9cd2060 None None] MFA Rules not processed for user `b82957c28fd4475fa726f460ef7f5219`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:43.408584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d397b060-86ec-478c-8dea-a434a9cd2060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:43.507536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1105/2205] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:43.515973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62072f-b1ce-4fb7-993b-43d3ca8f3ee0 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:43.517456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0c62072f-b1ce-4fb7-993b-43d3ca8f3ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:43.583536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62072f-b1ce-4fb7-993b-43d3ca8f3ee0 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:43.587476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798492e-b7e8-4c8c-8511-26adb37d0069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:43.588117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798492e-b7e8-4c8c-8511-26adb37d0069 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:43.588499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798492e-b7e8-4c8c-8511-26adb37d0069 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:43.588684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798492e-b7e8-4c8c-8511-26adb37d0069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:43.597604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798492e-b7e8-4c8c-8511-26adb37d0069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:43.599030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798492e-b7e8-4c8c-8511-26adb37d0069 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:43.610353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1101/2206] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:46.530020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397b060-86ec-478c-8dea-a434a9cd2060 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:46.531767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d397b060-86ec-478c-8dea-a434a9cd2060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:46.556207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8e38-f595-4ae1-a756-9a0b20c6b966 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:46.557294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397b060-86ec-478c-8dea-a434a9cd2060 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:46.557973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8e38-f595-4ae1-a756-9a0b20c6b966 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:46.558265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d8e38-f595-4ae1-a756-9a0b20c6b966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:46.562022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:46.562673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:46.562929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:46.563202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] PATH_INFO: `/v3/users/55ba66311c254ffda926eb6fc08997d3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:46.564350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ba66311c254ffda926eb6fc08997d3)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:46.566267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:46.577318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-345d8e38-f595-4ae1-a756-9a0b20c6b966 None None] MFA Rules not processed for user `b82957c28fd4475fa726f460ef7f5219`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:46.578536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-345d8e38-f595-4ae1-a756-9a0b20c6b966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:46.586631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1102/2207] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:46.759218 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ba66311c254ffda926eb6fc08997d3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:46.760848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ba66311c254ffda926eb6fc08997d3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:46.768708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ba66311c254ffda926eb6fc08997d3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:46.769561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ba66311c254ffda926eb6fc08997d3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:46.783000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ba66311c254ffda926eb6fc08997d3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:46.870905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1106/2208] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:19:46 2022] DELETE /identity/v3/users/55ba66311c254ffda926eb6fc08997d3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:47.234147 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d8e38-f595-4ae1-a756-9a0b20c6b966 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:47.247862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d8e38-f595-4ae1-a756-9a0b20c6b966 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:47.312924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:47.313577 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:47.313858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:47.314131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] PATH_INFO: `/v3/projects/c8b777f0c2924fde9232c486d1f416cb` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:47.315264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b777f0c2924fde9232c486d1f416cb)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:47.317362 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:47.348125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:47.492007 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b777f0c2924fde9232c486d1f416cb', 'request_id': 'req-55874bd9-d648-440b-887c-7eee5d7d1266'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:47.584368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b777f0c2924fde9232c486d1f416cb', 'request_id': 'req-55874bd9-d648-440b-887c-7eee5d7d1266'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:47.592643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b777f0c2924fde9232c486d1f416cb', 'request_id': 'req-55874bd9-d648-440b-887c-7eee5d7d1266'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:47.610427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] The token cache is being invalidate because project c8b777f0c2924fde9232c486d1f416cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:19:47.610835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:47.611599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:47.613333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1103/2209] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:19:47 2022] DELETE /identity/v3/projects/c8b777f0c2924fde9232c486d1f416cb => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:19:47.617557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:47.619906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:47.638056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:47.643076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b869c43-c22f-4f8e-8af0-1afd9988c62a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:47.728187 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b01e1a-d9cd-41b0-af12-3783e0bdc2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:47.729550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b01e1a-d9cd-41b0-af12-3783e0bdc2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:47.729827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b01e1a-d9cd-41b0-af12-3783e0bdc2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:47.730098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b01e1a-d9cd-41b0-af12-3783e0bdc2e3 admin admin] PATH_INFO: `/v3/users/1b6bd8402f494a6da93d2b3a37f75ec3` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:47.731233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b01e1a-d9cd-41b0-af12-3783e0bdc2e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6bd8402f494a6da93d2b3a37f75ec3)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:47.733469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b01e1a-d9cd-41b0-af12-3783e0bdc2e3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:47.972501 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a8b01e1a-d9cd-41b0-af12-3783e0bdc2e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6bd8402f494a6da93d2b3a37f75ec3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:47.973366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a8b01e1a-d9cd-41b0-af12-3783e0bdc2e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6bd8402f494a6da93d2b3a37f75ec3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:47.981713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a8b01e1a-d9cd-41b0-af12-3783e0bdc2e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6bd8402f494a6da93d2b3a37f75ec3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:47.984353 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a8b01e1a-d9cd-41b0-af12-3783e0bdc2e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6bd8402f494a6da93d2b3a37f75ec3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:48.004105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a8b01e1a-d9cd-41b0-af12-3783e0bdc2e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6bd8402f494a6da93d2b3a37f75ec3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:48.101523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1107/2210] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:19:47 2022] DELETE /identity/v3/users/1b6bd8402f494a6da93d2b3a37f75ec3 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:19:48.354621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:48.356911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:48.372207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55874bd9-d648-440b-887c-7eee5d7d1266 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:48.443579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:48.444223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:48.444529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:48.444806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] PATH_INFO: `/v3/projects/86ecd22f18a34cb5aea212e27c3ffb5d` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:48.446566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86ecd22f18a34cb5aea212e27c3ffb5d)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:48.448627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:48.555295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86ecd22f18a34cb5aea212e27c3ffb5d', 'request_id': 'req-367be889-44af-40af-bddb-dfdab522c422'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:48.622622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86ecd22f18a34cb5aea212e27c3ffb5d', 'request_id': 'req-367be889-44af-40af-bddb-dfdab522c422'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:48.630107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86ecd22f18a34cb5aea212e27c3ffb5d', 'request_id': 'req-367be889-44af-40af-bddb-dfdab522c422'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:48.643394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] The token cache is being invalidate because project 86ecd22f18a34cb5aea212e27c3ffb5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:19:48.643686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:48.644631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-367be889-44af-40af-bddb-dfdab522c422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:48.646134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1104/2211] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:19:48 2022] DELETE /identity/v3/projects/86ecd22f18a34cb5aea212e27c3ffb5d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:48.651545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01462aa3-0d3a-470f-9692-c190d33dea3c None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:48.652067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01462aa3-0d3a-470f-9692-c190d33dea3c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:48.652298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01462aa3-0d3a-470f-9692-c190d33dea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:48.677592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-01462aa3-0d3a-470f-9692-c190d33dea3c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:48.679020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-01462aa3-0d3a-470f-9692-c190d33dea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:48.773163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1108/2212] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:19:48.782549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd84cb-7808-45d4-a1d7-74f531090d08 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:48.782839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd84cb-7808-45d4-a1d7-74f531090d08 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:48.783113 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd84cb-7808-45d4-a1d7-74f531090d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:48.813153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-7fdd84cb-7808-45d4-a1d7-74f531090d08 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:48.814661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7fdd84cb-7808-45d4-a1d7-74f531090d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:48.824679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1105/2213] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:48.829114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01462aa3-0d3a-470f-9692-c190d33dea3c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:48.840401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01462aa3-0d3a-470f-9692-c190d33dea3c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:48.845235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed561-ddef-4dfc-9044-590929f4177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:48.845850 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed561-ddef-4dfc-9044-590929f4177d admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:48.846131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed561-ddef-4dfc-9044-590929f4177d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:48.846402 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ed561-ddef-4dfc-9044-590929f4177d admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:48.847055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed561-ddef-4dfc-9044-590929f4177d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:19:48.847377 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed561-ddef-4dfc-9044-590929f4177d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:48.849660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ed561-ddef-4dfc-9044-590929f4177d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:48.862660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1109/2214] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:19:48.868476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd84cb-7808-45d4-a1d7-74f531090d08 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:48.880352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd84cb-7808-45d4-a1d7-74f531090d08 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:48.890131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679fa8b-6b96-463e-a7bc-550a254a1ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:48.890761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679fa8b-6b96-463e-a7bc-550a254a1ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:48.891086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679fa8b-6b96-463e-a7bc-550a254a1ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:48.891419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679fa8b-6b96-463e-a7bc-550a254a1ad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:48.896834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679fa8b-6b96-463e-a7bc-550a254a1ad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:48.896834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679fa8b-6b96-463e-a7bc-550a254a1ad4 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:49.043756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:49.050327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1106/2215] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:19:48 2022] POST /identity/v3/projects => generated 355 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:19:49.054512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed561-ddef-4dfc-9044-590929f4177d admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:49.065222 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ed561-ddef-4dfc-9044-590929f4177d admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:49.074070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:49.129183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f6501-ac59-4c40-ba38-5c71a1721996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:49.129793 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f6501-ac59-4c40-ba38-5c71a1721996 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:49.130079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f6501-ac59-4c40-ba38-5c71a1721996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:49.130468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f6501-ac59-4c40-ba38-5c71a1721996 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:49.131126 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f6501-ac59-4c40-ba38-5c71a1721996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:49.133165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f6501-ac59-4c40-ba38-5c71a1721996 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:49.251536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1110/2216] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:19:49 2022] POST /identity/v3/users => generated 278 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:19:49.255567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679fa8b-6b96-463e-a7bc-550a254a1ad4 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:49.270000 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679fa8b-6b96-463e-a7bc-550a254a1ad4 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:49.275670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07452fb-2c60-4cab-85d1-de0174a6aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:49.276449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07452fb-2c60-4cab-85d1-de0174a6aa61 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:49.277077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07452fb-2c60-4cab-85d1-de0174a6aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:49.277444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07452fb-2c60-4cab-85d1-de0174a6aa61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:49.278267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07452fb-2c60-4cab-85d1-de0174a6aa61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:49.280186 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07452fb-2c60-4cab-85d1-de0174a6aa61 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:49.295720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1107/2217] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:19:49.298094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f6501-ac59-4c40-ba38-5c71a1721996 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:49.309897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f6501-ac59-4c40-ba38-5c71a1721996 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:49.315833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d7c7f-5298-4e76-91e8-540082a43031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:49.316475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d7c7f-5298-4e76-91e8-540082a43031 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:49.317042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d7c7f-5298-4e76-91e8-540082a43031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:49.317487 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d7c7f-5298-4e76-91e8-540082a43031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:49.318446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d7c7f-5298-4e76-91e8-540082a43031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:49.321354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d7c7f-5298-4e76-91e8-540082a43031 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:49.333364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1111/2218] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:19:49.338881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07452fb-2c60-4cab-85d1-de0174a6aa61 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:49.358779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07452fb-2c60-4cab-85d1-de0174a6aa61 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:49.363450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d17d41-e98d-45f9-bf43-b519142fd96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:49.364107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d17d41-e98d-45f9-bf43-b519142fd96b admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:49.364426 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d17d41-e98d-45f9-bf43-b519142fd96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:49.364688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d17d41-e98d-45f9-bf43-b519142fd96b admin admin] PATH_INFO: `/v3/projects/d5b5aaf1dc544f889b3b03306367c3e2/users/8029aa1716cc4fac87d23734e38abcdf/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:49.381601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d17d41-e98d-45f9-bf43-b519142fd96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b5aaf1dc544f889b3b03306367c3e2, user_id=8029aa1716cc4fac87d23734e38abcdf, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:49.389946 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d17d41-e98d-45f9-bf43-b519142fd96b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:49.483880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1108/2219] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:19:49 2022] PUT /identity/v3/projects/d5b5aaf1dc544f889b3b03306367c3e2/users/8029aa1716cc4fac87d23734e38abcdf/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:49.494351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8dad-fb16-4262-89f5-7500017c9fb4 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:49.494795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8dad-fb16-4262-89f5-7500017c9fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:49.495078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f8dad-fb16-4262-89f5-7500017c9fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:49.525701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-be5f8dad-fb16-4262-89f5-7500017c9fb4 None None] MFA Rules not processed for user `8029aa1716cc4fac87d23734e38abcdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:49.527259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-be5f8dad-fb16-4262-89f5-7500017c9fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:49.595064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1112/2220] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:49.628834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d17d41-e98d-45f9-bf43-b519142fd96b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:49.630589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-32d17d41-e98d-45f9-bf43-b519142fd96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:49.690420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d17d41-e98d-45f9-bf43-b519142fd96b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:49.694697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38aa074-0672-459e-8000-ab02704c45fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:49.695302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa074-0672-459e-8000-ab02704c45fe service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:49.695581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa074-0672-459e-8000-ab02704c45fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:49.695854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38aa074-0672-459e-8000-ab02704c45fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:49.705766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38aa074-0672-459e-8000-ab02704c45fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:49.706893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38aa074-0672-459e-8000-ab02704c45fe service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:49.715971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1109/2221] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:49.731777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f8dad-fb16-4262-89f5-7500017c9fb4 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:49.819915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f8dad-fb16-4262-89f5-7500017c9fb4 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:49.827666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:49.828706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:49.829060 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:49.829405 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] PATH_INFO: `/v3/users/8029aa1716cc4fac87d23734e38abcdf` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:49.830772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8029aa1716cc4fac87d23734e38abcdf)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:49.833967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:49.872053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:50.104211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8029aa1716cc4fac87d23734e38abcdf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:50.104932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8029aa1716cc4fac87d23734e38abcdf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:50.111874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8029aa1716cc4fac87d23734e38abcdf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:50.112586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8029aa1716cc4fac87d23734e38abcdf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:50.125046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8029aa1716cc4fac87d23734e38abcdf'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:50.230284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1113/2222] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:19:49 2022] DELETE /identity/v3/users/8029aa1716cc4fac87d23734e38abcdf => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:50.235034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68248a05-282f-4377-a20d-d492e8e6cd4f None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:50.238933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68248a05-282f-4377-a20d-d492e8e6cd4f None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:50.238933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68248a05-282f-4377-a20d-d492e8e6cd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:50.256259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-68248a05-282f-4377-a20d-d492e8e6cd4f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:50.257488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-68248a05-282f-4377-a20d-d492e8e6cd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:50.325847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1110/2223] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:50.332697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:50.334735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:50.401820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b755854-1623-4e3b-a9f6-6ecfcb0da265 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:50.406333 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622edb1e-2566-4727-9691-3bca60597c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:50.407112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622edb1e-2566-4727-9691-3bca60597c5c service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:50.407471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622edb1e-2566-4727-9691-3bca60597c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:50.407846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622edb1e-2566-4727-9691-3bca60597c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:50.418458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622edb1e-2566-4727-9691-3bca60597c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:50.420001 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622edb1e-2566-4727-9691-3bca60597c5c service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:50.430700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1114/2224] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:50.949976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68248a05-282f-4377-a20d-d492e8e6cd4f None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:50.952478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-68248a05-282f-4377-a20d-d492e8e6cd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:50.969801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68248a05-282f-4377-a20d-d492e8e6cd4f None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:50.977581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:50.979181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:50.980038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:50.980358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] PATH_INFO: `/v3/projects/d5b5aaf1dc544f889b3b03306367c3e2` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:50.981641 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b5aaf1dc544f889b3b03306367c3e2)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:50.983886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:51.138266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b5aaf1dc544f889b3b03306367c3e2', 'request_id': 'req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:51.287345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b5aaf1dc544f889b3b03306367c3e2', 'request_id': 'req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:51.309327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b5aaf1dc544f889b3b03306367c3e2', 'request_id': 'req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:51.313334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:51.329784 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] The token cache is being invalidate because project d5b5aaf1dc544f889b3b03306367c3e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:19:51.330260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:51.331325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ba54e7a6-2591-4ec5-a5d7-e30a6f648585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:51.334043 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1111/2225] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:19:50 2022] DELETE /identity/v3/projects/d5b5aaf1dc544f889b3b03306367c3e2 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:51.340892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf1498-b003-483f-8101-3b3be3814b32 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:51.341414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf1498-b003-483f-8101-3b3be3814b32 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:51.341414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf1498-b003-483f-8101-3b3be3814b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:51.370275 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-dbbf1498-b003-483f-8101-3b3be3814b32 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:51.371683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-dbbf1498-b003-483f-8101-3b3be3814b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:51.463719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1115/2226] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:51.472522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153c638-08b2-482a-b6ba-25ed0fb8edf0 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:51.472805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153c638-08b2-482a-b6ba-25ed0fb8edf0 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:51.473072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153c638-08b2-482a-b6ba-25ed0fb8edf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:51.496340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1153c638-08b2-482a-b6ba-25ed0fb8edf0 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:51.497696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1153c638-08b2-482a-b6ba-25ed0fb8edf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:51.506184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1112/2227] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:51.511172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf1498-b003-483f-8101-3b3be3814b32 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:51.523016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf1498-b003-483f-8101-3b3be3814b32 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:51.530297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f56d5e-2cbc-45ec-986b-6597e3a90d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:51.530917 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f56d5e-2cbc-45ec-986b-6597e3a90d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:51.531217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f56d5e-2cbc-45ec-986b-6597e3a90d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:51.531470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f56d5e-2cbc-45ec-986b-6597e3a90d83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:51.532119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f56d5e-2cbc-45ec-986b-6597e3a90d83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:19:51.532619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f56d5e-2cbc-45ec-986b-6597e3a90d83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:51.537410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f56d5e-2cbc-45ec-986b-6597e3a90d83 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:51.551729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1116/2228] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:19:51.556662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153c638-08b2-482a-b6ba-25ed0fb8edf0 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:51.568621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153c638-08b2-482a-b6ba-25ed0fb8edf0 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:51.573978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc1823-ef75-4754-a9d2-979040edf88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:51.574671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1823-ef75-4754-a9d2-979040edf88b admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:51.575032 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1823-ef75-4754-a9d2-979040edf88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:51.575367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc1823-ef75-4754-a9d2-979040edf88b admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:51.576267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc1823-ef75-4754-a9d2-979040edf88b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:51.578298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc1823-ef75-4754-a9d2-979040edf88b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:51.700373 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1113/2229] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:19:51 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:19:51.704948 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f56d5e-2cbc-45ec-986b-6597e3a90d83 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:51.718029 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f56d5e-2cbc-45ec-986b-6597e3a90d83 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:51.760398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:51.809146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35333526-0fd0-4be7-add0-c7abe20d88e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:51.810013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35333526-0fd0-4be7-add0-c7abe20d88e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:51.810335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35333526-0fd0-4be7-add0-c7abe20d88e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:51.810615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35333526-0fd0-4be7-add0-c7abe20d88e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:51.811407 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35333526-0fd0-4be7-add0-c7abe20d88e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:51.813381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35333526-0fd0-4be7-add0-c7abe20d88e3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:52.034616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1117/2230] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:19:51 2022] POST /identity/v3/users => generated 287 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:19:52.039700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc1823-ef75-4754-a9d2-979040edf88b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:52.051774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc1823-ef75-4754-a9d2-979040edf88b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:52.058588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7433d-59c8-4279-97ce-41c80958902a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:52.059342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7433d-59c8-4279-97ce-41c80958902a admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:52.059842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7433d-59c8-4279-97ce-41c80958902a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:52.063982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7433d-59c8-4279-97ce-41c80958902a admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:52.063982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7433d-59c8-4279-97ce-41c80958902a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:52.063982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7433d-59c8-4279-97ce-41c80958902a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:52.079305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1114/2231] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:19:52.084978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35333526-0fd0-4be7-add0-c7abe20d88e3 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:52.101168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35333526-0fd0-4be7-add0-c7abe20d88e3 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:52.106914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d351c2-ec53-4c31-90aa-8ae4556b5557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:52.107919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d351c2-ec53-4c31-90aa-8ae4556b5557 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:52.108428 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d351c2-ec53-4c31-90aa-8ae4556b5557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:52.108956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d351c2-ec53-4c31-90aa-8ae4556b5557 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:52.109627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d351c2-ec53-4c31-90aa-8ae4556b5557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:52.111258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d351c2-ec53-4c31-90aa-8ae4556b5557 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:52.123111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1118/2232] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:19:52.129230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7433d-59c8-4279-97ce-41c80958902a admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:52.146231 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7433d-59c8-4279-97ce-41c80958902a admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:52.154486 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24483b-94ba-45f8-933e-b389bad865a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:52.155297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24483b-94ba-45f8-933e-b389bad865a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:52.155663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24483b-94ba-45f8-933e-b389bad865a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:52.156102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24483b-94ba-45f8-933e-b389bad865a5 admin admin] PATH_INFO: `/v3/projects/9dab2c5b7e3941939f475232c194742e/users/90a4d9f1e98940029d36fbdaaed96bab/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:52.175834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24483b-94ba-45f8-933e-b389bad865a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dab2c5b7e3941939f475232c194742e, user_id=90a4d9f1e98940029d36fbdaaed96bab, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:52.178979 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24483b-94ba-45f8-933e-b389bad865a5 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:52.335201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1115/2233] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:19:52 2022] PUT /identity/v3/projects/9dab2c5b7e3941939f475232c194742e/users/90a4d9f1e98940029d36fbdaaed96bab/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:52.347123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eb0b5-9b93-4548-967c-afa50f986856 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:52.347687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eb0b5-9b93-4548-967c-afa50f986856 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:52.347687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eb0b5-9b93-4548-967c-afa50f986856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:52.377947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-783eb0b5-9b93-4548-967c-afa50f986856 None None] MFA Rules not processed for user `90a4d9f1e98940029d36fbdaaed96bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:52.379337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-783eb0b5-9b93-4548-967c-afa50f986856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:52.476356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1119/2234] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:52.505148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24483b-94ba-45f8-933e-b389bad865a5 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:52.507205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-af24483b-94ba-45f8-933e-b389bad865a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:52.580067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24483b-94ba-45f8-933e-b389bad865a5 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:52.583969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951ad53-d8da-4bd2-a5ba-18207f591e02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:52.584626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951ad53-d8da-4bd2-a5ba-18207f591e02 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:52.584912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951ad53-d8da-4bd2-a5ba-18207f591e02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:52.593126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951ad53-d8da-4bd2-a5ba-18207f591e02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:52.595646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951ad53-d8da-4bd2-a5ba-18207f591e02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:52.597286 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951ad53-d8da-4bd2-a5ba-18207f591e02 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:52.606924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1116/2235] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:54.753155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425634-2758-4160-8654-2aa06ddb390f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:54.753673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425634-2758-4160-8654-2aa06ddb390f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:54.753756 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb425634-2758-4160-8654-2aa06ddb390f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:54.781064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-eb425634-2758-4160-8654-2aa06ddb390f None None] MFA Rules not processed for user `9b22f661cc524dd2a58a499badb8e661`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:54.782298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-eb425634-2758-4160-8654-2aa06ddb390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:54.846907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1120/2236] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:55.704077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdc853-1ef3-41a5-bf58-fe66f168257c None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:55.704663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdc853-1ef3-41a5-bf58-fe66f168257c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:55.704769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdc853-1ef3-41a5-bf58-fe66f168257c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:55.724353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-43cdc853-1ef3-41a5-bf58-fe66f168257c None None] MFA Rules not processed for user `90a4d9f1e98940029d36fbdaaed96bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:55.725675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-43cdc853-1ef3-41a5-bf58-fe66f168257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:55.733416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1117/2237] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:19:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:04.841246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:05.718864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=59,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:10.387419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23153a76-f353-42df-a404-3b06ce03609c None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:10.387920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23153a76-f353-42df-a404-3b06ce03609c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:10.390038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23153a76-f353-42df-a404-3b06ce03609c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:10.408481 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-23153a76-f353-42df-a404-3b06ce03609c None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:10.409876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-23153a76-f353-42df-a404-3b06ce03609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:10.468288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1121/2238] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:20:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:10.481216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdc853-1ef3-41a5-bf58-fe66f168257c None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:10.482625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-43cdc853-1ef3-41a5-bf58-fe66f168257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:10.554556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdc853-1ef3-41a5-bf58-fe66f168257c None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:10.559207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbae01c-9641-4368-b74e-0a2d41bc79e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:10.559813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbae01c-9641-4368-b74e-0a2d41bc79e9 service swift] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:10.560094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbae01c-9641-4368-b74e-0a2d41bc79e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:10.565170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbae01c-9641-4368-b74e-0a2d41bc79e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:10.569630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbae01c-9641-4368-b74e-0a2d41bc79e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:10.571209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbae01c-9641-4368-b74e-0a2d41bc79e9 service swift] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:10.580015 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1118/2239] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:20:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 17:20:20.459136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=25 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:20.577233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=32 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:28.744364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23153a76-f353-42df-a404-3b06ce03609c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:28.746858 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-23153a76-f353-42df-a404-3b06ce03609c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:28.807522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23153a76-f353-42df-a404-3b06ce03609c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:28.811357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc6016-4cba-4413-8076-e9a2452595fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:28.811971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc6016-4cba-4413-8076-e9a2452595fa service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:28.812282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc6016-4cba-4413-8076-e9a2452595fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:28.812563 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc6016-4cba-4413-8076-e9a2452595fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:28.814338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d0bc6016-4cba-4413-8076-e9a2452595fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:28.881383 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc6016-4cba-4413-8076-e9a2452595fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:28.882836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc6016-4cba-4413-8076-e9a2452595fa service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:28.894714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1122/2240] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:20:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:20:31.410822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114f709-2593-4397-8251-feb76152a459 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:31.411799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114f709-2593-4397-8251-feb76152a459 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:31.412315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114f709-2593-4397-8251-feb76152a459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:31.436503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a114f709-2593-4397-8251-feb76152a459 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:31.437991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a114f709-2593-4397-8251-feb76152a459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:31.450944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1119/2241] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:20:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:31.459119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc6016-4cba-4413-8076-e9a2452595fa service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:31.471838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc6016-4cba-4413-8076-e9a2452595fa service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:31.480580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc51e86-31a6-4094-8e0a-ed8388005d8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:31.481525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51e86-31a6-4094-8e0a-ed8388005d8d service swift] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:31.482005 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51e86-31a6-4094-8e0a-ed8388005d8d service swift] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:31.482809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc51e86-31a6-4094-8e0a-ed8388005d8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:31.493638 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc51e86-31a6-4094-8e0a-ed8388005d8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:31.497449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc51e86-31a6-4094-8e0a-ed8388005d8d service swift] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:31.507101 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1123/2242] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 17:20:32.637135 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccef99a-220b-4c7b-ae25-4365f0a346d5 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:32.637587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccef99a-220b-4c7b-ae25-4365f0a346d5 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:32.637692 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccef99a-220b-4c7b-ae25-4365f0a346d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:32.657520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8ccef99a-220b-4c7b-ae25-4365f0a346d5 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:32.662135 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8ccef99a-220b-4c7b-ae25-4365f0a346d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:32.665936 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1120/2243] 10.222.0.20 () {58 vars in 967 bytes} [Wed Aug 24 17:20:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:32.678306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc51e86-31a6-4094-8e0a-ed8388005d8d service swift] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:32.689813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc51e86-31a6-4094-8e0a-ed8388005d8d service swift] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:32.695181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c834d-fb86-4818-b73c-56cb97fd0858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:32.695768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c834d-fb86-4818-b73c-56cb97fd0858 service swift] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:32.696492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c834d-fb86-4818-b73c-56cb97fd0858 service swift] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:32.696492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c834d-fb86-4818-b73c-56cb97fd0858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:32.706854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c834d-fb86-4818-b73c-56cb97fd0858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:32.708512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c834d-fb86-4818-b73c-56cb97fd0858 service swift] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:32.717379 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1124/2244] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:20:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:20:32.960806 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62822-99b6-470f-989a-e84403bad88d None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:32.961147 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62822-99b6-470f-989a-e84403bad88d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:32.961420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62822-99b6-470f-989a-e84403bad88d None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:32.962758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1121/2245] 10.222.0.20 () {54 vars in 921 bytes} [Wed Aug 24 17:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:20:32.969072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50735d3-3828-4289-a17c-45ea8b6611b8 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:32.969504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50735d3-3828-4289-a17c-45ea8b6611b8 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:32.969981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50735d3-3828-4289-a17c-45ea8b6611b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:32.995159 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-a50735d3-3828-4289-a17c-45ea8b6611b8 None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:32.997112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a50735d3-3828-4289-a17c-45ea8b6611b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:33.070914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1125/2246] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Aug 24 17:20:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:33.082824 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b62822-99b6-470f-989a-e84403bad88d None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:33.084516 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-36b62822-99b6-470f-989a-e84403bad88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:33.148479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b62822-99b6-470f-989a-e84403bad88d None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:33.153446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b809ba-7f8f-472b-8cf5-1401897cebd4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1684abe7e6aa44a0873e43dfc146c1b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:33.154054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b809ba-7f8f-472b-8cf5-1401897cebd4 service glance] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:33.154334 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b809ba-7f8f-472b-8cf5-1401897cebd4 service glance] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:33.154609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b809ba-7f8f-472b-8cf5-1401897cebd4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:33.164837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b809ba-7f8f-472b-8cf5-1401897cebd4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:33.166854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b809ba-7f8f-472b-8cf5-1401897cebd4 service glance] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:33.177637 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1122/2247] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:20:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:20:33.328630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7577f9e-85d7-40d4-94a6-54ef63b1d4ed None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:33.328853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7577f9e-85d7-40d4-94a6-54ef63b1d4ed None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:33.329127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7577f9e-85d7-40d4-94a6-54ef63b1d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:33.349894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-d7577f9e-85d7-40d4-94a6-54ef63b1d4ed None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:33.354949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d7577f9e-85d7-40d4-94a6-54ef63b1d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:33.359875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1126/2248] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:20:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:33.372167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b809ba-7f8f-472b-8cf5-1401897cebd4 service glance] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:33.384810 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b809ba-7f8f-472b-8cf5-1401897cebd4 service glance] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:33.390526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4061f48-83a0-427a-be53-af60d5b68e2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:33.391135 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061f48-83a0-427a-be53-af60d5b68e2f service swift] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:33.391413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061f48-83a0-427a-be53-af60d5b68e2f service swift] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:33.391686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061f48-83a0-427a-be53-af60d5b68e2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:33.401394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4061f48-83a0-427a-be53-af60d5b68e2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:33.403167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4061f48-83a0-427a-be53-af60d5b68e2f service swift] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:33.411737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1123/2249] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:20:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:20:33.439707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319db353-d6bc-43ba-8e9d-821336625873 None None] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:33.440165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319db353-d6bc-43ba-8e9d-821336625873 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:33.440543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319db353-d6bc-43ba-8e9d-821336625873 None None] PATH_INFO: `/` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:33.441991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1127/2250] 10.222.0.20 () {54 vars in 921 bytes} [Wed Aug 24 17:20:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:20:33.447215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081293f-3549-4e65-b0b2-2585aa340bc5 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:33.447589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081293f-3549-4e65-b0b2-2585aa340bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:33.447973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081293f-3549-4e65-b0b2-2585aa340bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:33.469735 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a081293f-3549-4e65-b0b2-2585aa340bc5 None None] MFA Rules not processed for user `e303777e78b7499fbff457254d14d360`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:33.474553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a081293f-3549-4e65-b0b2-2585aa340bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:33.477952 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1124/2251] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Aug 24 17:20:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:33.491434 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319db353-d6bc-43ba-8e9d-821336625873 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:33.506692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319db353-d6bc-43ba-8e9d-821336625873 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:33.510728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11beef-9657-4524-9cf4-83703c6c98dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:33.511335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11beef-9657-4524-9cf4-83703c6c98dd service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:33.511869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11beef-9657-4524-9cf4-83703c6c98dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:33.512138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11beef-9657-4524-9cf4-83703c6c98dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:33.517677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:33.520333 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11beef-9657-4524-9cf4-83703c6c98dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:33.521793 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c11beef-9657-4524-9cf4-83703c6c98dd service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:33.531338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1128/2252] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:20:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:20:33.620405 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b806aa6-fda9-461c-b069-2c597919cb9e None None] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:33.620687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b806aa6-fda9-461c-b069-2c597919cb9e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:33.620960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b806aa6-fda9-461c-b069-2c597919cb9e None None] PATH_INFO: `/` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:33.622368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1125/2253] 10.222.0.20 () {54 vars in 921 bytes} [Wed Aug 24 17:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:20:33.628432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43701d39-b9b8-4403-92e2-0fcc0c13dfa6 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:33.628818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43701d39-b9b8-4403-92e2-0fcc0c13dfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:33.629188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43701d39-b9b8-4403-92e2-0fcc0c13dfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:33.649971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-43701d39-b9b8-4403-92e2-0fcc0c13dfa6 None None] MFA Rules not processed for user `8af51476b48e45efbc3b626f9780e0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:33.652049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-43701d39-b9b8-4403-92e2-0fcc0c13dfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:33.661564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1129/2254] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Aug 24 17:20:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:20:33.674264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b806aa6-fda9-461c-b069-2c597919cb9e None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:33.675950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4b806aa6-fda9-461c-b069-2c597919cb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:33.693110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b806aa6-fda9-461c-b069-2c597919cb9e None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:33.699494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4c495-6425-4bd3-a8fd-6a85dc6bd89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:33.700439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c495-6425-4bd3-a8fd-6a85dc6bd89b service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:33.700723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c495-6425-4bd3-a8fd-6a85dc6bd89b service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:33.700993 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4c495-6425-4bd3-a8fd-6a85dc6bd89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:33.712194 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4c495-6425-4bd3-a8fd-6a85dc6bd89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:33.714660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4c495-6425-4bd3-a8fd-6a85dc6bd89b service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:33.726935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1126/2255] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:20:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:20:34.049482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b84d-4425-42c2-b104-84c0cd7afa21 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:34.049974 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b84d-4425-42c2-b104-84c0cd7afa21 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:34.050078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494b84d-4425-42c2-b104-84c0cd7afa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:34.070645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-a494b84d-4425-42c2-b104-84c0cd7afa21 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:34.071854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a494b84d-4425-42c2-b104-84c0cd7afa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:34.080327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1130/2256] 10.222.0.20 () {58 vars in 967 bytes} [Wed Aug 24 17:20:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:34.097291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4c495-6425-4bd3-a8fd-6a85dc6bd89b service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:34.110223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4c495-6425-4bd3-a8fd-6a85dc6bd89b service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:34.115651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00972-1e86-4225-9d6d-a9ff0087f1af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:34.116297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00972-1e86-4225-9d6d-a9ff0087f1af service swift] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:34.116583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00972-1e86-4225-9d6d-a9ff0087f1af service swift] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:34.116861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00972-1e86-4225-9d6d-a9ff0087f1af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:34.126331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00972-1e86-4225-9d6d-a9ff0087f1af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:34.129886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00972-1e86-4225-9d6d-a9ff0087f1af service swift] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:34.139017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1127/2257] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:20:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:20:37.136832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494b84d-4425-42c2-b104-84c0cd7afa21 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:37.213382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494b84d-4425-42c2-b104-84c0cd7afa21 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:37.222606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:37.223533 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:37.224562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:37.225077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] PATH_INFO: `/v3/users/90a4d9f1e98940029d36fbdaaed96bab` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:37.226420 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a4d9f1e98940029d36fbdaaed96bab)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:37.228617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:37.423250 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a4d9f1e98940029d36fbdaaed96bab'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:20:37.424110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a4d9f1e98940029d36fbdaaed96bab'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:20:37.433337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a4d9f1e98940029d36fbdaaed96bab'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:20:37.434653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a4d9f1e98940029d36fbdaaed96bab'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:20:37.449283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a4d9f1e98940029d36fbdaaed96bab'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:20:37.527326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1131/2258] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:20:37 2022] DELETE /identity/v3/users/90a4d9f1e98940029d36fbdaaed96bab => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:20:37.532055 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbcbbc-61e7-428a-8cf5-936745eeebc8 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:37.532583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbcbbc-61e7-428a-8cf5-936745eeebc8 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:37.532680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbcbbc-61e7-428a-8cf5-936745eeebc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:37.552402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-05bbcbbc-61e7-428a-8cf5-936745eeebc8 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:37.553715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-05bbcbbc-61e7-428a-8cf5-936745eeebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:37.619118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1128/2259] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:20:37.629388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:37.631028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:37.696106 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27933883-ecbc-4852-991a-80ba32f1bd52 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:37.700653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dda839-dc02-459b-92b7-ebe7dc0f928f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:37.701633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dda839-dc02-459b-92b7-ebe7dc0f928f service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:37.703609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dda839-dc02-459b-92b7-ebe7dc0f928f service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:37.703609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dda839-dc02-459b-92b7-ebe7dc0f928f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:37.714446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dda839-dc02-459b-92b7-ebe7dc0f928f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:37.715897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dda839-dc02-459b-92b7-ebe7dc0f928f service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:37.727285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1132/2260] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:20:38.133868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbcbbc-61e7-428a-8cf5-936745eeebc8 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:38.135637 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-05bbcbbc-61e7-428a-8cf5-936745eeebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:38.159358 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbcbbc-61e7-428a-8cf5-936745eeebc8 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:38.166985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:38.167944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:38.168471 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:38.168743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] PATH_INFO: `/v3/projects/9dab2c5b7e3941939f475232c194742e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:38.170113 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dab2c5b7e3941939f475232c194742e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:38.172061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:38.325276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:38.333487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dab2c5b7e3941939f475232c194742e', 'request_id': 'req-1bdff132-08bf-47c5-87e3-1afccb6188e9'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:20:38.409586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dab2c5b7e3941939f475232c194742e', 'request_id': 'req-1bdff132-08bf-47c5-87e3-1afccb6188e9'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:20:38.417870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dab2c5b7e3941939f475232c194742e', 'request_id': 'req-1bdff132-08bf-47c5-87e3-1afccb6188e9'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:20:38.438664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] The token cache is being invalidate because project 9dab2c5b7e3941939f475232c194742e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:20:38.439152 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:20:38.448719 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1bdff132-08bf-47c5-87e3-1afccb6188e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:20:38.451290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1129/2261] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:20:38 2022] DELETE /identity/v3/projects/9dab2c5b7e3941939f475232c194742e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:20:38.458019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e7caf-3953-4d63-8bac-96dc39adcd74 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:38.458907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e7caf-3953-4d63-8bac-96dc39adcd74 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:38.459072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e7caf-3953-4d63-8bac-96dc39adcd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:38.474573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:38.492669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-920e7caf-3953-4d63-8bac-96dc39adcd74 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:38.493585 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-920e7caf-3953-4d63-8bac-96dc39adcd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:38.557532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1133/2262] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:38.569950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff5dc4-e578-42b4-972e-aedb7111b015 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:38.570702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff5dc4-e578-42b4-972e-aedb7111b015 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:38.570702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff5dc4-e578-42b4-972e-aedb7111b015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:38.594066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a2ff5dc4-e578-42b4-972e-aedb7111b015 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:38.595326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a2ff5dc4-e578-42b4-972e-aedb7111b015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:38.605247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1130/2263] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:38.610255 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e7caf-3953-4d63-8bac-96dc39adcd74 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:38.621445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e7caf-3953-4d63-8bac-96dc39adcd74 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:38.626716 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8107f02-de58-410f-9110-d21589eb6eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:38.627386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8107f02-de58-410f-9110-d21589eb6eed admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:38.627665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8107f02-de58-410f-9110-d21589eb6eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:38.627964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8107f02-de58-410f-9110-d21589eb6eed admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:38.628657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8107f02-de58-410f-9110-d21589eb6eed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:20:38.629010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8107f02-de58-410f-9110-d21589eb6eed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:38.630672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8107f02-de58-410f-9110-d21589eb6eed admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:38.644112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1134/2264] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:20:38.654823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff5dc4-e578-42b4-972e-aedb7111b015 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:38.664595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff5dc4-e578-42b4-972e-aedb7111b015 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:38.670555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85810588-6c5e-4695-9670-bef286310778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:38.671183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85810588-6c5e-4695-9670-bef286310778 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:38.671465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85810588-6c5e-4695-9670-bef286310778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:38.671797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85810588-6c5e-4695-9670-bef286310778 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:38.672547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85810588-6c5e-4695-9670-bef286310778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:38.674466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85810588-6c5e-4695-9670-bef286310778 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:38.748022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1131/2265] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:20:38 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:20:38.752274 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8107f02-de58-410f-9110-d21589eb6eed admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:38.763659 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8107f02-de58-410f-9110-d21589eb6eed admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:38.821011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c98b5a-02fe-495b-a189-3f4a488dacec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:38.821543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c98b5a-02fe-495b-a189-3f4a488dacec admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:38.821823 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c98b5a-02fe-495b-a189-3f4a488dacec admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:38.822096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c98b5a-02fe-495b-a189-3f4a488dacec admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:38.822890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c98b5a-02fe-495b-a189-3f4a488dacec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:38.824861 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c98b5a-02fe-495b-a189-3f4a488dacec admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:38.930803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194be3f6-9569-4ee0-8dda-38d619a9746a None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:38.931010 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194be3f6-9569-4ee0-8dda-38d619a9746a None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:38.931616 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194be3f6-9569-4ee0-8dda-38d619a9746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:38.932426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1135/2266] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:20:38 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:20:38.936602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c98b5a-02fe-495b-a189-3f4a488dacec admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:38.948338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c98b5a-02fe-495b-a189-3f4a488dacec admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:38.956936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da323f-4380-4349-8f21-2d3b2d1d7376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:38.957576 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da323f-4380-4349-8f21-2d3b2d1d7376 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:38.957849 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da323f-4380-4349-8f21-2d3b2d1d7376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:38.958158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da323f-4380-4349-8f21-2d3b2d1d7376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:38.958854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da323f-4380-4349-8f21-2d3b2d1d7376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:38.958959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-194be3f6-9569-4ee0-8dda-38d619a9746a None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:38.960119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-194be3f6-9569-4ee0-8dda-38d619a9746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:38.962839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da323f-4380-4349-8f21-2d3b2d1d7376 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:38.981776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1136/2267] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:20:38.982700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da323f-4380-4349-8f21-2d3b2d1d7376 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:38.995156 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da323f-4380-4349-8f21-2d3b2d1d7376 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:39.007548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4522c48-9672-4c07-aa6f-a559044cfa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:39.008163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522c48-9672-4c07-aa6f-a559044cfa7f admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:39.008541 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522c48-9672-4c07-aa6f-a559044cfa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:39.008809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4522c48-9672-4c07-aa6f-a559044cfa7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:39.009473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4522c48-9672-4c07-aa6f-a559044cfa7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:39.012133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4522c48-9672-4c07-aa6f-a559044cfa7f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:39.023086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1137/2268] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:20:39.028089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4522c48-9672-4c07-aa6f-a559044cfa7f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:39.038886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1132/2269] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:20:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:20:39.042035 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4522c48-9672-4c07-aa6f-a559044cfa7f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:39.046975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8740584-046a-4a56-af51-dc7e755947f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:39.047397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8740584-046a-4a56-af51-dc7e755947f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:39.047686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8740584-046a-4a56-af51-dc7e755947f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:39.047965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8740584-046a-4a56-af51-dc7e755947f3 admin admin] PATH_INFO: `/v3/projects/b03d48a5b363455a8359673a1c568c2f/users/3db839a9ad544263bda4864c1b13876e/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:39.053316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194be3f6-9569-4ee0-8dda-38d619a9746a None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:39.055013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-194be3f6-9569-4ee0-8dda-38d619a9746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:39.066014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8740584-046a-4a56-af51-dc7e755947f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03d48a5b363455a8359673a1c568c2f, user_id=3db839a9ad544263bda4864c1b13876e, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:39.068790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8740584-046a-4a56-af51-dc7e755947f3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:39.124283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194be3f6-9569-4ee0-8dda-38d619a9746a None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:39.129381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da1508b-6475-4fbb-a76c-0deda05141f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:39.129976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1508b-6475-4fbb-a76c-0deda05141f2 service swift] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:39.130276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1508b-6475-4fbb-a76c-0deda05141f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:39.130536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da1508b-6475-4fbb-a76c-0deda05141f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:39.139418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1508b-6475-4fbb-a76c-0deda05141f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:39.141020 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da1508b-6475-4fbb-a76c-0deda05141f2 service swift] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:39.145631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1138/2270] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:20:39 2022] PUT /identity/v3/projects/b03d48a5b363455a8359673a1c568c2f/users/3db839a9ad544263bda4864c1b13876e/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:20:39.145631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e61d-f5f8-4696-9f28-4ca225914ea3 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:39.145631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e61d-f5f8-4696-9f28-4ca225914ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:39.145631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e61d-f5f8-4696-9f28-4ca225914ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:39.151445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1133/2271] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:20:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:20:39.152716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944139bd-fff8-4381-a50d-ee080a5fb650 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:39.153078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944139bd-fff8-4381-a50d-ee080a5fb650 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:39.153450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944139bd-fff8-4381-a50d-ee080a5fb650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:39.165418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ad79e61d-f5f8-4696-9f28-4ca225914ea3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:39.167248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ad79e61d-f5f8-4696-9f28-4ca225914ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:39.177512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-944139bd-fff8-4381-a50d-ee080a5fb650 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:39.178732 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-944139bd-fff8-4381-a50d-ee080a5fb650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:39.200416 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:39.209307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:39.231202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1139/2272] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 17:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:39.248144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79e61d-f5f8-4696-9f28-4ca225914ea3 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:39.249758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ad79e61d-f5f8-4696-9f28-4ca225914ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:39.340850 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79e61d-f5f8-4696-9f28-4ca225914ea3 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:39.347409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46cb8f-d25f-49e1-a521-42dec8dbce5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:39.348202 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46cb8f-d25f-49e1-a521-42dec8dbce5b service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:39.348614 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46cb8f-d25f-49e1-a521-42dec8dbce5b service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:39.348995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46cb8f-d25f-49e1-a521-42dec8dbce5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:39.360898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46cb8f-d25f-49e1-a521-42dec8dbce5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:39.363228 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46cb8f-d25f-49e1-a521-42dec8dbce5b service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:39.376483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1140/2273] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:20:39.377200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1134/2274] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:39.389301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46cb8f-d25f-49e1-a521-42dec8dbce5b service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:39.391702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ad46cb8f-d25f-49e1-a521-42dec8dbce5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:39.476738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46cb8f-d25f-49e1-a521-42dec8dbce5b service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:39.483561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2f5dd-4f12-4ec8-8385-6e1b20d58a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:39.485629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f5dd-4f12-4ec8-8385-6e1b20d58a87 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:39.486068 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f5dd-4f12-4ec8-8385-6e1b20d58a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:39.486507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2f5dd-4f12-4ec8-8385-6e1b20d58a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:39.498024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2f5dd-4f12-4ec8-8385-6e1b20d58a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:39.499779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2f5dd-4f12-4ec8-8385-6e1b20d58a87 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:39.513066 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1141/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:20:46.314195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70493215-264d-476b-9662-acc50965f5ad None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:46.314195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70493215-264d-476b-9662-acc50965f5ad None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:46.314195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70493215-264d-476b-9662-acc50965f5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:46.372671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-70493215-264d-476b-9662-acc50965f5ad None None] MFA Rules not processed for user `3db839a9ad544263bda4864c1b13876e`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:46.374386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-70493215-264d-476b-9662-acc50965f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:46.445321 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1135/2276] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:20:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:46.450782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2f5dd-4f12-4ec8-8385-6e1b20d58a87 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:46.463822 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2f5dd-4f12-4ec8-8385-6e1b20d58a87 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:46.469871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb87bb2-9981-433a-a43a-e78b11bd7bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:46.470546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb87bb2-9981-433a-a43a-e78b11bd7bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:46.470829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb87bb2-9981-433a-a43a-e78b11bd7bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:46.471102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb87bb2-9981-433a-a43a-e78b11bd7bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:46.471760 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb87bb2-9981-433a-a43a-e78b11bd7bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:46.473755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb87bb2-9981-433a-a43a-e78b11bd7bdb admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:46.570696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1142/2277] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:20:46 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:20:46.575786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70493215-264d-476b-9662-acc50965f5ad None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:46.615259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70493215-264d-476b-9662-acc50965f5ad None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:46.737394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73058eb6-0fea-4901-9860-1c7d08241486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:46.741001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058eb6-0fea-4901-9860-1c7d08241486 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:46.741384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058eb6-0fea-4901-9860-1c7d08241486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:46.741743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73058eb6-0fea-4901-9860-1c7d08241486 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:46.742492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73058eb6-0fea-4901-9860-1c7d08241486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:46.746263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73058eb6-0fea-4901-9860-1c7d08241486 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:46.841338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1136/2278] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:20:46 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:20:46.845084 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb87bb2-9981-433a-a43a-e78b11bd7bdb admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:46.858926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb87bb2-9981-433a-a43a-e78b11bd7bdb admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:46.869362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa8e15-8499-4bc6-b4e2-985e3e4e7a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:46.870401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa8e15-8499-4bc6-b4e2-985e3e4e7a56 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:46.870692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa8e15-8499-4bc6-b4e2-985e3e4e7a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:46.872129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa8e15-8499-4bc6-b4e2-985e3e4e7a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:46.872886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa8e15-8499-4bc6-b4e2-985e3e4e7a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:46.878278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa8e15-8499-4bc6-b4e2-985e3e4e7a56 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:46.917890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1143/2279] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:20:46.922837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73058eb6-0fea-4901-9860-1c7d08241486 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:46.935501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73058eb6-0fea-4901-9860-1c7d08241486 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:46.940205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b6a2d-4f23-4a28-980e-cbd4a7a340be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:46.940900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6a2d-4f23-4a28-980e-cbd4a7a340be admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:46.941178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6a2d-4f23-4a28-980e-cbd4a7a340be admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:46.941449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6a2d-4f23-4a28-980e-cbd4a7a340be admin admin] PATH_INFO: `/v3/projects/f59785863fdb47c6bdb2b892cfbfd0d7/users/bed77623bb234ee48159b43950a3ec25/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:46.975298 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b6a2d-4f23-4a28-980e-cbd4a7a340be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59785863fdb47c6bdb2b892cfbfd0d7, user_id=bed77623bb234ee48159b43950a3ec25, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:46.981787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b6a2d-4f23-4a28-980e-cbd4a7a340be admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:47.073212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1137/2280] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:20:46 2022] PUT /identity/v3/projects/f59785863fdb47c6bdb2b892cfbfd0d7/users/bed77623bb234ee48159b43950a3ec25/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:20:47.077780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa8e15-8499-4bc6-b4e2-985e3e4e7a56 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:47.090367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa8e15-8499-4bc6-b4e2-985e3e4e7a56 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:47.139947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:47.172883 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85674188-18e8-4720-b21e-8182552402c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:47.173570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674188-18e8-4720-b21e-8182552402c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:47.173835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674188-18e8-4720-b21e-8182552402c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:47.174107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85674188-18e8-4720-b21e-8182552402c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:47.174763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85674188-18e8-4720-b21e-8182552402c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:47.176446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85674188-18e8-4720-b21e-8182552402c5 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:47.190680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1144/2281] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:20:47.192113 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b6a2d-4f23-4a28-980e-cbd4a7a340be admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:47.204885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b6a2d-4f23-4a28-980e-cbd4a7a340be admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:47.212134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25a31c-778d-4251-a25c-f078def30faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:47.212134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25a31c-778d-4251-a25c-f078def30faa admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:47.212134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25a31c-778d-4251-a25c-f078def30faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:47.212134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25a31c-778d-4251-a25c-f078def30faa admin admin] PATH_INFO: `/v3/projects/f59785863fdb47c6bdb2b892cfbfd0d7/users/bed77623bb234ee48159b43950a3ec25/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:47.214052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25a31c-778d-4251-a25c-f078def30faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59785863fdb47c6bdb2b892cfbfd0d7, user_id=bed77623bb234ee48159b43950a3ec25, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:47.216805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25a31c-778d-4251-a25c-f078def30faa admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:47.230411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1138/2282] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:20:47 2022] PUT /identity/v3/projects/f59785863fdb47c6bdb2b892cfbfd0d7/users/bed77623bb234ee48159b43950a3ec25/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:20:54.713622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228790-4b42-48ed-9f16-47832711ff3b None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:54.714148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228790-4b42-48ed-9f16-47832711ff3b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:54.714272 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42228790-4b42-48ed-9f16-47832711ff3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:54.745303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-42228790-4b42-48ed-9f16-47832711ff3b None None] MFA Rules not processed for user `bed77623bb234ee48159b43950a3ec25`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:54.746869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-42228790-4b42-48ed-9f16-47832711ff3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:54.833358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1145/2283] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:20:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:54.846378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25a31c-778d-4251-a25c-f078def30faa admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:54.848217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6a25a31c-778d-4251-a25c-f078def30faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:54.868644 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:54.917306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25a31c-778d-4251-a25c-f078def30faa admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:54.921000 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be03c2-c923-4ee3-bcff-1fb7f2025fa0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1684abe7e6aa44a0873e43dfc146c1b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:54.921774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be03c2-c923-4ee3-bcff-1fb7f2025fa0 service glance] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:54.922190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be03c2-c923-4ee3-bcff-1fb7f2025fa0 service glance] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:54.922711 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be03c2-c923-4ee3-bcff-1fb7f2025fa0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:54.988494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be03c2-c923-4ee3-bcff-1fb7f2025fa0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:54.989933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be03c2-c923-4ee3-bcff-1fb7f2025fa0 service glance] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:54.999902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1139/2284] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:20:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:20:55.324357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87993d-9d5a-4cc2-a73f-d723fb40dd4d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:55.324676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87993d-9d5a-4cc2-a73f-d723fb40dd4d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:55.327314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87993d-9d5a-4cc2-a73f-d723fb40dd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:55.346379 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-9b87993d-9d5a-4cc2-a73f-d723fb40dd4d None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:55.347595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-9b87993d-9d5a-4cc2-a73f-d723fb40dd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:55.413632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1146/2285] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:20:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:55.426325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be03c2-c923-4ee3-bcff-1fb7f2025fa0 service glance] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:55.515424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be03c2-c923-4ee3-bcff-1fb7f2025fa0 service glance] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:55.520892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23428102-48f5-481c-ac24-f7c69d8ea395 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:55.521510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23428102-48f5-481c-ac24-f7c69d8ea395 service swift] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:55.521785 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23428102-48f5-481c-ac24-f7c69d8ea395 service swift] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:55.522052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23428102-48f5-481c-ac24-f7c69d8ea395 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:55.531769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23428102-48f5-481c-ac24-f7c69d8ea395 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:55.533602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23428102-48f5-481c-ac24-f7c69d8ea395 service swift] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:55.543400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1140/2286] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:20:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:21:05.221437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefeae9-37ab-49ae-b3c2-0d0dfead4563 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:05.221915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefeae9-37ab-49ae-b3c2-0d0dfead4563 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:05.222016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefeae9-37ab-49ae-b3c2-0d0dfead4563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:05.243292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-5aefeae9-37ab-49ae-b3c2-0d0dfead4563 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:21:05.244830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5aefeae9-37ab-49ae-b3c2-0d0dfead4563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:05.252078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1147/2287] 10.222.0.20 () {58 vars in 967 bytes} [Wed Aug 24 17:21:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:21:05.266440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23428102-48f5-481c-ac24-f7c69d8ea395 service swift] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:05.278156 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23428102-48f5-481c-ac24-f7c69d8ea395 service swift] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:05.283703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa888425-f2f8-451b-872a-73c64e0c63f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:05.284374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa888425-f2f8-451b-872a-73c64e0c63f2 service swift] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:05.284926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa888425-f2f8-451b-872a-73c64e0c63f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:05.284926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa888425-f2f8-451b-872a-73c64e0c63f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:05.294308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa888425-f2f8-451b-872a-73c64e0c63f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:05.295898 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa888425-f2f8-451b-872a-73c64e0c63f2 service swift] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:05.304913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1141/2288] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:21:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:21:07.064651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79172a8-3390-4a4d-8ef1-6f813aa5911a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:07.065204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79172a8-3390-4a4d-8ef1-6f813aa5911a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:07.065204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79172a8-3390-4a4d-8ef1-6f813aa5911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:07.084338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b79172a8-3390-4a4d-8ef1-6f813aa5911a None None] MFA Rules not processed for user `3db839a9ad544263bda4864c1b13876e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:21:07.085531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b79172a8-3390-4a4d-8ef1-6f813aa5911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:07.093129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1148/2289] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:21:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:21:07.698318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff88e3-99d2-464c-b703-6cf4e5e20eb7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:07.698870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff88e3-99d2-464c-b703-6cf4e5e20eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:07.698870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff88e3-99d2-464c-b703-6cf4e5e20eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:07.720466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-54ff88e3-99d2-464c-b703-6cf4e5e20eb7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:21:07.721738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-54ff88e3-99d2-464c-b703-6cf4e5e20eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:07.772340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:21:07.791634 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1142/2290] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 17:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:21:07.813310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79172a8-3390-4a4d-8ef1-6f813aa5911a None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:07.814751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b79172a8-3390-4a4d-8ef1-6f813aa5911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:07.866613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:21:07.905705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79172a8-3390-4a4d-8ef1-6f813aa5911a None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:07.915517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd561c-0c53-4d0d-b2ec-69b44cec937e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:07.916316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd561c-0c53-4d0d-b2ec-69b44cec937e service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:07.916734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd561c-0c53-4d0d-b2ec-69b44cec937e service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:07.917123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd561c-0c53-4d0d-b2ec-69b44cec937e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:07.938746 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd561c-0c53-4d0d-b2ec-69b44cec937e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:07.941978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd561c-0c53-4d0d-b2ec-69b44cec937e service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:07.955817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1149/2291] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:21:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:21:12.013505 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e79c7f-3c2e-45f8-b5ee-aec015ce975c None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:12.014371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e79c7f-3c2e-45f8-b5ee-aec015ce975c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:12.014371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e79c7f-3c2e-45f8-b5ee-aec015ce975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:12.037507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-82e79c7f-3c2e-45f8-b5ee-aec015ce975c None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:21:12.038675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-82e79c7f-3c2e-45f8-b5ee-aec015ce975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:12.046262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1143/2292] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:21:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:21:12.071303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd561c-0c53-4d0d-b2ec-69b44cec937e service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:12.083818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd561c-0c53-4d0d-b2ec-69b44cec937e service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:12.089984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb410f13-6b78-482e-902e-30cbef7931cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:12.090594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb410f13-6b78-482e-902e-30cbef7931cc service swift] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:12.090875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb410f13-6b78-482e-902e-30cbef7931cc service swift] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:12.091148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb410f13-6b78-482e-902e-30cbef7931cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:12.100300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb410f13-6b78-482e-902e-30cbef7931cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:12.101921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb410f13-6b78-482e-902e-30cbef7931cc service swift] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:12.111237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1150/2293] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:21:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:21:13.373900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc4be0-5971-4836-95b5-1ff1ef83864c None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:13.374476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc4be0-5971-4836-95b5-1ff1ef83864c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:13.374476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc4be0-5971-4836-95b5-1ff1ef83864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:13.395724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-d3fc4be0-5971-4836-95b5-1ff1ef83864c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:21:13.401410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d3fc4be0-5971-4836-95b5-1ff1ef83864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:13.411933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1144/2294] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 17:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:21:13.453629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb410f13-6b78-482e-902e-30cbef7931cc service swift] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:13.469535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb410f13-6b78-482e-902e-30cbef7931cc service swift] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:13.475538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5674b2e-ef6c-4f55-9c96-e2fee35d6881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:13.476148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5674b2e-ef6c-4f55-9c96-e2fee35d6881 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:13.481909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5674b2e-ef6c-4f55-9c96-e2fee35d6881 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:13.481909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5674b2e-ef6c-4f55-9c96-e2fee35d6881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:13.486190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5674b2e-ef6c-4f55-9c96-e2fee35d6881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:13.487710 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5674b2e-ef6c-4f55-9c96-e2fee35d6881 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:13.497729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1151/2295] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:21:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:21:23.390660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=12 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:21:23.493476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=26 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:21:40.710282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc4be0-5971-4836-95b5-1ff1ef83864c None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:40.766691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc4be0-5971-4836-95b5-1ff1ef83864c None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:40.770767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665bed-1932-494b-b73d-3083f5bfec27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:40.771372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665bed-1932-494b-b73d-3083f5bfec27 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:40.771647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665bed-1932-494b-b73d-3083f5bfec27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:40.771918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09665bed-1932-494b-b73d-3083f5bfec27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:40.773677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-09665bed-1932-494b-b73d-3083f5bfec27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:40.787618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09665bed-1932-494b-b73d-3083f5bfec27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:40.789216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09665bed-1932-494b-b73d-3083f5bfec27 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:40.800715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1145/2296] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:21:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:21:41.061089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4201-f405-4ae4-85cf-abf5578ea705 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:41.062230 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4201-f405-4ae4-85cf-abf5578ea705 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:41.062476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4201-f405-4ae4-85cf-abf5578ea705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:41.082228 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0ebe4201-f405-4ae4-85cf-abf5578ea705 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:21:41.083460 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0ebe4201-f405-4ae4-85cf-abf5578ea705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:41.091525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1152/2297] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 17:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:21:41.107145 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665bed-1932-494b-b73d-3083f5bfec27 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:41.119071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09665bed-1932-494b-b73d-3083f5bfec27 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:41.125776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a7037-fcab-467e-b98a-cb17a316d0ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:41.126386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a7037-fcab-467e-b98a-cb17a316d0ec service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:41.126664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a7037-fcab-467e-b98a-cb17a316d0ec service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:41.126938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a7037-fcab-467e-b98a-cb17a316d0ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:41.135687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a7037-fcab-467e-b98a-cb17a316d0ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:41.137287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a7037-fcab-467e-b98a-cb17a316d0ec service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:41.143093 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe4201-f405-4ae4-85cf-abf5578ea705 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:41.147749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1146/2298] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:21:41.153317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe4201-f405-4ae4-85cf-abf5578ea705 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:41.157229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135947bc-a4ca-4d53-838c-3fc88a8467f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:41.157832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135947bc-a4ca-4d53-838c-3fc88a8467f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:41.158166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135947bc-a4ca-4d53-838c-3fc88a8467f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:41.158601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135947bc-a4ca-4d53-838c-3fc88a8467f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:41.160456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-135947bc-a4ca-4d53-838c-3fc88a8467f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:41.175020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135947bc-a4ca-4d53-838c-3fc88a8467f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:41.176427 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135947bc-a4ca-4d53-838c-3fc88a8467f6 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:41.188797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1153/2299] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:21:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:21:46.328065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4521-75f7-40a6-a0fa-057cc24bb498 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:46.328973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4521-75f7-40a6-a0fa-057cc24bb498 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:46.328973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a4521-75f7-40a6-a0fa-057cc24bb498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:46.349280 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e57a4521-75f7-40a6-a0fa-057cc24bb498 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:21:46.350500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e57a4521-75f7-40a6-a0fa-057cc24bb498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:46.365466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1147/2300] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 17:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:21:46.381756 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135947bc-a4ca-4d53-838c-3fc88a8467f6 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:46.394037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135947bc-a4ca-4d53-838c-3fc88a8467f6 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:46.399645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afc3c7-3fc0-4406-ab02-5db61c800c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:46.400255 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afc3c7-3fc0-4406-ab02-5db61c800c36 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:46.400551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afc3c7-3fc0-4406-ab02-5db61c800c36 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:46.400817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afc3c7-3fc0-4406-ab02-5db61c800c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:46.409767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afc3c7-3fc0-4406-ab02-5db61c800c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:46.411328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afc3c7-3fc0-4406-ab02-5db61c800c36 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:46.420921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1154/2301] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:21:51.608174 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00caa2f-c5df-4d43-b2a0-f8a5bd5201ab None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:51.608724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00caa2f-c5df-4d43-b2a0-f8a5bd5201ab None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:51.608724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00caa2f-c5df-4d43-b2a0-f8a5bd5201ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:51.627906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-f00caa2f-c5df-4d43-b2a0-f8a5bd5201ab None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:21:51.629138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f00caa2f-c5df-4d43-b2a0-f8a5bd5201ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:51.637704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1148/2302] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 17:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:21:51.655280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afc3c7-3fc0-4406-ab02-5db61c800c36 service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:51.667839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afc3c7-3fc0-4406-ab02-5db61c800c36 service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:51.673512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939affb6-42ff-44c0-ba7e-00ad097dc2d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:51.674120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939affb6-42ff-44c0-ba7e-00ad097dc2d5 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:51.674399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939affb6-42ff-44c0-ba7e-00ad097dc2d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:51.674673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939affb6-42ff-44c0-ba7e-00ad097dc2d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:51.683593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939affb6-42ff-44c0-ba7e-00ad097dc2d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:51.685238 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939affb6-42ff-44c0-ba7e-00ad097dc2d5 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:51.695182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1155/2303] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:21:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:21:55.780063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00caa2f-c5df-4d43-b2a0-f8a5bd5201ab None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:55.798103 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00caa2f-c5df-4d43-b2a0-f8a5bd5201ab None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:55.805027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55859a-a61f-4e9c-886c-1d849a91d184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:55.810112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55859a-a61f-4e9c-886c-1d849a91d184 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:55.810112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55859a-a61f-4e9c-886c-1d849a91d184 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:55.810112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55859a-a61f-4e9c-886c-1d849a91d184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:55.810112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9b55859a-a61f-4e9c-886c-1d849a91d184 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:55.893311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55859a-a61f-4e9c-886c-1d849a91d184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:55.897913 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55859a-a61f-4e9c-886c-1d849a91d184 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:55.909721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1149/2304] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:21:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:21:56.950152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939affb6-42ff-44c0-ba7e-00ad097dc2d5 service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:56.951926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-939affb6-42ff-44c0-ba7e-00ad097dc2d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:56.965134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939affb6-42ff-44c0-ba7e-00ad097dc2d5 service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:56.968853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378a752-15b1-4fb7-a7b0-dbe9b9f2a5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:56.969488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378a752-15b1-4fb7-a7b0-dbe9b9f2a5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:56.969764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378a752-15b1-4fb7-a7b0-dbe9b9f2a5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:56.970031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378a752-15b1-4fb7-a7b0-dbe9b9f2a5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:56.980613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378a752-15b1-4fb7-a7b0-dbe9b9f2a5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:56.982046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378a752-15b1-4fb7-a7b0-dbe9b9f2a5c4 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:56.992608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1156/2305] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:21:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:02.254990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55859a-a61f-4e9c-886c-1d849a91d184 service nova] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:02.268000 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55859a-a61f-4e9c-886c-1d849a91d184 service nova] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:02.276344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4ff64-cf0b-46a3-8c11-303261ffdbbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:02.276344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4ff64-cf0b-46a3-8c11-303261ffdbbd service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:02.276344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4ff64-cf0b-46a3-8c11-303261ffdbbd service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:02.276344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4ff64-cf0b-46a3-8c11-303261ffdbbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:02.280691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8be4ff64-cf0b-46a3-8c11-303261ffdbbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:02.356469 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4ff64-cf0b-46a3-8c11-303261ffdbbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:02.358604 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4ff64-cf0b-46a3-8c11-303261ffdbbd service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:02.373775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1150/2306] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:06.987809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=27 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:09.303623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378a752-15b1-4fb7-a7b0-dbe9b9f2a5c4 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:09.318166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378a752-15b1-4fb7-a7b0-dbe9b9f2a5c4 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:09.324372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20418ec-875b-4a1f-aad9-541d026439ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:09.325008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20418ec-875b-4a1f-aad9-541d026439ea service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:09.325294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20418ec-875b-4a1f-aad9-541d026439ea service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:09.325572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20418ec-875b-4a1f-aad9-541d026439ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:09.327437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a20418ec-875b-4a1f-aad9-541d026439ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:09.394243 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20418ec-875b-4a1f-aad9-541d026439ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:09.395884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20418ec-875b-4a1f-aad9-541d026439ea service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:09.406667 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1157/2307] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:12.364066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=94 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:13.296490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de23a1-99b8-43c3-a39c-cfa1f75986bc None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:13.296490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de23a1-99b8-43c3-a39c-cfa1f75986bc None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:13.296490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de23a1-99b8-43c3-a39c-cfa1f75986bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:13.316219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-d3de23a1-99b8-43c3-a39c-cfa1f75986bc None None] MFA Rules not processed for user `751a93746a5248cb9ec450b315282f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:13.317845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d3de23a1-99b8-43c3-a39c-cfa1f75986bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:13.326511 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1151/2308] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:22:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:13.939556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20418ec-875b-4a1f-aad9-541d026439ea service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:13.951149 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20418ec-875b-4a1f-aad9-541d026439ea service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:13.956017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafb697-70ba-4ed3-80d7-9fb9a9d8b6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:13.956942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb697-70ba-4ed3-80d7-9fb9a9d8b6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:13.957422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb697-70ba-4ed3-80d7-9fb9a9d8b6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:13.957748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb697-70ba-4ed3-80d7-9fb9a9d8b6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:13.961113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7fafb697-70ba-4ed3-80d7-9fb9a9d8b6b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:13.977572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafb697-70ba-4ed3-80d7-9fb9a9d8b6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:13.979721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafb697-70ba-4ed3-80d7-9fb9a9d8b6b4 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:13.995036 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1158/2309] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:16.642836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da0ab5-e7e9-41f4-8fec-12454201c310 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:16.643363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da0ab5-e7e9-41f4-8fec-12454201c310 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:16.643363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da0ab5-e7e9-41f4-8fec-12454201c310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:16.662320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a0da0ab5-e7e9-41f4-8fec-12454201c310 None None] MFA Rules not processed for user `b82957c28fd4475fa726f460ef7f5219`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:16.663809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a0da0ab5-e7e9-41f4-8fec-12454201c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:16.720291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1152/2310] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:22:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:16.815736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafb697-70ba-4ed3-80d7-9fb9a9d8b6b4 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:16.831623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafb697-70ba-4ed3-80d7-9fb9a9d8b6b4 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:16.839838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e2dd3-5948-452d-9968-17a21e366d14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:16.840771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e2dd3-5948-452d-9968-17a21e366d14 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:16.841248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e2dd3-5948-452d-9968-17a21e366d14 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:16.841727 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e2dd3-5948-452d-9968-17a21e366d14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:16.843877 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2c8e2dd3-5948-452d-9968-17a21e366d14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:16.928107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e2dd3-5948-452d-9968-17a21e366d14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:16.929777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e2dd3-5948-452d-9968-17a21e366d14 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:16.940891 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1159/2311] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:16.986160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da0ab5-e7e9-41f4-8fec-12454201c310 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:16.997642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da0ab5-e7e9-41f4-8fec-12454201c310 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:17.001250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4f25-e492-46cd-a5ad-eb9d64f9450f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:17.001922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4f25-e492-46cd-a5ad-eb9d64f9450f service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:17.002144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4f25-e492-46cd-a5ad-eb9d64f9450f service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:17.002412 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac4f25-e492-46cd-a5ad-eb9d64f9450f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:17.004411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b5ac4f25-e492-46cd-a5ad-eb9d64f9450f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:17.014841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4f25-e492-46cd-a5ad-eb9d64f9450f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:17.016463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac4f25-e492-46cd-a5ad-eb9d64f9450f service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:17.026487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1153/2312] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:17.485411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e2dd3-5948-452d-9968-17a21e366d14 service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:17.487031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2c8e2dd3-5948-452d-9968-17a21e366d14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:17.610782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e2dd3-5948-452d-9968-17a21e366d14 service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:17.620976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e68ff-1625-4b4c-aa11-3d7e8661ca52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a698e566a46841cf83aa1711e83f8829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:17.621614 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e68ff-1625-4b4c-aa11-3d7e8661ca52 service placement] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:17.621922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e68ff-1625-4b4c-aa11-3d7e8661ca52 service placement] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:17.622195 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e68ff-1625-4b4c-aa11-3d7e8661ca52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:17.624180 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-551e68ff-1625-4b4c-aa11-3d7e8661ca52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:17.637080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e68ff-1625-4b4c-aa11-3d7e8661ca52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:17.638688 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e68ff-1625-4b4c-aa11-3d7e8661ca52 service placement] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:17.653368 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1160/2313] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:22.261512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4f25-e492-46cd-a5ad-eb9d64f9450f service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:22.281360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac4f25-e492-46cd-a5ad-eb9d64f9450f service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:22.288066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fba72-0a1c-419e-8297-4264f5b425c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:22.289100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fba72-0a1c-419e-8297-4264f5b425c4 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:22.289533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fba72-0a1c-419e-8297-4264f5b425c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:22.289847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fba72-0a1c-419e-8297-4264f5b425c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:22.291776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-504fba72-0a1c-419e-8297-4264f5b425c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:22.307817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fba72-0a1c-419e-8297-4264f5b425c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:22.310773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fba72-0a1c-419e-8297-4264f5b425c4 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:22.327722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1154/2314] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:23.607226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e68ff-1625-4b4c-aa11-3d7e8661ca52 service placement] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:23.624927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e68ff-1625-4b4c-aa11-3d7e8661ca52 service placement] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:23.632396 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0d75d-be9f-4a27-afa0-862e2a493d73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:23.633835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0d75d-be9f-4a27-afa0-862e2a493d73 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:23.634274 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0d75d-be9f-4a27-afa0-862e2a493d73 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:23.634975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0d75d-be9f-4a27-afa0-862e2a493d73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:23.639472 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c3b0d75d-be9f-4a27-afa0-862e2a493d73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:23.670855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0d75d-be9f-4a27-afa0-862e2a493d73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:23.676327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0d75d-be9f-4a27-afa0-862e2a493d73 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:23.691060 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:23.694357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1161/2315] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:32.323218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=40 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:34.278049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601c714-a766-4da3-bfa1-7c73c485dd47 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:34.278838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601c714-a766-4da3-bfa1-7c73c485dd47 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:34.278838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601c714-a766-4da3-bfa1-7c73c485dd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:34.302521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5601c714-a766-4da3-bfa1-7c73c485dd47 None None] MFA Rules not processed for user `60efa77075d94402a0cb8e9e427772cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:34.303743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5601c714-a766-4da3-bfa1-7c73c485dd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:34.311164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1155/2316] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:22:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:34.678844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0d75d-be9f-4a27-afa0-862e2a493d73 service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:34.695033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0d75d-be9f-4a27-afa0-862e2a493d73 service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:34.701548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf9e2b-e609-4fba-b334-2eea3bb41006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:34.702306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf9e2b-e609-4fba-b334-2eea3bb41006 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:34.702759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf9e2b-e609-4fba-b334-2eea3bb41006 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:34.703157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf9e2b-e609-4fba-b334-2eea3bb41006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:34.705716 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-07bf9e2b-e609-4fba-b334-2eea3bb41006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:34.718485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf9e2b-e609-4fba-b334-2eea3bb41006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:34.720892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf9e2b-e609-4fba-b334-2eea3bb41006 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:34.732504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1162/2317] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:35.726207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024807f0-6562-4442-94e3-227821e374aa None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:35.726782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024807f0-6562-4442-94e3-227821e374aa None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:35.726885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024807f0-6562-4442-94e3-227821e374aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:35.745387 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-024807f0-6562-4442-94e3-227821e374aa None None] MFA Rules not processed for user `9b22f661cc524dd2a58a499badb8e661`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:35.746600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-024807f0-6562-4442-94e3-227821e374aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:35.753549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1156/2318] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:22:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:39.421648 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff1f98-6741-4650-a164-3f0d4581c46e None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:39.422725 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff1f98-6741-4650-a164-3f0d4581c46e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:39.423268 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff1f98-6741-4650-a164-3f0d4581c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:39.449699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-bdff1f98-6741-4650-a164-3f0d4581c46e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:39.451265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bdff1f98-6741-4650-a164-3f0d4581c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:39.460314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1163/2319] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 17:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:22:39.498129 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024807f0-6562-4442-94e3-227821e374aa None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:39.521368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024807f0-6562-4442-94e3-227821e374aa None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:39.527753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7dcce-7729-4a7c-9d4f-eca1bec00378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:39.534775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7dcce-7729-4a7c-9d4f-eca1bec00378 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:39.534775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7dcce-7729-4a7c-9d4f-eca1bec00378 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:39.534775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7dcce-7729-4a7c-9d4f-eca1bec00378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:39.541920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7dcce-7729-4a7c-9d4f-eca1bec00378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:39.544111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7dcce-7729-4a7c-9d4f-eca1bec00378 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:39.568695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1157/2320] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:43.984516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8cac7-e2ca-458f-b473-310af5cbd5fa None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:43.985100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8cac7-e2ca-458f-b473-310af5cbd5fa None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:43.985188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8cac7-e2ca-458f-b473-310af5cbd5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:44.005526 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-6ab8cac7-e2ca-458f-b473-310af5cbd5fa None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:44.007336 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6ab8cac7-e2ca-458f-b473-310af5cbd5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:44.015464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1164/2321] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 17:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:44.030395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7dcce-7729-4a7c-9d4f-eca1bec00378 service nova] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:44.042130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7dcce-7729-4a7c-9d4f-eca1bec00378 service nova] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:44.047618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8537c-7ab4-4281-ae44-d566515dad52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:44.048214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8537c-7ab4-4281-ae44-d566515dad52 service nova] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:44.048541 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8537c-7ab4-4281-ae44-d566515dad52 service nova] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:44.048811 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8537c-7ab4-4281-ae44-d566515dad52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:44.057383 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8537c-7ab4-4281-ae44-d566515dad52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:44.058937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8537c-7ab4-4281-ae44-d566515dad52 service nova] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:44.068677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1158/2322] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:47.635819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8cac7-e2ca-458f-b473-310af5cbd5fa None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:47.650024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8cac7-e2ca-458f-b473-310af5cbd5fa None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:47.656158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff90fad-630b-4d4d-843f-5e3c0cc36470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:47.656967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff90fad-630b-4d4d-843f-5e3c0cc36470 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:47.657262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff90fad-630b-4d4d-843f-5e3c0cc36470 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:47.657541 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff90fad-630b-4d4d-843f-5e3c0cc36470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:47.659416 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1ff90fad-630b-4d4d-843f-5e3c0cc36470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:47.673364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff90fad-630b-4d4d-843f-5e3c0cc36470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:47.674961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff90fad-630b-4d4d-843f-5e3c0cc36470 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:47.688517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1165/2323] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:54.064093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=18 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:55.125793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079213a5-f554-409c-ac32-1dfa80b3c0c4 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:55.126575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079213a5-f554-409c-ac32-1dfa80b3c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:55.126575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079213a5-f554-409c-ac32-1dfa80b3c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:55.226596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-079213a5-f554-409c-ac32-1dfa80b3c0c4 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:55.227863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-079213a5-f554-409c-ac32-1dfa80b3c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:55.314297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1159/2324] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 17:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:55.331269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff90fad-630b-4d4d-843f-5e3c0cc36470 service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:55.393642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff90fad-630b-4d4d-843f-5e3c0cc36470 service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:55.402506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffefa39-8082-4262-9e80-fbc2f2cf4504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:55.403139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffefa39-8082-4262-9e80-fbc2f2cf4504 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:55.403428 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffefa39-8082-4262-9e80-fbc2f2cf4504 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:55.403705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffefa39-8082-4262-9e80-fbc2f2cf4504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:55.413878 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffefa39-8082-4262-9e80-fbc2f2cf4504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:55.415665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffefa39-8082-4262-9e80-fbc2f2cf4504 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:55.428164 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1166/2325] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:23:00.452328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65773a-67d5-4932-ac83-97531acc838d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:00.452904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65773a-67d5-4932-ac83-97531acc838d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:00.452904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65773a-67d5-4932-ac83-97531acc838d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:00.472675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6b65773a-67d5-4932-ac83-97531acc838d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:00.473879 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6b65773a-67d5-4932-ac83-97531acc838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:00.482491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1160/2326] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 17:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:00.498101 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffefa39-8082-4262-9e80-fbc2f2cf4504 service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:00.510751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffefa39-8082-4262-9e80-fbc2f2cf4504 service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:00.516986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa613e-43cb-4b5f-b80f-cb4ed6b23901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:00.517592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa613e-43cb-4b5f-b80f-cb4ed6b23901 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:00.517920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa613e-43cb-4b5f-b80f-cb4ed6b23901 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:00.518142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa613e-43cb-4b5f-b80f-cb4ed6b23901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:00.527402 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa613e-43cb-4b5f-b80f-cb4ed6b23901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:00.529074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa613e-43cb-4b5f-b80f-cb4ed6b23901 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:00.539839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1167/2327] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:23:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:23:05.771670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dfd72-ae3e-4fb9-870a-fd053fed79a7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:05.772182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dfd72-ae3e-4fb9-870a-fd053fed79a7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:05.772307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dfd72-ae3e-4fb9-870a-fd053fed79a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:05.792873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1a1dfd72-ae3e-4fb9-870a-fd053fed79a7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:05.794180 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1a1dfd72-ae3e-4fb9-870a-fd053fed79a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:05.804194 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1161/2328] 10.222.0.30 () {58 vars in 1016 bytes} [Wed Aug 24 17:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:05.822311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa613e-43cb-4b5f-b80f-cb4ed6b23901 service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:05.827938 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=45 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:05.833831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa613e-43cb-4b5f-b80f-cb4ed6b23901 service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:05.839994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05827e5-90f6-4edb-a787-e72292279cd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8af51476b48e45efbc3b626f9780e0be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:05.840648 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05827e5-90f6-4edb-a787-e72292279cd1 service nova] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:05.840931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05827e5-90f6-4edb-a787-e72292279cd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:05.841203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05827e5-90f6-4edb-a787-e72292279cd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:05.850676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05827e5-90f6-4edb-a787-e72292279cd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:05.852325 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05827e5-90f6-4edb-a787-e72292279cd1 service nova] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:05.862401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1168/2329] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:23:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:23:15.786890 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=51 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:15.865514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=5 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:31.355241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b8c9c-044f-4c50-9bb6-b7d2e90c0a08 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:31.356002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b8c9c-044f-4c50-9bb6-b7d2e90c0a08 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:31.356002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b8c9c-044f-4c50-9bb6-b7d2e90c0a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:31.375689 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-9b8b8c9c-044f-4c50-9bb6-b7d2e90c0a08 None None] MFA Rules not processed for user `a0ad0c892c464a7ab40a683ca588963a`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:31.376991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9b8b8c9c-044f-4c50-9bb6-b7d2e90c0a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:31.385400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1162/2330] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:23:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:41.370406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:45.396739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05827e5-90f6-4edb-a787-e72292279cd1 service nova] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:45.398931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d05827e5-90f6-4edb-a787-e72292279cd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:45.415398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05827e5-90f6-4edb-a787-e72292279cd1 service nova] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:45.427530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00b5c-a890-4fed-98be-afa337040cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:45.428764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00b5c-a890-4fed-98be-afa337040cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:45.429162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00b5c-a890-4fed-98be-afa337040cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:45.429619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00b5c-a890-4fed-98be-afa337040cd9 admin admin] PATH_INFO: `/v3/users/b82957c28fd4475fa726f460ef7f5219` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:45.431001 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb00b5c-a890-4fed-98be-afa337040cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82957c28fd4475fa726f460ef7f5219)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:45.435681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb00b5c-a890-4fed-98be-afa337040cd9 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:45.655627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bbb00b5c-a890-4fed-98be-afa337040cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82957c28fd4475fa726f460ef7f5219'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:45.656344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bbb00b5c-a890-4fed-98be-afa337040cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82957c28fd4475fa726f460ef7f5219'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:45.665466 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bbb00b5c-a890-4fed-98be-afa337040cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82957c28fd4475fa726f460ef7f5219'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:45.666335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bbb00b5c-a890-4fed-98be-afa337040cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82957c28fd4475fa726f460ef7f5219'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:45.682109 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bbb00b5c-a890-4fed-98be-afa337040cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82957c28fd4475fa726f460ef7f5219'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:45.775533 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1169/2331] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:23:45 2022] DELETE /identity/v3/users/b82957c28fd4475fa726f460ef7f5219 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:23:46.158155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b8c9c-044f-4c50-9bb6-b7d2e90c0a08 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:46.176140 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b8c9c-044f-4c50-9bb6-b7d2e90c0a08 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:46.259140 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:46.259891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:46.260195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:46.260556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] PATH_INFO: `/v3/projects/fc52ad9fd7044928bc782a8e9e8ffa3c` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:46.261856 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc52ad9fd7044928bc782a8e9e8ffa3c)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:46.263960 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:46.391187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc52ad9fd7044928bc782a8e9e8ffa3c', 'request_id': 'req-67b044fe-9530-4d5e-b0ac-07a378013a28'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:46.460525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc52ad9fd7044928bc782a8e9e8ffa3c', 'request_id': 'req-67b044fe-9530-4d5e-b0ac-07a378013a28'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:46.471986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc52ad9fd7044928bc782a8e9e8ffa3c', 'request_id': 'req-67b044fe-9530-4d5e-b0ac-07a378013a28'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:46.492339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] The token cache is being invalidate because project fc52ad9fd7044928bc782a8e9e8ffa3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:23:46.492868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:46.494029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-67b044fe-9530-4d5e-b0ac-07a378013a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:46.497215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1163/2332] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:23:46 2022] DELETE /identity/v3/projects/fc52ad9fd7044928bc782a8e9e8ffa3c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:23:46.503509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde682d-2917-46a9-9c05-e4942aaf6cf0 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:46.505129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde682d-2917-46a9-9c05-e4942aaf6cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:46.505678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde682d-2917-46a9-9c05-e4942aaf6cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:46.541182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-efde682d-2917-46a9-9c05-e4942aaf6cf0 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:46.542451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-efde682d-2917-46a9-9c05-e4942aaf6cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:46.621711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1170/2333] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:23:46.629640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f153-7b7e-46f1-b73e-1cd944e0ba99 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:46.629983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f153-7b7e-46f1-b73e-1cd944e0ba99 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:46.630288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f153-7b7e-46f1-b73e-1cd944e0ba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:46.652131 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-c841f153-7b7e-46f1-b73e-1cd944e0ba99 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:46.653438 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c841f153-7b7e-46f1-b73e-1cd944e0ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:46.663371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1164/2334] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:46.672701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde682d-2917-46a9-9c05-e4942aaf6cf0 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:46.683314 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde682d-2917-46a9-9c05-e4942aaf6cf0 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:46.688657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2219b7-0f4b-4cbb-94e4-58565a43c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:46.689278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2219b7-0f4b-4cbb-94e4-58565a43c906 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:46.689584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2219b7-0f4b-4cbb-94e4-58565a43c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:46.689855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2219b7-0f4b-4cbb-94e4-58565a43c906 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:46.690507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2219b7-0f4b-4cbb-94e4-58565a43c906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:23:46.690810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2219b7-0f4b-4cbb-94e4-58565a43c906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:46.692775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2219b7-0f4b-4cbb-94e4-58565a43c906 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:46.707141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1171/2335] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:23:46.711878 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841f153-7b7e-46f1-b73e-1cd944e0ba99 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:46.721610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841f153-7b7e-46f1-b73e-1cd944e0ba99 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:46.727031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c5479-5a97-4a9c-a222-eb44de1500d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:46.727650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c5479-5a97-4a9c-a222-eb44de1500d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:46.727956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c5479-5a97-4a9c-a222-eb44de1500d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:46.728259 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c5479-5a97-4a9c-a222-eb44de1500d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:46.728904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c5479-5a97-4a9c-a222-eb44de1500d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:46.730819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c5479-5a97-4a9c-a222-eb44de1500d2 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:46.866923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1165/2336] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:23:46 2022] POST /identity/v3/projects => generated 395 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:23:46.871465 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2219b7-0f4b-4cbb-94e4-58565a43c906 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:46.884130 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2219b7-0f4b-4cbb-94e4-58565a43c906 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:46.949577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66f26-c863-4f38-8099-b7ca3a49fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:46.951242 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66f26-c863-4f38-8099-b7ca3a49fda1 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:46.951242 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66f26-c863-4f38-8099-b7ca3a49fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:46.951242 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66f26-c863-4f38-8099-b7ca3a49fda1 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:46.951936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66f26-c863-4f38-8099-b7ca3a49fda1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:46.953773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66f26-c863-4f38-8099-b7ca3a49fda1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:46.962908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:47.084644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1172/2337] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:23:46 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:23:47.086624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c5479-5a97-4a9c-a222-eb44de1500d2 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:47.098912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c5479-5a97-4a9c-a222-eb44de1500d2 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:47.104279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744989f-2a18-4081-9326-1172b83b1ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:47.104935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744989f-2a18-4081-9326-1172b83b1ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:47.105222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744989f-2a18-4081-9326-1172b83b1ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:47.105539 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744989f-2a18-4081-9326-1172b83b1ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:47.106269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744989f-2a18-4081-9326-1172b83b1ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:47.108181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744989f-2a18-4081-9326-1172b83b1ed4 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:47.120872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1166/2338] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:23:47.125529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66f26-c863-4f38-8099-b7ca3a49fda1 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:47.139510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66f26-c863-4f38-8099-b7ca3a49fda1 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:47.146065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a1f62-cbe2-4a62-8662-e031b8347c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:47.146838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a1f62-cbe2-4a62-8662-e031b8347c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:47.147121 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a1f62-cbe2-4a62-8662-e031b8347c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:47.147463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a1f62-cbe2-4a62-8662-e031b8347c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:47.148189 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a1f62-cbe2-4a62-8662-e031b8347c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:47.150005 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a1f62-cbe2-4a62-8662-e031b8347c0a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:47.165270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1173/2339] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:23:47.170954 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744989f-2a18-4081-9326-1172b83b1ed4 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:47.195098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744989f-2a18-4081-9326-1172b83b1ed4 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:47.201224 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d62dd-c112-4b75-94b4-1bce16417683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:47.202284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d62dd-c112-4b75-94b4-1bce16417683 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:47.202640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d62dd-c112-4b75-94b4-1bce16417683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:47.203138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d62dd-c112-4b75-94b4-1bce16417683 admin admin] PATH_INFO: `/v3/projects/981cb9469318451484f3f5160663e241/users/a864c52f2a8d4de28a3a2fb25b1b9e80/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:47.227376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d62dd-c112-4b75-94b4-1bce16417683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981cb9469318451484f3f5160663e241, user_id=a864c52f2a8d4de28a3a2fb25b1b9e80, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:47.231284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d62dd-c112-4b75-94b4-1bce16417683 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:47.329130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1167/2340] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:23:47 2022] PUT /identity/v3/projects/981cb9469318451484f3f5160663e241/users/a864c52f2a8d4de28a3a2fb25b1b9e80/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:23:47.340683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9f42d-4600-43ec-84cc-b6a4ecde77a0 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:47.341015 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9f42d-4600-43ec-84cc-b6a4ecde77a0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:47.341290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9f42d-4600-43ec-84cc-b6a4ecde77a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:47.371842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-2be9f42d-4600-43ec-84cc-b6a4ecde77a0 None None] MFA Rules not processed for user `a864c52f2a8d4de28a3a2fb25b1b9e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:47.373114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2be9f42d-4600-43ec-84cc-b6a4ecde77a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:47.449933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1174/2341] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:23:47 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:47.464177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d62dd-c112-4b75-94b4-1bce16417683 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:47.466269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-619d62dd-c112-4b75-94b4-1bce16417683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:47.495112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:47.611638 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d62dd-c112-4b75-94b4-1bce16417683 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:47.619401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764abc4-c7fc-4c41-a1b1-56093fb44d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:47.620550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764abc4-c7fc-4c41-a1b1-56093fb44d17 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:47.620893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764abc4-c7fc-4c41-a1b1-56093fb44d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:47.621308 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764abc4-c7fc-4c41-a1b1-56093fb44d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:47.638724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764abc4-c7fc-4c41-a1b1-56093fb44d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:47.640506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764abc4-c7fc-4c41-a1b1-56093fb44d17 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:47.654248 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1168/2342] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:23:47 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:23:53.554091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9f42d-4600-43ec-84cc-b6a4ecde77a0 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:53.555543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2be9f42d-4600-43ec-84cc-b6a4ecde77a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:53.650040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9f42d-4600-43ec-84cc-b6a4ecde77a0 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:53.653898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a26f1-0024-4d67-9b4e-5730bc68e7e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:53.654543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a26f1-0024-4d67-9b4e-5730bc68e7e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:53.654847 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a26f1-0024-4d67-9b4e-5730bc68e7e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:53.655122 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a26f1-0024-4d67-9b4e-5730bc68e7e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:53.656978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7c6a26f1-0024-4d67-9b4e-5730bc68e7e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:53.722808 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a26f1-0024-4d67-9b4e-5730bc68e7e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:53.725308 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a26f1-0024-4d67-9b4e-5730bc68e7e5 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:53.729395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:53.736163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1175/2343] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:23:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:23:54.881768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764abc4-c7fc-4c41-a1b1-56093fb44d17 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:54.904982 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764abc4-c7fc-4c41-a1b1-56093fb44d17 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:54.914444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:54.918101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:54.918101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:54.918101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] PATH_INFO: `/v3/users/a864c52f2a8d4de28a3a2fb25b1b9e80` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:54.919008 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a864c52f2a8d4de28a3a2fb25b1b9e80)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:54.923305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:55.468283 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a864c52f2a8d4de28a3a2fb25b1b9e80'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:55.469154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a864c52f2a8d4de28a3a2fb25b1b9e80'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:55.469828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a864c52f2a8d4de28a3a2fb25b1b9e80'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:55.482852 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a864c52f2a8d4de28a3a2fb25b1b9e80'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:55.584363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a864c52f2a8d4de28a3a2fb25b1b9e80'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:55.602014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1169/2344] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:23:54 2022] DELETE /identity/v3/users/a864c52f2a8d4de28a3a2fb25b1b9e80 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:23:55.611291 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd8ff-38c4-480f-ab21-7a48243a8758 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:55.611291 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd8ff-38c4-480f-ab21-7a48243a8758 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:55.611291 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bd8ff-38c4-480f-ab21-7a48243a8758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:55.630530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-e79bd8ff-38c4-480f-ab21-7a48243a8758 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:55.631796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e79bd8ff-38c4-480f-ab21-7a48243a8758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:55.714627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1176/2345] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:23:55.741785 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:55.744506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:55.832005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9489b10-0cf9-4676-8b77-e590ac21b73a admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:55.842455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1b756-63e9-4961-8469-b4d5445d0f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:55.842455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1b756-63e9-4961-8469-b4d5445d0f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:55.842455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1b756-63e9-4961-8469-b4d5445d0f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:55.842455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1b756-63e9-4961-8469-b4d5445d0f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:55.851062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1b756-63e9-4961-8469-b4d5445d0f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:55.852687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1b756-63e9-4961-8469-b4d5445d0f75 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:55.867340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1170/2346] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:23:56.415317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bd8ff-38c4-480f-ab21-7a48243a8758 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:56.417768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-e79bd8ff-38c4-480f-ab21-7a48243a8758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:56.436406 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bd8ff-38c4-480f-ab21-7a48243a8758 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:56.445252 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:56.446369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:56.446689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:56.447185 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] PATH_INFO: `/v3/projects/981cb9469318451484f3f5160663e241` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:56.448686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=981cb9469318451484f3f5160663e241)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:56.455846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:56.587799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981cb9469318451484f3f5160663e241', 'request_id': 'req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:56.664884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981cb9469318451484f3f5160663e241', 'request_id': 'req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:56.672722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981cb9469318451484f3f5160663e241', 'request_id': 'req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:56.685997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] The token cache is being invalidate because project 981cb9469318451484f3f5160663e241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:23:56.689432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:56.689432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:56.689432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1177/2347] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:23:56 2022] DELETE /identity/v3/projects/981cb9469318451484f3f5160663e241 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:23:58.154698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1b756-63e9-4961-8469-b4d5445d0f75 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:58.156260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8ec1b756-63e9-4961-8469-b4d5445d0f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:58.170102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1b756-63e9-4961-8469-b4d5445d0f75 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:58.174232 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:58.232451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0016e-ac4a-49d7-aca4-f82e36a5d70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:58.233094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0016e-ac4a-49d7-aca4-f82e36a5d70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:58.233371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0016e-ac4a-49d7-aca4-f82e36a5d70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:58.233643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0016e-ac4a-49d7-aca4-f82e36a5d70f admin admin] PATH_INFO: `/v3/users/751a93746a5248cb9ec450b315282f60` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:58.234994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0016e-ac4a-49d7-aca4-f82e36a5d70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=751a93746a5248cb9ec450b315282f60)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:58.237427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0016e-ac4a-49d7-aca4-f82e36a5d70f admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:58.439593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5bd0016e-ac4a-49d7-aca4-f82e36a5d70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751a93746a5248cb9ec450b315282f60'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:58.440429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5bd0016e-ac4a-49d7-aca4-f82e36a5d70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751a93746a5248cb9ec450b315282f60'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:58.441119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5bd0016e-ac4a-49d7-aca4-f82e36a5d70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751a93746a5248cb9ec450b315282f60'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:58.454510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5bd0016e-ac4a-49d7-aca4-f82e36a5d70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751a93746a5248cb9ec450b315282f60'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:58.538864 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5bd0016e-ac4a-49d7-aca4-f82e36a5d70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751a93746a5248cb9ec450b315282f60'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:58.552300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1171/2348] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:23:58 2022] DELETE /identity/v3/users/751a93746a5248cb9ec450b315282f60 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:23:58.866926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:58.868805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:58.884293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f8d1a-bd22-4e60-8e17-2314a1a4e379 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:58.946610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:58.947257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:58.947536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:58.947805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] PATH_INFO: `/v3/projects/450f1824b50f4d99acf0aa424efb0922` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:58.949053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=450f1824b50f4d99acf0aa424efb0922)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:58.950996 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:58.977927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:59.056125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450f1824b50f4d99acf0aa424efb0922', 'request_id': 'req-f1ed6bf6-c8c3-45d5-8619-2db985e02243'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:59.120372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450f1824b50f4d99acf0aa424efb0922', 'request_id': 'req-f1ed6bf6-c8c3-45d5-8619-2db985e02243'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:59.127138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450f1824b50f4d99acf0aa424efb0922', 'request_id': 'req-f1ed6bf6-c8c3-45d5-8619-2db985e02243'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:59.138870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] The token cache is being invalidate because project 450f1824b50f4d99acf0aa424efb0922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:23:59.139080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:59.139718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f1ed6bf6-c8c3-45d5-8619-2db985e02243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:59.141236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1178/2349] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:23:58 2022] DELETE /identity/v3/projects/450f1824b50f4d99acf0aa424efb0922 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:23:59.147288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9089-f39c-426d-9cfd-b84f8b289022 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.147593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9089-f39c-426d-9cfd-b84f8b289022 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.147884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be9089-f39c-426d-9cfd-b84f8b289022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.170149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-09be9089-f39c-426d-9cfd-b84f8b289022 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:59.172237 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-09be9089-f39c-426d-9cfd-b84f8b289022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:59.243228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1172/2350] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:59.251177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75673991-50e8-4d92-9177-7c1a955cf712 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.251483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75673991-50e8-4d92-9177-7c1a955cf712 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.251756 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75673991-50e8-4d92-9177-7c1a955cf712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.272523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-75673991-50e8-4d92-9177-7c1a955cf712 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:59.273735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-75673991-50e8-4d92-9177-7c1a955cf712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:59.282564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1179/2351] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:59.289342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be9089-f39c-426d-9cfd-b84f8b289022 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.300148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be9089-f39c-426d-9cfd-b84f8b289022 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.306179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a35ac-4286-4581-8946-8588f5e21f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.306413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a35ac-4286-4581-8946-8588f5e21f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.306662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a35ac-4286-4581-8946-8588f5e21f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.306934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a35ac-4286-4581-8946-8588f5e21f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.307585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a35ac-4286-4581-8946-8588f5e21f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:23:59.308019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a35ac-4286-4581-8946-8588f5e21f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.309684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a35ac-4286-4581-8946-8588f5e21f70 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.322770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1173/2352] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:23:59.327359 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75673991-50e8-4d92-9177-7c1a955cf712 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.337842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75673991-50e8-4d92-9177-7c1a955cf712 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.342866 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce5b0d-29b8-47a5-bfa8-d3a7cab9e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.343490 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5b0d-29b8-47a5-bfa8-d3a7cab9e554 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.343764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5b0d-29b8-47a5-bfa8-d3a7cab9e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.344173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5b0d-29b8-47a5-bfa8-d3a7cab9e554 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.344849 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce5b0d-29b8-47a5-bfa8-d3a7cab9e554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.346770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce5b0d-29b8-47a5-bfa8-d3a7cab9e554 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.472135 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1180/2353] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:23:59 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:23:59.477866 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a35ac-4286-4581-8946-8588f5e21f70 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.488057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a35ac-4286-4581-8946-8588f5e21f70 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.509431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:59.564762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfb836-8f6e-42f8-9c5a-7b900a543e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.565377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb836-8f6e-42f8-9c5a-7b900a543e96 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.565663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb836-8f6e-42f8-9c5a-7b900a543e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.565934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfb836-8f6e-42f8-9c5a-7b900a543e96 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.567238 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfb836-8f6e-42f8-9c5a-7b900a543e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.569316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbfb836-8f6e-42f8-9c5a-7b900a543e96 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.711203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1174/2354] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:23:59 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:23:59.715510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce5b0d-29b8-47a5-bfa8-d3a7cab9e554 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.726539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce5b0d-29b8-47a5-bfa8-d3a7cab9e554 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.731350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af560fe-807c-4baf-8434-4812adcf478f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.731957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af560fe-807c-4baf-8434-4812adcf478f admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.732249 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af560fe-807c-4baf-8434-4812adcf478f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.732560 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af560fe-807c-4baf-8434-4812adcf478f admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.733184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af560fe-807c-4baf-8434-4812adcf478f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.734781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af560fe-807c-4baf-8434-4812adcf478f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.745719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1181/2355] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:23:59.750343 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfb836-8f6e-42f8-9c5a-7b900a543e96 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.760945 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfb836-8f6e-42f8-9c5a-7b900a543e96 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.765929 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb8522-d6de-4f57-860e-922f3e954d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.766535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb8522-d6de-4f57-860e-922f3e954d32 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.766814 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb8522-d6de-4f57-860e-922f3e954d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.767210 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb8522-d6de-4f57-860e-922f3e954d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.767867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb8522-d6de-4f57-860e-922f3e954d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.769530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb8522-d6de-4f57-860e-922f3e954d32 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.782443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1175/2356] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:23:59.787321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af560fe-807c-4baf-8434-4812adcf478f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.797608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af560fe-807c-4baf-8434-4812adcf478f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.803332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b244e6-a988-4a2d-8b9b-18b7e2d3a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.803990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b244e6-a988-4a2d-8b9b-18b7e2d3a2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.804302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b244e6-a988-4a2d-8b9b-18b7e2d3a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.804582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b244e6-a988-4a2d-8b9b-18b7e2d3a2c4 admin admin] PATH_INFO: `/v3/projects/8a298e2e28584ae68234a851e4ce1ed3/users/aff98d15297d4dcea634aa0c3667c629/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.821848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b244e6-a988-4a2d-8b9b-18b7e2d3a2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a298e2e28584ae68234a851e4ce1ed3, user_id=aff98d15297d4dcea634aa0c3667c629, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.824717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b244e6-a988-4a2d-8b9b-18b7e2d3a2c4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.904827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1182/2357] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:23:59 2022] PUT /identity/v3/projects/8a298e2e28584ae68234a851e4ce1ed3/users/aff98d15297d4dcea634aa0c3667c629/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:23:59.916091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb7d70-00d0-42d9-9805-6c10058c09b4 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.916517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb7d70-00d0-42d9-9805-6c10058c09b4 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.916799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb7d70-00d0-42d9-9805-6c10058c09b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.947721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-dddb7d70-00d0-42d9-9805-6c10058c09b4 None None] MFA Rules not processed for user `aff98d15297d4dcea634aa0c3667c629`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:59.949163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-dddb7d70-00d0-42d9-9805-6c10058c09b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:00.018996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1176/2358] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:23:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:00.024445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b244e6-a988-4a2d-8b9b-18b7e2d3a2c4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:00.096137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b244e6-a988-4a2d-8b9b-18b7e2d3a2c4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:00.101562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09c8c1-37ab-459b-b250-bc6eccede830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:00.102166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09c8c1-37ab-459b-b250-bc6eccede830 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.102440 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09c8c1-37ab-459b-b250-bc6eccede830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.102707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09c8c1-37ab-459b-b250-bc6eccede830 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.103319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09c8c1-37ab-459b-b250-bc6eccede830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:00.105242 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09c8c1-37ab-459b-b250-bc6eccede830 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:00.220768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1183/2359] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:24:00 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:00.225710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb7d70-00d0-42d9-9805-6c10058c09b4 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:00.237175 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb7d70-00d0-42d9-9805-6c10058c09b4 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:00.298870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb32a5-af1a-4788-a5e4-b78addd6c99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:00.299551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb32a5-af1a-4788-a5e4-b78addd6c99b admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.299940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb32a5-af1a-4788-a5e4-b78addd6c99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.299940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb32a5-af1a-4788-a5e4-b78addd6c99b admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.300754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb32a5-af1a-4788-a5e4-b78addd6c99b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:00.302777 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb32a5-af1a-4788-a5e4-b78addd6c99b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:00.412892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1177/2360] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:24:00 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:00.417636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09c8c1-37ab-459b-b250-bc6eccede830 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:00.428627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09c8c1-37ab-459b-b250-bc6eccede830 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:00.433340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138d16c-c385-4acc-9111-9760fd4438b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:00.433955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d16c-c385-4acc-9111-9760fd4438b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.434237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d16c-c385-4acc-9111-9760fd4438b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.434545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138d16c-c385-4acc-9111-9760fd4438b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.435240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138d16c-c385-4acc-9111-9760fd4438b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:00.436895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138d16c-c385-4acc-9111-9760fd4438b9 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:00.449079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1184/2361] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:24:00.453498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb32a5-af1a-4788-a5e4-b78addd6c99b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:00.465025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb32a5-af1a-4788-a5e4-b78addd6c99b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:00.469725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0f41d-83f3-4a7f-ac80-a5fcba9fdb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:00.470389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f41d-83f3-4a7f-ac80-a5fcba9fdb9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.470670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f41d-83f3-4a7f-ac80-a5fcba9fdb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.470945 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0f41d-83f3-4a7f-ac80-a5fcba9fdb9a admin admin] PATH_INFO: `/v3/projects/87a63f9211434957b7ac2dfa0b0d4740/users/4ec7597963194fe68a11a72804e3fa9a/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.479930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:00.486171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0f41d-83f3-4a7f-ac80-a5fcba9fdb9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a63f9211434957b7ac2dfa0b0d4740, user_id=4ec7597963194fe68a11a72804e3fa9a, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:00.497373 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0f41d-83f3-4a7f-ac80-a5fcba9fdb9a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:00.608024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1178/2362] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:24:00 2022] PUT /identity/v3/projects/87a63f9211434957b7ac2dfa0b0d4740/users/4ec7597963194fe68a11a72804e3fa9a/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:00.612799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138d16c-c385-4acc-9111-9760fd4438b9 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:00.624041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138d16c-c385-4acc-9111-9760fd4438b9 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:00.647876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:00.686556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb9101-507c-4c07-9ddd-b5704169464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:00.687397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb9101-507c-4c07-9ddd-b5704169464b admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.687765 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb9101-507c-4c07-9ddd-b5704169464b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.688358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb9101-507c-4c07-9ddd-b5704169464b admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.689063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb9101-507c-4c07-9ddd-b5704169464b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:00.691098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb9101-507c-4c07-9ddd-b5704169464b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:00.702387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1185/2363] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:24:00.706476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0f41d-83f3-4a7f-ac80-a5fcba9fdb9a admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:00.717947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0f41d-83f3-4a7f-ac80-a5fcba9fdb9a admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:00.723049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3244-d010-4b16-8d14-02cb0384767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:00.723725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3244-d010-4b16-8d14-02cb0384767e admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.724003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3244-d010-4b16-8d14-02cb0384767e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.724312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e3244-d010-4b16-8d14-02cb0384767e admin admin] PATH_INFO: `/v3/projects/87a63f9211434957b7ac2dfa0b0d4740/users/4ec7597963194fe68a11a72804e3fa9a/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.726281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e3244-d010-4b16-8d14-02cb0384767e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a63f9211434957b7ac2dfa0b0d4740, user_id=4ec7597963194fe68a11a72804e3fa9a, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:00.731816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e3244-d010-4b16-8d14-02cb0384767e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:00.741181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1179/2364] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:24:00 2022] PUT /identity/v3/projects/87a63f9211434957b7ac2dfa0b0d4740/users/4ec7597963194fe68a11a72804e3fa9a/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:00.753014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c279-09bc-4305-a182-2456314eb000 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.753320 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c279-09bc-4305-a182-2456314eb000 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.753617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18c279-09bc-4305-a182-2456314eb000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.783621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-dc18c279-09bc-4305-a182-2456314eb000 None None] MFA Rules not processed for user `4ec7597963194fe68a11a72804e3fa9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:00.784897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-dc18c279-09bc-4305-a182-2456314eb000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:00.857331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1186/2365] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:24:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:00.869593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3244-d010-4b16-8d14-02cb0384767e admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:00.871687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4c0e3244-d010-4b16-8d14-02cb0384767e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:00.933010 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e3244-d010-4b16-8d14-02cb0384767e admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:00.936766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd58c17-0740-4d30-9a16-b5dcf06e7ae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:00.937385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd58c17-0740-4d30-9a16-b5dcf06e7ae3 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.937703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd58c17-0740-4d30-9a16-b5dcf06e7ae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.937986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd58c17-0740-4d30-9a16-b5dcf06e7ae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.948934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd58c17-0740-4d30-9a16-b5dcf06e7ae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:00.950382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd58c17-0740-4d30-9a16-b5dcf06e7ae3 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:00.960473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1180/2366] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:24:01.152926 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18c279-09bc-4305-a182-2456314eb000 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:01.164335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18c279-09bc-4305-a182-2456314eb000 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:01.168209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b0c19-b942-4ddf-9fb7-cff45646e4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:01.168853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b0c19-b942-4ddf-9fb7-cff45646e4ed service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:01.169129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b0c19-b942-4ddf-9fb7-cff45646e4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:01.169397 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b0c19-b942-4ddf-9fb7-cff45646e4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:01.229619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b0c19-b942-4ddf-9fb7-cff45646e4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:01.237073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b0c19-b942-4ddf-9fb7-cff45646e4ed service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:01.241548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1187/2367] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:24:10.955955 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=36,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:11.236315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=81 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:38.912963 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd58c17-0740-4d30-9a16-b5dcf06e7ae3 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:38.914767 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4fd58c17-0740-4d30-9a16-b5dcf06e7ae3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:39.032179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd58c17-0740-4d30-9a16-b5dcf06e7ae3 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:39.036831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d7c88-a087-40be-bfbc-8342c6f85aa1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a698e566a46841cf83aa1711e83f8829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:39.037643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d7c88-a087-40be-bfbc-8342c6f85aa1 service placement] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:39.037873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d7c88-a087-40be-bfbc-8342c6f85aa1 service placement] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:39.038144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d7c88-a087-40be-bfbc-8342c6f85aa1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:39.040620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b20d7c88-a087-40be-bfbc-8342c6f85aa1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:39.054038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d7c88-a087-40be-bfbc-8342c6f85aa1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:39.056439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d7c88-a087-40be-bfbc-8342c6f85aa1 service placement] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:39.067273 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1181/2368] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:24:42.473672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b0c19-b942-4ddf-9fb7-cff45646e4ed service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:42.583170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b0c19-b942-4ddf-9fb7-cff45646e4ed service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:42.590162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:42.591014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:42.591392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:42.591768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] PATH_INFO: `/v3/users/aff98d15297d4dcea634aa0c3667c629` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:42.593395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff98d15297d4dcea634aa0c3667c629)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:42.595941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:42.893193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff98d15297d4dcea634aa0c3667c629'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:42.894198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff98d15297d4dcea634aa0c3667c629'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:42.902880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff98d15297d4dcea634aa0c3667c629'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:42.903637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff98d15297d4dcea634aa0c3667c629'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:42.927670 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff98d15297d4dcea634aa0c3667c629'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:43.027967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1188/2369] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:24:42 2022] DELETE /identity/v3/users/aff98d15297d4dcea634aa0c3667c629 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:43.029863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e3e05-7193-4e8f-b50d-4d286f34b285 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:43.030319 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e3e05-7193-4e8f-b50d-4d286f34b285 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:43.030402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e3e05-7193-4e8f-b50d-4d286f34b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:43.051143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a58e3e05-7193-4e8f-b50d-4d286f34b285 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:43.052711 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a58e3e05-7193-4e8f-b50d-4d286f34b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:43.128354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1182/2370] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:43.147587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:43.149561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:43.280006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d72c2-60f4-4fd8-99cb-5694adb62577 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:43.287328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1747d-dca3-4478-9ca2-b419cdb85307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:43.288025 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1747d-dca3-4478-9ca2-b419cdb85307 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:43.288435 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1747d-dca3-4478-9ca2-b419cdb85307 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:43.289309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1747d-dca3-4478-9ca2-b419cdb85307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:43.301470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1747d-dca3-4478-9ca2-b419cdb85307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:43.303000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1747d-dca3-4478-9ca2-b419cdb85307 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:43.314245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1189/2371] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:24:44.140419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e3e05-7193-4e8f-b50d-4d286f34b285 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:44.142724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a58e3e05-7193-4e8f-b50d-4d286f34b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:44.164525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e3e05-7193-4e8f-b50d-4d286f34b285 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:44.184045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:44.184752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.185190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.185338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] PATH_INFO: `/v3/projects/8a298e2e28584ae68234a851e4ce1ed3` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.189972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a298e2e28584ae68234a851e4ce1ed3)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:44.192110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:44.420765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a298e2e28584ae68234a851e4ce1ed3', 'request_id': 'req-6ec7e82d-2f88-4abe-a262-873a24a031b6'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:44.522217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa65dbe-80d6-4cef-927e-44f6c7c757ae None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.522728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa65dbe-80d6-4cef-927e-44f6c7c757ae None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.522826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa65dbe-80d6-4cef-927e-44f6c7c757ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.542668 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a298e2e28584ae68234a851e4ce1ed3', 'request_id': 'req-6ec7e82d-2f88-4abe-a262-873a24a031b6'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:44.554700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a298e2e28584ae68234a851e4ce1ed3', 'request_id': 'req-6ec7e82d-2f88-4abe-a262-873a24a031b6'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:44.563906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:44.577344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] The token cache is being invalidate because project 8a298e2e28584ae68234a851e4ce1ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:24:44.577651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:44.578373 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:44.580978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1183/2372] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:24:44 2022] DELETE /identity/v3/projects/8a298e2e28584ae68234a851e4ce1ed3 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:44.585252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:44.590952 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:44.601728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-faa65dbe-80d6-4cef-927e-44f6c7c757ae None None] MFA Rules not processed for user `9b22f661cc524dd2a58a499badb8e661`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:44.603455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-faa65dbe-80d6-4cef-927e-44f6c7c757ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:44.627344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:44.678578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1190/2373] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:24:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:24:44.740672 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7e82d-2f88-4abe-a262-873a24a031b6 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:44.746705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc898c51-6b9f-47de-85b1-bddf87647ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:44.747651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc898c51-6b9f-47de-85b1-bddf87647ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:44.748034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc898c51-6b9f-47de-85b1-bddf87647ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:44.748560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc898c51-6b9f-47de-85b1-bddf87647ebb admin admin] PATH_INFO: `/v3/users/4ec7597963194fe68a11a72804e3fa9a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:44.750406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc898c51-6b9f-47de-85b1-bddf87647ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec7597963194fe68a11a72804e3fa9a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:44.752695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc898c51-6b9f-47de-85b1-bddf87647ebb admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:45.042132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-bc898c51-6b9f-47de-85b1-bddf87647ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec7597963194fe68a11a72804e3fa9a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:45.042853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-bc898c51-6b9f-47de-85b1-bddf87647ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec7597963194fe68a11a72804e3fa9a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:45.043553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-bc898c51-6b9f-47de-85b1-bddf87647ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec7597963194fe68a11a72804e3fa9a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:45.059629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-bc898c51-6b9f-47de-85b1-bddf87647ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec7597963194fe68a11a72804e3fa9a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:45.173444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-bc898c51-6b9f-47de-85b1-bddf87647ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec7597963194fe68a11a72804e3fa9a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:45.193817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1184/2374] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:24:44 2022] DELETE /identity/v3/users/4ec7597963194fe68a11a72804e3fa9a => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:45.678613 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa65dbe-80d6-4cef-927e-44f6c7c757ae None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:45.690895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa65dbe-80d6-4cef-927e-44f6c7c757ae None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:45.782144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:45.782797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:45.783078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:45.783353 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] PATH_INFO: `/v3/projects/87a63f9211434957b7ac2dfa0b0d4740` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:45.785275 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a63f9211434957b7ac2dfa0b0d4740)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:45.787217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:45.924158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a63f9211434957b7ac2dfa0b0d4740', 'request_id': 'req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:46.021928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a63f9211434957b7ac2dfa0b0d4740', 'request_id': 'req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:46.045858 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a63f9211434957b7ac2dfa0b0d4740', 'request_id': 'req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:46.059475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] The token cache is being invalidate because project 87a63f9211434957b7ac2dfa0b0d4740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:24:46.059816 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:46.060488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-540dafe7-e5b3-416e-abfc-adc0fe3f2f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:46.062299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1191/2375] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:24:45 2022] DELETE /identity/v3/projects/87a63f9211434957b7ac2dfa0b0d4740 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:46.067117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e25d8-99d9-43f5-a062-704cb3e8f635 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.067677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e25d8-99d9-43f5-a062-704cb3e8f635 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.067924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e25d8-99d9-43f5-a062-704cb3e8f635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.101826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-c69e25d8-99d9-43f5-a062-704cb3e8f635 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:46.103060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c69e25d8-99d9-43f5-a062-704cb3e8f635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:46.183695 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1185/2376] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:46.193000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca940ab5-1c35-4a85-8e9d-4b050e893f60 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.193358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca940ab5-1c35-4a85-8e9d-4b050e893f60 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.193879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca940ab5-1c35-4a85-8e9d-4b050e893f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.219205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ca940ab5-1c35-4a85-8e9d-4b050e893f60 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:46.220676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ca940ab5-1c35-4a85-8e9d-4b050e893f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:46.232386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1192/2377] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:46.236446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e25d8-99d9-43f5-a062-704cb3e8f635 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.263673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e25d8-99d9-43f5-a062-704cb3e8f635 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.269266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15d27e-42ea-4b5d-9a40-3f78f23e77a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.270303 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15d27e-42ea-4b5d-9a40-3f78f23e77a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.270691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15d27e-42ea-4b5d-9a40-3f78f23e77a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.271064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15d27e-42ea-4b5d-9a40-3f78f23e77a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.272030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15d27e-42ea-4b5d-9a40-3f78f23e77a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:46.272396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15d27e-42ea-4b5d-9a40-3f78f23e77a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.274285 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15d27e-42ea-4b5d-9a40-3f78f23e77a1 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.290680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1186/2378] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:24:46.295333 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca940ab5-1c35-4a85-8e9d-4b050e893f60 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.297870 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:46.313337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca940ab5-1c35-4a85-8e9d-4b050e893f60 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.322907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad90a8-10e7-4e0e-866c-8f2aee9b4198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.323514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad90a8-10e7-4e0e-866c-8f2aee9b4198 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.324923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad90a8-10e7-4e0e-866c-8f2aee9b4198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.325378 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad90a8-10e7-4e0e-866c-8f2aee9b4198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.326030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad90a8-10e7-4e0e-866c-8f2aee9b4198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.332520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad90a8-10e7-4e0e-866c-8f2aee9b4198 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.470027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1193/2379] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:24:46 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:46.471766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15d27e-42ea-4b5d-9a40-3f78f23e77a1 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.486413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15d27e-42ea-4b5d-9a40-3f78f23e77a1 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.578554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ef87-3979-4f42-9191-5ce867b8112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.579243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ef87-3979-4f42-9191-5ce867b8112a admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.579521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ef87-3979-4f42-9191-5ce867b8112a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.579791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ef87-3979-4f42-9191-5ce867b8112a admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.580467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ef87-3979-4f42-9191-5ce867b8112a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.582429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ef87-3979-4f42-9191-5ce867b8112a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.706459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1187/2380] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:24:46 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:46.712502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad90a8-10e7-4e0e-866c-8f2aee9b4198 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.723496 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad90a8-10e7-4e0e-866c-8f2aee9b4198 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.730205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798f766-0e80-44fb-998d-1ad09a5b0e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.734914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798f766-0e80-44fb-998d-1ad09a5b0e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.734914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798f766-0e80-44fb-998d-1ad09a5b0e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.734914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798f766-0e80-44fb-998d-1ad09a5b0e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.734914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798f766-0e80-44fb-998d-1ad09a5b0e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.734914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798f766-0e80-44fb-998d-1ad09a5b0e75 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.745152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1194/2381] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:24:46.749617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ef87-3979-4f42-9191-5ce867b8112a admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.763229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ef87-3979-4f42-9191-5ce867b8112a admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.768583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a17f2a-66bb-47cd-8dd8-71a354408878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.769280 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17f2a-66bb-47cd-8dd8-71a354408878 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.774066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17f2a-66bb-47cd-8dd8-71a354408878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.774066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17f2a-66bb-47cd-8dd8-71a354408878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.774066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a17f2a-66bb-47cd-8dd8-71a354408878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.774066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a17f2a-66bb-47cd-8dd8-71a354408878 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.784744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1188/2382] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:24:46.789240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798f766-0e80-44fb-998d-1ad09a5b0e75 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:46.799430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798f766-0e80-44fb-998d-1ad09a5b0e75 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:46.804096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c470b-d65a-4bd4-a90e-f4d3ccf77ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:46.804870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c470b-d65a-4bd4-a90e-f4d3ccf77ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.805184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c470b-d65a-4bd4-a90e-f4d3ccf77ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.805462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c470b-d65a-4bd4-a90e-f4d3ccf77ff9 admin admin] PATH_INFO: `/v3/projects/6d8f29fb91524175afa66da07b3b23a1/users/fcda9ae13fec45b9899e9fd62798a767/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.821577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c470b-d65a-4bd4-a90e-f4d3ccf77ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8f29fb91524175afa66da07b3b23a1, user_id=fcda9ae13fec45b9899e9fd62798a767, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:46.824388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c470b-d65a-4bd4-a90e-f4d3ccf77ff9 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:46.826736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:46.945123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1195/2383] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:24:46 2022] PUT /identity/v3/projects/6d8f29fb91524175afa66da07b3b23a1/users/fcda9ae13fec45b9899e9fd62798a767/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:46.956077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481facd-6248-4b20-8d50-16b799780877 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:46.956404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481facd-6248-4b20-8d50-16b799780877 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:46.956680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481facd-6248-4b20-8d50-16b799780877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:46.989061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-f481facd-6248-4b20-8d50-16b799780877 None None] MFA Rules not processed for user `fcda9ae13fec45b9899e9fd62798a767`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:46.990288 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f481facd-6248-4b20-8d50-16b799780877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:47.062903 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1189/2384] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:24:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:47.067587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c470b-d65a-4bd4-a90e-f4d3ccf77ff9 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:47.133600 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c470b-d65a-4bd4-a90e-f4d3ccf77ff9 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:47.139374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39c754-b462-41ef-9602-6c736edecbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:47.139988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39c754-b462-41ef-9602-6c736edecbae admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.140298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39c754-b462-41ef-9602-6c736edecbae admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.140574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39c754-b462-41ef-9602-6c736edecbae admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.141313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39c754-b462-41ef-9602-6c736edecbae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:47.143258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39c754-b462-41ef-9602-6c736edecbae admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:47.237791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1196/2385] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:24:47 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:47.242430 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481facd-6248-4b20-8d50-16b799780877 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:47.253579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481facd-6248-4b20-8d50-16b799780877 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:47.313300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f94fdf-11c2-4726-a04c-8d6538cb84fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:47.313944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f94fdf-11c2-4726-a04c-8d6538cb84fc admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.314226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f94fdf-11c2-4726-a04c-8d6538cb84fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.314501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f94fdf-11c2-4726-a04c-8d6538cb84fc admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.315167 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f94fdf-11c2-4726-a04c-8d6538cb84fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:47.317106 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f94fdf-11c2-4726-a04c-8d6538cb84fc admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:47.435006 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:47.441414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1190/2386] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:24:47 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:47.446971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39c754-b462-41ef-9602-6c736edecbae admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:47.457605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39c754-b462-41ef-9602-6c736edecbae admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:47.462468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822c7d0-5f14-44b8-862c-20b3a519cbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:47.463079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822c7d0-5f14-44b8-862c-20b3a519cbea admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.463389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822c7d0-5f14-44b8-862c-20b3a519cbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.463665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822c7d0-5f14-44b8-862c-20b3a519cbea admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.464366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822c7d0-5f14-44b8-862c-20b3a519cbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:47.465978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822c7d0-5f14-44b8-862c-20b3a519cbea admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:47.477971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1197/2387] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:24:47.482349 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f94fdf-11c2-4726-a04c-8d6538cb84fc admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:47.495305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f94fdf-11c2-4726-a04c-8d6538cb84fc admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:47.502142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc3d1e-9921-49da-9149-cf89440d9144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:47.502828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc3d1e-9921-49da-9149-cf89440d9144 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.503111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc3d1e-9921-49da-9149-cf89440d9144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.503388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc3d1e-9921-49da-9149-cf89440d9144 admin admin] PATH_INFO: `/v3/projects/690486d8eb6b4e9387890df7f4863f9d/users/c1027e56420c4a53a101701485e0ee88/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.521581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc3d1e-9921-49da-9149-cf89440d9144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=690486d8eb6b4e9387890df7f4863f9d, user_id=c1027e56420c4a53a101701485e0ee88, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:47.524822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc3d1e-9921-49da-9149-cf89440d9144 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:47.599306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1191/2388] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:24:47 2022] PUT /identity/v3/projects/690486d8eb6b4e9387890df7f4863f9d/users/c1027e56420c4a53a101701485e0ee88/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:47.603811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822c7d0-5f14-44b8-862c-20b3a519cbea admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:47.614580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822c7d0-5f14-44b8-862c-20b3a519cbea admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:47.707880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2dca3-4f5c-4e39-bcc7-0e60a51551b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:47.708597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2dca3-4f5c-4e39-bcc7-0e60a51551b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.708968 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2dca3-4f5c-4e39-bcc7-0e60a51551b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.709302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2dca3-4f5c-4e39-bcc7-0e60a51551b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.710083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2dca3-4f5c-4e39-bcc7-0e60a51551b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:47.711857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e2dca3-4f5c-4e39-bcc7-0e60a51551b8 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:47.726851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1198/2389] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:24:47.731316 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc3d1e-9921-49da-9149-cf89440d9144 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:47.743346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc3d1e-9921-49da-9149-cf89440d9144 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:47.749410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aeed1-f91c-466c-abca-84f0408eb84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:47.750098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aeed1-f91c-466c-abca-84f0408eb84e admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.750376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aeed1-f91c-466c-abca-84f0408eb84e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.750656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aeed1-f91c-466c-abca-84f0408eb84e admin admin] PATH_INFO: `/v3/projects/690486d8eb6b4e9387890df7f4863f9d/users/c1027e56420c4a53a101701485e0ee88/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.759859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aeed1-f91c-466c-abca-84f0408eb84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=690486d8eb6b4e9387890df7f4863f9d, user_id=c1027e56420c4a53a101701485e0ee88, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:47.765239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aeed1-f91c-466c-abca-84f0408eb84e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:47.778229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1192/2390] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:24:47 2022] PUT /identity/v3/projects/690486d8eb6b4e9387890df7f4863f9d/users/c1027e56420c4a53a101701485e0ee88/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:47.790061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b77bc-fbba-4474-8475-83f19dcd1fc5 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:47.790633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b77bc-fbba-4474-8475-83f19dcd1fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:47.791090 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b77bc-fbba-4474-8475-83f19dcd1fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:47.830938 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0c8b77bc-fbba-4474-8475-83f19dcd1fc5 None None] MFA Rules not processed for user `c1027e56420c4a53a101701485e0ee88`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:47.832756 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0c8b77bc-fbba-4474-8475-83f19dcd1fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:47.921962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:47.952505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1199/2391] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:24:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:47.962200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aeed1-f91c-466c-abca-84f0408eb84e admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:47.964441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-cd2aeed1-f91c-466c-abca-84f0408eb84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:48.031473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aeed1-f91c-466c-abca-84f0408eb84e admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:48.037152 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a79d7-ca76-4653-9a7a-9467aa35c534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:48.037711 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a79d7-ca76-4653-9a7a-9467aa35c534 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.037998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a79d7-ca76-4653-9a7a-9467aa35c534 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.038269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a79d7-ca76-4653-9a7a-9467aa35c534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.048368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a79d7-ca76-4653-9a7a-9467aa35c534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:48.049801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a79d7-ca76-4653-9a7a-9467aa35c534 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:48.063815 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1193/2392] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:24:48.349729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b77bc-fbba-4474-8475-83f19dcd1fc5 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:48.360600 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b77bc-fbba-4474-8475-83f19dcd1fc5 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:48.364672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37b84e-3bfe-4b88-8f4f-cb199489d19a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:48.365518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37b84e-3bfe-4b88-8f4f-cb199489d19a service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:48.365813 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37b84e-3bfe-4b88-8f4f-cb199489d19a service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:48.366087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37b84e-3bfe-4b88-8f4f-cb199489d19a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:48.431622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37b84e-3bfe-4b88-8f4f-cb199489d19a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:48.433174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37b84e-3bfe-4b88-8f4f-cb199489d19a service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:48.443251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1200/2393] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:24:52.276532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b04ee-9a65-4a1a-bb9f-58e0453a2572 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:52.277179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b04ee-9a65-4a1a-bb9f-58e0453a2572 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:52.277720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b04ee-9a65-4a1a-bb9f-58e0453a2572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:52.312978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-488b04ee-9a65-4a1a-bb9f-58e0453a2572 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:52.314176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-488b04ee-9a65-4a1a-bb9f-58e0453a2572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:52.383339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1194/2394] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:24:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:52.433091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37b84e-3bfe-4b88-8f4f-cb199489d19a service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:52.434583 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7a37b84e-3bfe-4b88-8f4f-cb199489d19a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:52.511072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37b84e-3bfe-4b88-8f4f-cb199489d19a service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:52.516205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc8459-ce95-479b-a178-5faeadd03098 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:52.516919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc8459-ce95-479b-a178-5faeadd03098 service swift] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:52.517198 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc8459-ce95-479b-a178-5faeadd03098 service swift] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:52.517954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc8459-ce95-479b-a178-5faeadd03098 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:52.526942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc8459-ce95-479b-a178-5faeadd03098 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:52.528629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc8459-ce95-479b-a178-5faeadd03098 service swift] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:52.537150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1201/2395] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:24:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:24:57.294964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26fa72-3a45-49f9-b4e1-8de0c0e6dc68 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:57.295551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26fa72-3a45-49f9-b4e1-8de0c0e6dc68 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:57.295551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26fa72-3a45-49f9-b4e1-8de0c0e6dc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:57.324521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6a26fa72-3a45-49f9-b4e1-8de0c0e6dc68 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:57.324521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6a26fa72-3a45-49f9-b4e1-8de0c0e6dc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:57.332377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1195/2396] 10.222.0.20 () {58 vars in 967 bytes} [Wed Aug 24 17:24:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:57.358542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc8459-ce95-479b-a178-5faeadd03098 service swift] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:57.387086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc8459-ce95-479b-a178-5faeadd03098 service swift] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:57.396532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcec71-4de9-4e93-9161-acc02d6f7094 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:57.407456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcec71-4de9-4e93-9161-acc02d6f7094 service swift] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:57.407456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcec71-4de9-4e93-9161-acc02d6f7094 service swift] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:57.407456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcec71-4de9-4e93-9161-acc02d6f7094 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:57.418985 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcec71-4de9-4e93-9161-acc02d6f7094 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:57.424677 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcec71-4de9-4e93-9161-acc02d6f7094 service swift] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:57.439085 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1202/2397] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:24:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:24:59.402041 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26fa72-3a45-49f9-b4e1-8de0c0e6dc68 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:59.518774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:59.541778 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26fa72-3a45-49f9-b4e1-8de0c0e6dc68 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:59.547096 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:59.547801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:59.548082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:59.548376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] PATH_INFO: `/v3/users/fcda9ae13fec45b9899e9fd62798a767` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:59.552656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcda9ae13fec45b9899e9fd62798a767)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:59.555062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:59.817492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcda9ae13fec45b9899e9fd62798a767'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:59.818221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcda9ae13fec45b9899e9fd62798a767'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:59.818838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcda9ae13fec45b9899e9fd62798a767'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:59.845821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcda9ae13fec45b9899e9fd62798a767'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:00.022345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcda9ae13fec45b9899e9fd62798a767'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:00.068297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1196/2398] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:24:59 2022] DELETE /identity/v3/users/fcda9ae13fec45b9899e9fd62798a767 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:00.073921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d9242-e098-4abd-a5d2-4d84591ce0ad None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.074889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d9242-e098-4abd-a5d2-4d84591ce0ad None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.075165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d9242-e098-4abd-a5d2-4d84591ce0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.098033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-9c0d9242-e098-4abd-a5d2-4d84591ce0ad None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:00.099332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-9c0d9242-e098-4abd-a5d2-4d84591ce0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:00.187315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1203/2399] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:00.197248 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:00.198823 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:00.277241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf0910-f7d2-4fa4-bb79-65954a3a76b1 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:00.282154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b87c5-0245-4673-9c03-3231867c1a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:00.282891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b87c5-0245-4673-9c03-3231867c1a65 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:00.283172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b87c5-0245-4673-9c03-3231867c1a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:00.283467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b87c5-0245-4673-9c03-3231867c1a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:00.296375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b87c5-0245-4673-9c03-3231867c1a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:00.298541 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b87c5-0245-4673-9c03-3231867c1a65 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:00.313263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1197/2400] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:01.475947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d9242-e098-4abd-a5d2-4d84591ce0ad None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:01.478784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-9c0d9242-e098-4abd-a5d2-4d84591ce0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:01.516341 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:01.521862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d9242-e098-4abd-a5d2-4d84591ce0ad None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:01.540882 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:01.541755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:01.545503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:01.545503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] PATH_INFO: `/v3/projects/6d8f29fb91524175afa66da07b3b23a1` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:01.546262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8f29fb91524175afa66da07b3b23a1)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:01.548317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:01.707030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8f29fb91524175afa66da07b3b23a1', 'request_id': 'req-bdad3d99-1445-4c5e-8500-9b4a078ac18a'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:01.777830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8f29fb91524175afa66da07b3b23a1', 'request_id': 'req-bdad3d99-1445-4c5e-8500-9b4a078ac18a'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:01.786275 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8f29fb91524175afa66da07b3b23a1', 'request_id': 'req-bdad3d99-1445-4c5e-8500-9b4a078ac18a'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:01.802274 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] The token cache is being invalidate because project 6d8f29fb91524175afa66da07b3b23a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:01.802578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:01.803297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:01.813664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1204/2401] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:01 2022] DELETE /identity/v3/projects/6d8f29fb91524175afa66da07b3b23a1 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:01.814819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b87c5-0245-4673-9c03-3231867c1a65 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:01.835232 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b87c5-0245-4673-9c03-3231867c1a65 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:01.970062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51659ee0-b9d2-49b1-a46a-feca1726a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:01.970871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51659ee0-b9d2-49b1-a46a-feca1726a153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:01.971159 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51659ee0-b9d2-49b1-a46a-feca1726a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:01.971553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51659ee0-b9d2-49b1-a46a-feca1726a153 admin admin] PATH_INFO: `/v3/users/c1027e56420c4a53a101701485e0ee88` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:01.975370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51659ee0-b9d2-49b1-a46a-feca1726a153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1027e56420c4a53a101701485e0ee88)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:01.979743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51659ee0-b9d2-49b1-a46a-feca1726a153 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:01.996684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:02.206899 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-51659ee0-b9d2-49b1-a46a-feca1726a153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1027e56420c4a53a101701485e0ee88'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:02.207988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-51659ee0-b9d2-49b1-a46a-feca1726a153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1027e56420c4a53a101701485e0ee88'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:02.208684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-51659ee0-b9d2-49b1-a46a-feca1726a153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1027e56420c4a53a101701485e0ee88'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:02.228953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-51659ee0-b9d2-49b1-a46a-feca1726a153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1027e56420c4a53a101701485e0ee88'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:02.298656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-51659ee0-b9d2-49b1-a46a-feca1726a153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1027e56420c4a53a101701485e0ee88'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:02.318618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1198/2402] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:01 2022] DELETE /identity/v3/users/c1027e56420c4a53a101701485e0ee88 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:25:02.967208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:02.969447 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:02.991643 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad3d99-1445-4c5e-8500-9b4a078ac18a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:03.079761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:03.082054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.082905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.083281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] PATH_INFO: `/v3/projects/690486d8eb6b4e9387890df7f4863f9d` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.085190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690486d8eb6b4e9387890df7f4863f9d)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:03.089846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:03.219975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690486d8eb6b4e9387890df7f4863f9d', 'request_id': 'req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:03.349282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690486d8eb6b4e9387890df7f4863f9d', 'request_id': 'req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:03.357037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690486d8eb6b4e9387890df7f4863f9d', 'request_id': 'req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:03.390071 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] The token cache is being invalidate because project 690486d8eb6b4e9387890df7f4863f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:03.390376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:03.392265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-3f6242fb-a9e8-4344-af77-4eb1a2b4aec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:03.398375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1205/2403] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:02 2022] DELETE /identity/v3/projects/690486d8eb6b4e9387890df7f4863f9d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:03.399510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a19681-4c51-4264-8a41-7ebc422e3d7e None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.400328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a19681-4c51-4264-8a41-7ebc422e3d7e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.400799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a19681-4c51-4264-8a41-7ebc422e3d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.436626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e4a19681-4c51-4264-8a41-7ebc422e3d7e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:03.438547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e4a19681-4c51-4264-8a41-7ebc422e3d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:03.529372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1199/2404] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:25:03.537669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f87477-59b1-461b-8aad-799e18afe2af None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.537951 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f87477-59b1-461b-8aad-799e18afe2af None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.538217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f87477-59b1-461b-8aad-799e18afe2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.571779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-d4f87477-59b1-461b-8aad-799e18afe2af None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:03.573152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d4f87477-59b1-461b-8aad-799e18afe2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:03.587033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1206/2405] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:03.588581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a19681-4c51-4264-8a41-7ebc422e3d7e None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:03.603181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a19681-4c51-4264-8a41-7ebc422e3d7e None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:03.622769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508a133-5f0a-4508-8980-9d5ef13681ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:03.625742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508a133-5f0a-4508-8980-9d5ef13681ab admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.626214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508a133-5f0a-4508-8980-9d5ef13681ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.626759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508a133-5f0a-4508-8980-9d5ef13681ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.627709 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508a133-5f0a-4508-8980-9d5ef13681ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:03.628043 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508a133-5f0a-4508-8980-9d5ef13681ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:03.629934 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508a133-5f0a-4508-8980-9d5ef13681ab admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:03.649581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1200/2406] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:03.651117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f87477-59b1-461b-8aad-799e18afe2af None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:03.667102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f87477-59b1-461b-8aad-799e18afe2af None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:03.677335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e38f2-415c-41b8-b2e6-830a5af866a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:03.678055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e38f2-415c-41b8-b2e6-830a5af866a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.678354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e38f2-415c-41b8-b2e6-830a5af866a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.678637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e38f2-415c-41b8-b2e6-830a5af866a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.679406 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e38f2-415c-41b8-b2e6-830a5af866a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:03.681890 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e38f2-415c-41b8-b2e6-830a5af866a4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:03.692790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:03.804093 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1207/2407] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:25:03 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:25:03.812071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508a133-5f0a-4508-8980-9d5ef13681ab admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:03.837859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508a133-5f0a-4508-8980-9d5ef13681ab admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:03.977101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869592-18e9-4897-adec-bee053914d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:03.978015 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869592-18e9-4897-adec-bee053914d91 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:03.978485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869592-18e9-4897-adec-bee053914d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:03.978925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869592-18e9-4897-adec-bee053914d91 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:03.979738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a869592-18e9-4897-adec-bee053914d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:03.982844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a869592-18e9-4897-adec-bee053914d91 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:04.127150 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e38f2-415c-41b8-b2e6-830a5af866a4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:04.128542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1201/2408] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:25:03 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:04.153741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e38f2-415c-41b8-b2e6-830a5af866a4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.174543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b994ad9-9d30-43bf-83aa-ef9346ae93b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.175927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994ad9-9d30-43bf-83aa-ef9346ae93b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.176386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994ad9-9d30-43bf-83aa-ef9346ae93b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.176804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994ad9-9d30-43bf-83aa-ef9346ae93b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.186963 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b994ad9-9d30-43bf-83aa-ef9346ae93b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:04.190696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b994ad9-9d30-43bf-83aa-ef9346ae93b6 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:04.238342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869592-18e9-4897-adec-bee053914d91 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:04.238578 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1208/2409] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:04.250527 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:04.274124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869592-18e9-4897-adec-bee053914d91 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.279620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8465708-36b7-491a-afc8-5a91e26f9272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.280439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8465708-36b7-491a-afc8-5a91e26f9272 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.281480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8465708-36b7-491a-afc8-5a91e26f9272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.282055 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8465708-36b7-491a-afc8-5a91e26f9272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.282711 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8465708-36b7-491a-afc8-5a91e26f9272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:04.293548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8465708-36b7-491a-afc8-5a91e26f9272 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:04.321737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1202/2410] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:04.322456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b994ad9-9d30-43bf-83aa-ef9346ae93b6 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:04.346533 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b994ad9-9d30-43bf-83aa-ef9346ae93b6 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.354964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99695b69-524d-482d-9c0c-3a75741db4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.355796 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99695b69-524d-482d-9c0c-3a75741db4d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.356172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99695b69-524d-482d-9c0c-3a75741db4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.357376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99695b69-524d-482d-9c0c-3a75741db4d1 admin admin] PATH_INFO: `/v3/projects/943e8d42be3941c7ac4af07089e2b6f7/users/b97cf533427546e89b70060e48c073b0/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.389531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99695b69-524d-482d-9c0c-3a75741db4d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=943e8d42be3941c7ac4af07089e2b6f7, user_id=b97cf533427546e89b70060e48c073b0, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:04.389531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99695b69-524d-482d-9c0c-3a75741db4d1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:04.587972 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ccd43-e3ac-4173-8e93-2c0c26e5975a None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.588553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ccd43-e3ac-4173-8e93-2c0c26e5975a None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.588922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ccd43-e3ac-4173-8e93-2c0c26e5975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.591877 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1209/2411] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:04 2022] PUT /identity/v3/projects/943e8d42be3941c7ac4af07089e2b6f7/users/b97cf533427546e89b70060e48c073b0/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:25:04.647825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-948ccd43-e3ac-4173-8e93-2c0c26e5975a None None] MFA Rules not processed for user `b97cf533427546e89b70060e48c073b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:04.652666 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-948ccd43-e3ac-4173-8e93-2c0c26e5975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:04.758579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1203/2412] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:04.764993 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99695b69-524d-482d-9c0c-3a75741db4d1 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:04.916700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99695b69-524d-482d-9c0c-3a75741db4d1 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:04.924708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ce2f3-02e4-4266-8e10-07e39c5385b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:04.926214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ce2f3-02e4-4266-8e10-07e39c5385b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:04.926602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ce2f3-02e4-4266-8e10-07e39c5385b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:04.927604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ce2f3-02e4-4266-8e10-07e39c5385b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:04.928505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ce2f3-02e4-4266-8e10-07e39c5385b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:04.936730 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ce2f3-02e4-4266-8e10-07e39c5385b9 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:05.061126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ccd43-e3ac-4173-8e93-2c0c26e5975a None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:05.062685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-948ccd43-e3ac-4173-8e93-2c0c26e5975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:05.141509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ccd43-e3ac-4173-8e93-2c0c26e5975a None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:05.161097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d76f-4c0f-4fed-ac05-e079f0fa2f9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a698e566a46841cf83aa1711e83f8829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:05.161941 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d76f-4c0f-4fed-ac05-e079f0fa2f9f service placement] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:05.162267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d76f-4c0f-4fed-ac05-e079f0fa2f9f service placement] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:05.162617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19d76f-4c0f-4fed-ac05-e079f0fa2f9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:05.165790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4f19d76f-4c0f-4fed-ac05-e079f0fa2f9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:05.181262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19d76f-4c0f-4fed-ac05-e079f0fa2f9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:05.183094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19d76f-4c0f-4fed-ac05-e079f0fa2f9f service placement] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:05.195697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1204/2413] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:25:05.329977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1210/2414] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:25:04 2022] POST /identity/v3/projects => generated 385 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:05.342381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d76f-4c0f-4fed-ac05-e079f0fa2f9f service placement] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:05.350523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19d76f-4c0f-4fed-ac05-e079f0fa2f9f service placement] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:05.430401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88048f-cc9b-4fed-90fb-45b664802c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:05.431086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88048f-cc9b-4fed-90fb-45b664802c7d admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:05.431822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88048f-cc9b-4fed-90fb-45b664802c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:05.431822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88048f-cc9b-4fed-90fb-45b664802c7d admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:05.433178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88048f-cc9b-4fed-90fb-45b664802c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:05.435143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88048f-cc9b-4fed-90fb-45b664802c7d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:05.575089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1205/2415] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:25:05 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:05.578759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ce2f3-02e4-4266-8e10-07e39c5385b9 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:05.631493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ce2f3-02e4-4266-8e10-07e39c5385b9 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:05.675630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9567c-0d50-4202-adcd-0c002224c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:05.676293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9567c-0d50-4202-adcd-0c002224c0ac admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:05.676582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9567c-0d50-4202-adcd-0c002224c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:05.676861 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9567c-0d50-4202-adcd-0c002224c0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:05.677529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9567c-0d50-4202-adcd-0c002224c0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:05.680238 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9567c-0d50-4202-adcd-0c002224c0ac admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:05.702415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88048f-cc9b-4fed-90fb-45b664802c7d admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:05.703509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1211/2416] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:05.708223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:05.715318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88048f-cc9b-4fed-90fb-45b664802c7d admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:05.721542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf46722-3150-455f-b229-0fc87a33cf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:05.725388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf46722-3150-455f-b229-0fc87a33cf1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:05.726069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf46722-3150-455f-b229-0fc87a33cf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:05.726643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf46722-3150-455f-b229-0fc87a33cf1f admin admin] PATH_INFO: `/v3/projects/6cf0e36132cb441b87083e8928ef23b4/users/e7a8f2324f224352bcc9f5f46e285738/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:05.747410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf46722-3150-455f-b229-0fc87a33cf1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf0e36132cb441b87083e8928ef23b4, user_id=e7a8f2324f224352bcc9f5f46e285738, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:05.750909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf46722-3150-455f-b229-0fc87a33cf1f admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:05.898100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1206/2417] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:05 2022] PUT /identity/v3/projects/6cf0e36132cb441b87083e8928ef23b4/users/e7a8f2324f224352bcc9f5f46e285738/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:25:05.898936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9567c-0d50-4202-adcd-0c002224c0ac admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:05.915003 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9567c-0d50-4202-adcd-0c002224c0ac admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:06.016208 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8ac36-8d87-4666-83d0-3fa258ea3a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:06.017282 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8ac36-8d87-4666-83d0-3fa258ea3a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.017600 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8ac36-8d87-4666-83d0-3fa258ea3a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.017880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8ac36-8d87-4666-83d0-3fa258ea3a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.018537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8ac36-8d87-4666-83d0-3fa258ea3a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:06.020159 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8ac36-8d87-4666-83d0-3fa258ea3a9d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:06.033851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1212/2418] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:25:06.041867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf46722-3150-455f-b229-0fc87a33cf1f admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:06.055686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf46722-3150-455f-b229-0fc87a33cf1f admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:06.061847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9c949-0bc8-4d80-b3af-2405ff912292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:06.062584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c949-0bc8-4d80-b3af-2405ff912292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.062866 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c949-0bc8-4d80-b3af-2405ff912292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.063161 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9c949-0bc8-4d80-b3af-2405ff912292 admin admin] PATH_INFO: `/v3/projects/6cf0e36132cb441b87083e8928ef23b4/users/e7a8f2324f224352bcc9f5f46e285738/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.065267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9c949-0bc8-4d80-b3af-2405ff912292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf0e36132cb441b87083e8928ef23b4, user_id=e7a8f2324f224352bcc9f5f46e285738, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:06.067940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9c949-0bc8-4d80-b3af-2405ff912292 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:06.088740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1207/2419] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:06 2022] PUT /identity/v3/projects/6cf0e36132cb441b87083e8928ef23b4/users/e7a8f2324f224352bcc9f5f46e285738/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:06.097309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927f523-c4a6-41e1-a953-9faf1eb23b83 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.097601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927f523-c4a6-41e1-a953-9faf1eb23b83 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.097882 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927f523-c4a6-41e1-a953-9faf1eb23b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.140767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-9927f523-c4a6-41e1-a953-9faf1eb23b83 None None] MFA Rules not processed for user `e7a8f2324f224352bcc9f5f46e285738`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:06.142013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-9927f523-c4a6-41e1-a953-9faf1eb23b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:06.155849 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:06.257019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1213/2420] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:06.273468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9c949-0bc8-4d80-b3af-2405ff912292 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:06.275450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9cc9c949-0bc8-4d80-b3af-2405ff912292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:06.396534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9c949-0bc8-4d80-b3af-2405ff912292 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:06.401997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74587b50-9c4e-4e56-b012-7160360dcfcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:06.402708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587b50-9c4e-4e56-b012-7160360dcfcb service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.403076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587b50-9c4e-4e56-b012-7160360dcfcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.403416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74587b50-9c4e-4e56-b012-7160360dcfcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.418278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74587b50-9c4e-4e56-b012-7160360dcfcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:06.422724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74587b50-9c4e-4e56-b012-7160360dcfcb service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:06.455670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1208/2421] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:06.474531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927f523-c4a6-41e1-a953-9faf1eb23b83 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:06.571605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927f523-c4a6-41e1-a953-9faf1eb23b83 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:06.578194 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:06.579192 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:06.579621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:06.579996 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] PATH_INFO: `/v3/users/b97cf533427546e89b70060e48c073b0` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:06.581374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b97cf533427546e89b70060e48c073b0)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:06.583661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:06.950674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b97cf533427546e89b70060e48c073b0'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:06.951350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b97cf533427546e89b70060e48c073b0'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:06.958698 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b97cf533427546e89b70060e48c073b0'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:06.959358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b97cf533427546e89b70060e48c073b0'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:06.973547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b97cf533427546e89b70060e48c073b0'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:07.183789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1214/2422] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:06 2022] DELETE /identity/v3/users/b97cf533427546e89b70060e48c073b0 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:07.188492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893dc7f-9489-42cd-88bf-b2ac7b3568e5 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:07.188971 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893dc7f-9489-42cd-88bf-b2ac7b3568e5 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:07.189102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893dc7f-9489-42cd-88bf-b2ac7b3568e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:07.209378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8893dc7f-9489-42cd-88bf-b2ac7b3568e5 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:07.211214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8893dc7f-9489-42cd-88bf-b2ac7b3568e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:07.272238 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1209/2423] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:07.283029 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:07.284895 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:07.326990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:07.361814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b188d-c9c0-4110-bee6-ce1cdcd54270 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:07.367222 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4c40d-f74f-41df-ae24-b4ee7d582db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:07.368022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4c40d-f74f-41df-ae24-b4ee7d582db8 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:07.368412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4c40d-f74f-41df-ae24-b4ee7d582db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:07.368924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4c40d-f74f-41df-ae24-b4ee7d582db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:07.381151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4c40d-f74f-41df-ae24-b4ee7d582db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:07.383381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4c40d-f74f-41df-ae24-b4ee7d582db8 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:07.413623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1215/2424] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:08.079929 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893dc7f-9489-42cd-88bf-b2ac7b3568e5 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:08.081556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8893dc7f-9489-42cd-88bf-b2ac7b3568e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:08.095692 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893dc7f-9489-42cd-88bf-b2ac7b3568e5 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:08.109804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:08.110653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:08.111078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:08.111996 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] PATH_INFO: `/v3/projects/943e8d42be3941c7ac4af07089e2b6f7` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:08.114041 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] RBAC: Authorizing `identity:delete_project(project_id=943e8d42be3941c7ac4af07089e2b6f7)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:08.116257 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:08.355468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943e8d42be3941c7ac4af07089e2b6f7', 'request_id': 'req-4d18d934-5379-439f-8784-b6ff50e0292c'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:08.438379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943e8d42be3941c7ac4af07089e2b6f7', 'request_id': 'req-4d18d934-5379-439f-8784-b6ff50e0292c'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:08.446212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943e8d42be3941c7ac4af07089e2b6f7', 'request_id': 'req-4d18d934-5379-439f-8784-b6ff50e0292c'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:08.449151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:08.461115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] The token cache is being invalidate because project 943e8d42be3941c7ac4af07089e2b6f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:08.462040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:08.462723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:08.464487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1210/2425] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:08 2022] DELETE /identity/v3/projects/943e8d42be3941c7ac4af07089e2b6f7 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:08.469648 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4c40d-f74f-41df-ae24-b4ee7d582db8 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:08.482327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4c40d-f74f-41df-ae24-b4ee7d582db8 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:08.556436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d17c0-71b1-46a8-a903-f60ef71812cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:08.556999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d17c0-71b1-46a8-a903-f60ef71812cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:08.557285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d17c0-71b1-46a8-a903-f60ef71812cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:08.557562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d17c0-71b1-46a8-a903-f60ef71812cd admin admin] PATH_INFO: `/v3/users/e7a8f2324f224352bcc9f5f46e285738` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:08.558738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d17c0-71b1-46a8-a903-f60ef71812cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a8f2324f224352bcc9f5f46e285738)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:08.561475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d17c0-71b1-46a8-a903-f60ef71812cd admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:08.805497 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-951d17c0-71b1-46a8-a903-f60ef71812cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a8f2324f224352bcc9f5f46e285738'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:08.806283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-951d17c0-71b1-46a8-a903-f60ef71812cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a8f2324f224352bcc9f5f46e285738'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:08.814464 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-951d17c0-71b1-46a8-a903-f60ef71812cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a8f2324f224352bcc9f5f46e285738'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:08.815203 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-951d17c0-71b1-46a8-a903-f60ef71812cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a8f2324f224352bcc9f5f46e285738'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:08.829036 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-951d17c0-71b1-46a8-a903-f60ef71812cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a8f2324f224352bcc9f5f46e285738'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:08.938196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1216/2426] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:08 2022] DELETE /identity/v3/users/e7a8f2324f224352bcc9f5f46e285738 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:09.544198 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:09.546295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:09.564028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18d934-5379-439f-8784-b6ff50e0292c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:09.658217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:09.661164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:09.661164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:09.661164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] PATH_INFO: `/v3/projects/6cf0e36132cb441b87083e8928ef23b4` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:09.663326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf0e36132cb441b87083e8928ef23b4)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:09.669839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:09.843657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf0e36132cb441b87083e8928ef23b4', 'request_id': 'req-ae18d0c9-8c72-438d-b978-895923dc4b78'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:09.949528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf0e36132cb441b87083e8928ef23b4', 'request_id': 'req-ae18d0c9-8c72-438d-b978-895923dc4b78'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:09.956647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf0e36132cb441b87083e8928ef23b4', 'request_id': 'req-ae18d0c9-8c72-438d-b978-895923dc4b78'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:09.968330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] The token cache is being invalidate because project 6cf0e36132cb441b87083e8928ef23b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:09.968557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:09.969236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ae18d0c9-8c72-438d-b978-895923dc4b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:09.970776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1211/2427] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:09 2022] DELETE /identity/v3/projects/6cf0e36132cb441b87083e8928ef23b4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:09.975743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0403f5-f371-4d61-92cc-a003ae79bd65 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:09.976936 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0403f5-f371-4d61-92cc-a003ae79bd65 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:09.983034 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0403f5-f371-4d61-92cc-a003ae79bd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:09.999026 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-1d0403f5-f371-4d61-92cc-a003ae79bd65 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:10.000328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1d0403f5-f371-4d61-92cc-a003ae79bd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:10.090160 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:10.120846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1217/2428] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:10.131540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acce983-48f2-409a-8b98-71f62454b185 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.134376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acce983-48f2-409a-8b98-71f62454b185 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.134376 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acce983-48f2-409a-8b98-71f62454b185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.162042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0acce983-48f2-409a-8b98-71f62454b185 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:10.163274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0acce983-48f2-409a-8b98-71f62454b185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:10.176454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1212/2429] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:10.181227 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0403f5-f371-4d61-92cc-a003ae79bd65 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:10.191112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0403f5-f371-4d61-92cc-a003ae79bd65 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:10.196734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b49f21-3bc0-4270-8c06-c6b95a92b570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:10.197475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b49f21-3bc0-4270-8c06-c6b95a92b570 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.197762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b49f21-3bc0-4270-8c06-c6b95a92b570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.198069 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b49f21-3bc0-4270-8c06-c6b95a92b570 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.198728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b49f21-3bc0-4270-8c06-c6b95a92b570 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:10.199029 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b49f21-3bc0-4270-8c06-c6b95a92b570 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:10.200832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b49f21-3bc0-4270-8c06-c6b95a92b570 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:10.214754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1218/2430] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:10.223792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acce983-48f2-409a-8b98-71f62454b185 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:10.234335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acce983-48f2-409a-8b98-71f62454b185 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:10.239774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c47d2-9b6d-4d75-a039-34758624ba4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:10.240654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c47d2-9b6d-4d75-a039-34758624ba4d admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.240841 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c47d2-9b6d-4d75-a039-34758624ba4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.241211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c47d2-9b6d-4d75-a039-34758624ba4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.241969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c47d2-9b6d-4d75-a039-34758624ba4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:10.244176 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c47d2-9b6d-4d75-a039-34758624ba4d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:10.361900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1213/2431] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:25:10 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:10.363372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b49f21-3bc0-4270-8c06-c6b95a92b570 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:10.374258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b49f21-3bc0-4270-8c06-c6b95a92b570 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:10.449904 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca9267-add8-4ae9-8dec-7a01bca95988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:10.450629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9267-add8-4ae9-8dec-7a01bca95988 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.451036 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9267-add8-4ae9-8dec-7a01bca95988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.451340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca9267-add8-4ae9-8dec-7a01bca95988 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.452016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca9267-add8-4ae9-8dec-7a01bca95988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:10.454345 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca9267-add8-4ae9-8dec-7a01bca95988 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:10.629574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1219/2432] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:25:10 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:10.631003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c47d2-9b6d-4d75-a039-34758624ba4d admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:10.651664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c47d2-9b6d-4d75-a039-34758624ba4d admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:10.656943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cf156-b865-4415-84ba-b82d3a885d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:10.657187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cf156-b865-4415-84ba-b82d3a885d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.657468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cf156-b865-4415-84ba-b82d3a885d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.657743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cf156-b865-4415-84ba-b82d3a885d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.658434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cf156-b865-4415-84ba-b82d3a885d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:10.660202 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cf156-b865-4415-84ba-b82d3a885d3e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:10.672988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1214/2433] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:10.677153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca9267-add8-4ae9-8dec-7a01bca95988 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:10.689385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca9267-add8-4ae9-8dec-7a01bca95988 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:10.695412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ee1a4-3f08-4bc0-b6c8-97431924eedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:10.699288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ee1a4-3f08-4bc0-b6c8-97431924eedc admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.699288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ee1a4-3f08-4bc0-b6c8-97431924eedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.699288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ee1a4-3f08-4bc0-b6c8-97431924eedc admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.699288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ee1a4-3f08-4bc0-b6c8-97431924eedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:10.699288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ee1a4-3f08-4bc0-b6c8-97431924eedc admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:10.731421 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1220/2434] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:10.735686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cf156-b865-4415-84ba-b82d3a885d3e admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:10.747015 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cf156-b865-4415-84ba-b82d3a885d3e admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:10.756475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3aa8d5-2c0d-4d8b-9739-d2a30a149c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:10.757016 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3aa8d5-2c0d-4d8b-9739-d2a30a149c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.757338 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3aa8d5-2c0d-4d8b-9739-d2a30a149c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.757615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3aa8d5-2c0d-4d8b-9739-d2a30a149c24 admin admin] PATH_INFO: `/v3/projects/662cf5828cbf4851a7d91030c78a81ae/users/d7666c48313c45f9a86679afe54d4de1/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.776427 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3aa8d5-2c0d-4d8b-9739-d2a30a149c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=662cf5828cbf4851a7d91030c78a81ae, user_id=d7666c48313c45f9a86679afe54d4de1, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:10.779258 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3aa8d5-2c0d-4d8b-9739-d2a30a149c24 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:10.810705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ee1a4-3f08-4bc0-b6c8-97431924eedc admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:10.812455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-9e9ee1a4-3f08-4bc0-b6c8-97431924eedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:10.875766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1215/2435] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:10 2022] PUT /identity/v3/projects/662cf5828cbf4851a7d91030c78a81ae/users/d7666c48313c45f9a86679afe54d4de1/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:25:10.887892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b4e6-52b2-49cb-b1e6-b5d53ce50266 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.888267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b4e6-52b2-49cb-b1e6-b5d53ce50266 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.888565 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b4e6-52b2-49cb-b1e6-b5d53ce50266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.908985 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ee1a4-3f08-4bc0-b6c8-97431924eedc admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:10.930226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-dce9b4e6-52b2-49cb-b1e6-b5d53ce50266 None None] MFA Rules not processed for user `d7666c48313c45f9a86679afe54d4de1`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:10.931542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-dce9b4e6-52b2-49cb-b1e6-b5d53ce50266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:10.940727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:10.981321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:10.989354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc5f3d-0d98-4b90-af91-b01753e653a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a698e566a46841cf83aa1711e83f8829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:10.989966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5f3d-0d98-4b90-af91-b01753e653a5 service placement] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:10.990241 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5f3d-0d98-4b90-af91-b01753e653a5 service placement] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:10.990517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc5f3d-0d98-4b90-af91-b01753e653a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:10.992419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-56bc5f3d-0d98-4b90-af91-b01753e653a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:11.003635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc5f3d-0d98-4b90-af91-b01753e653a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.005547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc5f3d-0d98-4b90-af91-b01753e653a5 service placement] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.007088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1216/2436] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:25:11.009165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9b4e6-52b2-49cb-b1e6-b5d53ce50266 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.010478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-dce9b4e6-52b2-49cb-b1e6-b5d53ce50266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:11.016709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1221/2437] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:25:11.017512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc5f3d-0d98-4b90-af91-b01753e653a5 service placement] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.082306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9b4e6-52b2-49cb-b1e6-b5d53ce50266 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.087850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.088518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.088795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.089117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] PATH_INFO: `/v3/users/3db839a9ad544263bda4864c1b13876e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.090355 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db839a9ad544263bda4864c1b13876e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.092395 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc5f3d-0d98-4b90-af91-b01753e653a5 service placement] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.092700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.097245 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef5192-2ce6-46e6-a52f-3d01bd6b0949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.097870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5192-2ce6-46e6-a52f-3d01bd6b0949 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.098153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5192-2ce6-46e6-a52f-3d01bd6b0949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.098426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef5192-2ce6-46e6-a52f-3d01bd6b0949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.099081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef5192-2ce6-46e6-a52f-3d01bd6b0949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.101178 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef5192-2ce6-46e6-a52f-3d01bd6b0949 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.243540 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1222/2438] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:25:11 2022] POST /identity/v3/projects => generated 379 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:11.247557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef5192-2ce6-46e6-a52f-3d01bd6b0949 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.311979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef5192-2ce6-46e6-a52f-3d01bd6b0949 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.316817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f356d93-9c7d-4384-829a-b21dc777f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.317429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f356d93-9c7d-4384-829a-b21dc777f8bb admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.317704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f356d93-9c7d-4384-829a-b21dc777f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.317974 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f356d93-9c7d-4384-829a-b21dc777f8bb admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.318602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f356d93-9c7d-4384-829a-b21dc777f8bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.321707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f356d93-9c7d-4384-829a-b21dc777f8bb admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.340367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db839a9ad544263bda4864c1b13876e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:11.341021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db839a9ad544263bda4864c1b13876e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:11.341741 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db839a9ad544263bda4864c1b13876e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:11.354631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db839a9ad544263bda4864c1b13876e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:11.475639 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db839a9ad544263bda4864c1b13876e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:11.482994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1223/2439] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:25:11 2022] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:11.487357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f356d93-9c7d-4384-829a-b21dc777f8bb admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.490193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1f356d93-9c7d-4384-829a-b21dc777f8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:11.497468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1217/2440] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:11 2022] DELETE /identity/v3/users/3db839a9ad544263bda4864c1b13876e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:11.509112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f356d93-9c7d-4384-829a-b21dc777f8bb admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.571285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaacb8-06ce-424b-8c3e-385fbbde670a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.571909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaacb8-06ce-424b-8c3e-385fbbde670a admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.572242 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaacb8-06ce-424b-8c3e-385fbbde670a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.572682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaacb8-06ce-424b-8c3e-385fbbde670a admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.573344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaacb8-06ce-424b-8c3e-385fbbde670a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.574981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbaacb8-06ce-424b-8c3e-385fbbde670a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.580516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:11.586438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1224/2441] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:25:11.590908 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.601743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261ae5d-110c-403e-83f5-28004ae48651 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.606583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73be923-e0e1-407a-9d2b-ebc2dee1de2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.607279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73be923-e0e1-407a-9d2b-ebc2dee1de2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.607560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73be923-e0e1-407a-9d2b-ebc2dee1de2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.607866 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73be923-e0e1-407a-9d2b-ebc2dee1de2f admin admin] PATH_INFO: `/v3/projects/a6e467ee0ebb4291887393f4ef93ee7b/users/8c1f32a3021f4101ac0524a4d880e283/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.624191 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73be923-e0e1-407a-9d2b-ebc2dee1de2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e467ee0ebb4291887393f4ef93ee7b, user_id=8c1f32a3021f4101ac0524a4d880e283, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.626659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73be923-e0e1-407a-9d2b-ebc2dee1de2f admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.730481 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1218/2442] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:11 2022] PUT /identity/v3/projects/a6e467ee0ebb4291887393f4ef93ee7b/users/8c1f32a3021f4101ac0524a4d880e283/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:25:11.734471 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaacb8-06ce-424b-8c3e-385fbbde670a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.747902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaacb8-06ce-424b-8c3e-385fbbde670a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.749554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73be923-e0e1-407a-9d2b-ebc2dee1de2f admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.750933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d73be923-e0e1-407a-9d2b-ebc2dee1de2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:11.757008 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:11.837369 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b37949-eaa0-4976-b695-130ea78ba2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.838017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b37949-eaa0-4976-b695-130ea78ba2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.838295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b37949-eaa0-4976-b695-130ea78ba2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.839225 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b37949-eaa0-4976-b695-130ea78ba2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.840279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b37949-eaa0-4976-b695-130ea78ba2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.842263 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b37949-eaa0-4976-b695-130ea78ba2f0 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.843835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73be923-e0e1-407a-9d2b-ebc2dee1de2f admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.850227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.851985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.852519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.852876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] PATH_INFO: `/v3/projects/b03d48a5b363455a8359673a1c568c2f` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.854318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b03d48a5b363455a8359673a1c568c2f)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.856166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1225/2443] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:11.856573 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.861433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b37949-eaa0-4976-b695-130ea78ba2f0 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:11.872690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b37949-eaa0-4976-b695-130ea78ba2f0 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:11.878945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e1053-cf24-473e-92c4-172b266e2bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:11.879623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1053-cf24-473e-92c4-172b266e2bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.879907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1053-cf24-473e-92c4-172b266e2bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.880735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1053-cf24-473e-92c4-172b266e2bcd admin admin] PATH_INFO: `/v3/projects/a6e467ee0ebb4291887393f4ef93ee7b/users/8c1f32a3021f4101ac0524a4d880e283/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.883401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e1053-cf24-473e-92c4-172b266e2bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e467ee0ebb4291887393f4ef93ee7b, user_id=8c1f32a3021f4101ac0524a4d880e283, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:11.887555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e1053-cf24-473e-92c4-172b266e2bcd admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:11.914141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1226/2444] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:11 2022] PUT /identity/v3/projects/a6e467ee0ebb4291887393f4ef93ee7b/users/8c1f32a3021f4101ac0524a4d880e283/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:25:11.914982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e72325-cb24-4481-811f-3d4323f8feae None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:11.915257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e72325-cb24-4481-811f-3d4323f8feae None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:11.915584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e72325-cb24-4481-811f-3d4323f8feae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:11.950125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c2e72325-cb24-4481-811f-3d4323f8feae None None] MFA Rules not processed for user `8c1f32a3021f4101ac0524a4d880e283`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:11.951382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c2e72325-cb24-4481-811f-3d4323f8feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:12.024513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1227/2445] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:12.035840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e72325-cb24-4481-811f-3d4323f8feae None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:12.035989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b03d48a5b363455a8359673a1c568c2f', 'request_id': 'req-1dcd1cb0-5478-4434-954e-04668c1e3b92'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:12.037292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c2e72325-cb24-4481-811f-3d4323f8feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:12.095107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e72325-cb24-4481-811f-3d4323f8feae None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:12.116167 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:12.123790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b03d48a5b363455a8359673a1c568c2f', 'request_id': 'req-1dcd1cb0-5478-4434-954e-04668c1e3b92'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:12.131446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b03d48a5b363455a8359673a1c568c2f', 'request_id': 'req-1dcd1cb0-5478-4434-954e-04668c1e3b92'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:12.145990 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] The token cache is being invalidate because project b03d48a5b363455a8359673a1c568c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:12.146444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:12.147421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:12.149234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1219/2446] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:11 2022] DELETE /identity/v3/projects/b03d48a5b363455a8359673a1c568c2f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:12.150526 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbdaaf-6339-4b7d-b5e4-a299d91baf5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:12.151140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbdaaf-6339-4b7d-b5e4-a299d91baf5e service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.151413 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbdaaf-6339-4b7d-b5e4-a299d91baf5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.151681 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbdaaf-6339-4b7d-b5e4-a299d91baf5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.152975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:12.153558 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-11fbdaaf-6339-4b7d-b5e4-a299d91baf5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:12.154424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:12.212586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbdaaf-6339-4b7d-b5e4-a299d91baf5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:12.214044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbdaaf-6339-4b7d-b5e4-a299d91baf5e service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:12.219708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd1cb0-5478-4434-954e-04668c1e3b92 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:12.223330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1228/2447] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:25:12.226850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:12.227498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:12.227780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:12.228051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] PATH_INFO: `/v3/users/bed77623bb234ee48159b43950a3ec25` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:12.229264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed77623bb234ee48159b43950a3ec25)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:12.231232 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:12.535062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed77623bb234ee48159b43950a3ec25'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:12.535715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed77623bb234ee48159b43950a3ec25'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:12.536377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed77623bb234ee48159b43950a3ec25'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:12.548592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed77623bb234ee48159b43950a3ec25'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:12.663003 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed77623bb234ee48159b43950a3ec25'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:12.677219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1220/2448] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:12 2022] DELETE /identity/v3/users/bed77623bb234ee48159b43950a3ec25 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:25:12.990927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbdaaf-6339-4b7d-b5e4-a299d91baf5e service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:13.004139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbdaaf-6339-4b7d-b5e4-a299d91baf5e service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:13.078974 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:13.079596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:13.079809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:13.080084 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] PATH_INFO: `/v3/projects/f59785863fdb47c6bdb2b892cfbfd0d7` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:13.081237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59785863fdb47c6bdb2b892cfbfd0d7)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:13.083173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:13.290626 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59785863fdb47c6bdb2b892cfbfd0d7', 'request_id': 'req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:13.392435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:13.392978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59785863fdb47c6bdb2b892cfbfd0d7', 'request_id': 'req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:13.401004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59785863fdb47c6bdb2b892cfbfd0d7', 'request_id': 'req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:13.411641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] The token cache is being invalidate because project f59785863fdb47c6bdb2b892cfbfd0d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:13.411906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:13.412592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bc1f7ea9-2f68-42d6-a6a4-f9722622edb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:13.414377 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1229/2449] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:12 2022] DELETE /identity/v3/projects/f59785863fdb47c6bdb2b892cfbfd0d7 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:14.135174 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:14.136657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:14.197087 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b9694-3e70-4397-bc6b-4d352e41524a admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:14.249303 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017598a-861d-4536-b835-1fd01960812c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:14.250084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017598a-861d-4536-b835-1fd01960812c service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:14.250319 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017598a-861d-4536-b835-1fd01960812c service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:14.250597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017598a-861d-4536-b835-1fd01960812c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:14.252446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5017598a-861d-4536-b835-1fd01960812c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:14.323573 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017598a-861d-4536-b835-1fd01960812c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:14.324959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017598a-861d-4536-b835-1fd01960812c service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:14.334381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1221/2450] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:17.358485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe584-ec21-4efa-bafc-251c27226c01 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.359057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe584-ec21-4efa-bafc-251c27226c01 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.359057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe584-ec21-4efa-bafc-251c27226c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.380596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-4cebe584-ec21-4efa-bafc-251c27226c01 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:17.381933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4cebe584-ec21-4efa-bafc-251c27226c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:17.386856 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:17.444362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1230/2451] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Aug 24 17:25:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:17.457942 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017598a-861d-4536-b835-1fd01960812c service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:17.460201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5017598a-861d-4536-b835-1fd01960812c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:17.481755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:17.537700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017598a-861d-4536-b835-1fd01960812c service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:17.543850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ee12f-3f3b-4dcc-a3ff-bf11a0802a47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:17.544491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ee12f-3f3b-4dcc-a3ff-bf11a0802a47 service swift] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:17.544773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ee12f-3f3b-4dcc-a3ff-bf11a0802a47 service swift] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:17.545073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ee12f-3f3b-4dcc-a3ff-bf11a0802a47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:17.554311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ee12f-3f3b-4dcc-a3ff-bf11a0802a47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:17.556540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ee12f-3f3b-4dcc-a3ff-bf11a0802a47 service swift] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:17.565843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1222/2452] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:25:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:25:18.733390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebe584-ec21-4efa-bafc-251c27226c01 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:18.734923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4cebe584-ec21-4efa-bafc-251c27226c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:18.809077 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebe584-ec21-4efa-bafc-251c27226c01 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:18.813923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:18.814569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:18.814851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:18.815122 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] PATH_INFO: `/v3/users/d7666c48313c45f9a86679afe54d4de1` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:18.816313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7666c48313c45f9a86679afe54d4de1)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:18.818760 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:19.021741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7666c48313c45f9a86679afe54d4de1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:19.022437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7666c48313c45f9a86679afe54d4de1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:19.030838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7666c48313c45f9a86679afe54d4de1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:19.031739 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7666c48313c45f9a86679afe54d4de1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:19.046907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7666c48313c45f9a86679afe54d4de1'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:19.120349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1231/2453] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:18 2022] DELETE /identity/v3/users/d7666c48313c45f9a86679afe54d4de1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:19.125250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee1845-daf7-4755-9b56-e6457e596272 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.125720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee1845-daf7-4755-9b56-e6457e596272 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.126032 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee1845-daf7-4755-9b56-e6457e596272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.147279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-b5ee1845-daf7-4755-9b56-e6457e596272 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:19.148627 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b5ee1845-daf7-4755-9b56-e6457e596272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:19.217189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1223/2454] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:19.232032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:19.233665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:19.281526 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:19.308147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84229058-8ec6-4cb6-bf3f-773d5a5c376e admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:19.311548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911830c-67df-4e8f-ade0-4dd0245e7e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:19.312166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911830c-67df-4e8f-ade0-4dd0245e7e45 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.312488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911830c-67df-4e8f-ade0-4dd0245e7e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.312764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911830c-67df-4e8f-ade0-4dd0245e7e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.324808 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911830c-67df-4e8f-ade0-4dd0245e7e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:19.325631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911830c-67df-4e8f-ade0-4dd0245e7e45 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:19.352298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1232/2455] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:19.849862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee1845-daf7-4755-9b56-e6457e596272 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:19.851335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b5ee1845-daf7-4755-9b56-e6457e596272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:19.864066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee1845-daf7-4755-9b56-e6457e596272 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:19.888137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:19.889091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:19.889528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:19.890449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] PATH_INFO: `/v3/projects/662cf5828cbf4851a7d91030c78a81ae` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:19.892551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662cf5828cbf4851a7d91030c78a81ae)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:19.894702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:20.041065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662cf5828cbf4851a7d91030c78a81ae', 'request_id': 'req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:20.148889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662cf5828cbf4851a7d91030c78a81ae', 'request_id': 'req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:20.156345 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662cf5828cbf4851a7d91030c78a81ae', 'request_id': 'req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:20.169227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] The token cache is being invalidate because project 662cf5828cbf4851a7d91030c78a81ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:20.169625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:20.170177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:20.174118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1224/2456] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:19 2022] DELETE /identity/v3/projects/662cf5828cbf4851a7d91030c78a81ae => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:20.176357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911830c-67df-4e8f-ade0-4dd0245e7e45 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:20.187928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911830c-67df-4e8f-ade0-4dd0245e7e45 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:20.250468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faca06b-98d6-45a5-938b-5e09cc89e6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:20.251105 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca06b-98d6-45a5-938b-5e09cc89e6b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:20.251380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca06b-98d6-45a5-938b-5e09cc89e6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:20.251646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faca06b-98d6-45a5-938b-5e09cc89e6b2 admin admin] PATH_INFO: `/v3/users/8c1f32a3021f4101ac0524a4d880e283` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:20.252803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faca06b-98d6-45a5-938b-5e09cc89e6b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1f32a3021f4101ac0524a4d880e283)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:20.254718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faca06b-98d6-45a5-938b-5e09cc89e6b2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:20.529436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1faca06b-98d6-45a5-938b-5e09cc89e6b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1f32a3021f4101ac0524a4d880e283'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:20.530146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1faca06b-98d6-45a5-938b-5e09cc89e6b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1f32a3021f4101ac0524a4d880e283'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:20.537296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1faca06b-98d6-45a5-938b-5e09cc89e6b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1f32a3021f4101ac0524a4d880e283'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:20.537952 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1faca06b-98d6-45a5-938b-5e09cc89e6b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1f32a3021f4101ac0524a4d880e283'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:20.551331 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1faca06b-98d6-45a5-938b-5e09cc89e6b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1f32a3021f4101ac0524a4d880e283'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:20.681682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1233/2457] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:20 2022] DELETE /identity/v3/users/8c1f32a3021f4101ac0524a4d880e283 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:21.125381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.126976 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:21.146153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baac0c1-3f3b-465f-a653-9c6a0d13f2b9 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.182254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:21.214001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.214646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.214932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.215205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] PATH_INFO: `/v3/projects/a6e467ee0ebb4291887393f4ef93ee7b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.216392 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e467ee0ebb4291887393f4ef93ee7b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:21.218313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:21.330986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e467ee0ebb4291887393f4ef93ee7b', 'request_id': 'req-61b2d3b6-1496-477b-8b69-297838cb3833'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:21.420498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e467ee0ebb4291887393f4ef93ee7b', 'request_id': 'req-61b2d3b6-1496-477b-8b69-297838cb3833'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:21.427540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e467ee0ebb4291887393f4ef93ee7b', 'request_id': 'req-61b2d3b6-1496-477b-8b69-297838cb3833'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:21.440443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] The token cache is being invalidate because project a6e467ee0ebb4291887393f4ef93ee7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:21.440678 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:21.441287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-61b2d3b6-1496-477b-8b69-297838cb3833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:21.443216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1225/2458] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:21 2022] DELETE /identity/v3/projects/a6e467ee0ebb4291887393f4ef93ee7b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:21.447833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90df7f-3fbf-4340-af0e-1ffcdd158f95 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.448373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90df7f-3fbf-4340-af0e-1ffcdd158f95 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.448474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90df7f-3fbf-4340-af0e-1ffcdd158f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.468674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ea90df7f-3fbf-4340-af0e-1ffcdd158f95 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:21.469947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ea90df7f-3fbf-4340-af0e-1ffcdd158f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:21.524624 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:21.538470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1234/2459] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:21.547020 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fea1c4-7d89-4e1d-99b2-bf94ba87e767 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.547317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fea1c4-7d89-4e1d-99b2-bf94ba87e767 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.547681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fea1c4-7d89-4e1d-99b2-bf94ba87e767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.570065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e3fea1c4-7d89-4e1d-99b2-bf94ba87e767 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:21.571397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e3fea1c4-7d89-4e1d-99b2-bf94ba87e767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:21.579444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1226/2460] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:21.583845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90df7f-3fbf-4340-af0e-1ffcdd158f95 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.594043 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90df7f-3fbf-4340-af0e-1ffcdd158f95 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.599076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4738cf4-150e-4443-b60a-32388d0bcfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.599699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4738cf4-150e-4443-b60a-32388d0bcfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.599982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4738cf4-150e-4443-b60a-32388d0bcfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.600310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4738cf4-150e-4443-b60a-32388d0bcfe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.600964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4738cf4-150e-4443-b60a-32388d0bcfe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:21.601266 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4738cf4-150e-4443-b60a-32388d0bcfe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:21.603666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4738cf4-150e-4443-b60a-32388d0bcfe2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:21.620270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1235/2461] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:21.622526 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fea1c4-7d89-4e1d-99b2-bf94ba87e767 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.632628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fea1c4-7d89-4e1d-99b2-bf94ba87e767 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.639944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fc414-a82e-4c54-880f-5a97af8debd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.640707 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fc414-a82e-4c54-880f-5a97af8debd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.640994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fc414-a82e-4c54-880f-5a97af8debd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.641267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fc414-a82e-4c54-880f-5a97af8debd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.641957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fc414-a82e-4c54-880f-5a97af8debd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:21.643847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fc414-a82e-4c54-880f-5a97af8debd6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:21.739410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1227/2462] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:25:21 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:21.744196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4738cf4-150e-4443-b60a-32388d0bcfe2 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.755950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4738cf4-150e-4443-b60a-32388d0bcfe2 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.819410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927711-333f-4514-bf66-7fb12512c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.819944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927711-333f-4514-bf66-7fb12512c65c admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.820220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927711-333f-4514-bf66-7fb12512c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.820519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927711-333f-4514-bf66-7fb12512c65c admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.821142 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43927711-333f-4514-bf66-7fb12512c65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:21.823326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43927711-333f-4514-bf66-7fb12512c65c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:21.912856 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1236/2463] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:25:21 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:21.914553 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fc414-a82e-4c54-880f-5a97af8debd6 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.926555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fc414-a82e-4c54-880f-5a97af8debd6 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.931924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d9f53-0500-4ed9-b8d5-307eb7be2e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.932711 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d9f53-0500-4ed9-b8d5-307eb7be2e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.932991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d9f53-0500-4ed9-b8d5-307eb7be2e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.933262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d9f53-0500-4ed9-b8d5-307eb7be2e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.933930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d9f53-0500-4ed9-b8d5-307eb7be2e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:21.935584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d9f53-0500-4ed9-b8d5-307eb7be2e79 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:21.947092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1228/2464] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:25:21.950878 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927711-333f-4514-bf66-7fb12512c65c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:21.963021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927711-333f-4514-bf66-7fb12512c65c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:21.968719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197862c5-baad-48db-a7e1-57712c64b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:21.973863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197862c5-baad-48db-a7e1-57712c64b690 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:21.973863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197862c5-baad-48db-a7e1-57712c64b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:21.973863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197862c5-baad-48db-a7e1-57712c64b690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:21.973863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197862c5-baad-48db-a7e1-57712c64b690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:21.973863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197862c5-baad-48db-a7e1-57712c64b690 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:21.988072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1237/2465] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:21.993753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d9f53-0500-4ed9-b8d5-307eb7be2e79 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.006410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d9f53-0500-4ed9-b8d5-307eb7be2e79 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.012198 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af8adf-da84-4502-a7ea-b43b00cd7c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.012483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af8adf-da84-4502-a7ea-b43b00cd7c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.012761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af8adf-da84-4502-a7ea-b43b00cd7c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.013031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af8adf-da84-4502-a7ea-b43b00cd7c26 admin admin] PATH_INFO: `/v3/projects/070c66274c6a494783a8602075b4e099/users/9f8851bbe91e47c6bc75d7bef3166e3f/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.029506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af8adf-da84-4502-a7ea-b43b00cd7c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070c66274c6a494783a8602075b4e099, user_id=9f8851bbe91e47c6bc75d7bef3166e3f, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.032766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af8adf-da84-4502-a7ea-b43b00cd7c26 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.104269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1229/2466] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:21 2022] PUT /identity/v3/projects/070c66274c6a494783a8602075b4e099/users/9f8851bbe91e47c6bc75d7bef3166e3f/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:22.115631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4297-5351-4ddd-9031-c8cadc2c931b None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.116161 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4297-5351-4ddd-9031-c8cadc2c931b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.116623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4297-5351-4ddd-9031-c8cadc2c931b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.146110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-f00e4297-5351-4ddd-9031-c8cadc2c931b None None] MFA Rules not processed for user `9f8851bbe91e47c6bc75d7bef3166e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:22.147341 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f00e4297-5351-4ddd-9031-c8cadc2c931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:22.223171 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1238/2467] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:22.227764 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af8adf-da84-4502-a7ea-b43b00cd7c26 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.290967 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:22.294881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af8adf-da84-4502-a7ea-b43b00cd7c26 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.299845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707ab43-b68b-42dd-b457-de06f25f126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.306066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707ab43-b68b-42dd-b457-de06f25f126b admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.306066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707ab43-b68b-42dd-b457-de06f25f126b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.306066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707ab43-b68b-42dd-b457-de06f25f126b admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.306066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707ab43-b68b-42dd-b457-de06f25f126b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.306066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707ab43-b68b-42dd-b457-de06f25f126b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.392981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1230/2468] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:25:22 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:22.396893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4297-5351-4ddd-9031-c8cadc2c931b None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.409709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4297-5351-4ddd-9031-c8cadc2c931b None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.461162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:22.471299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfe750-d7ce-4673-84b9-3b115f47e632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.472018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe750-d7ce-4673-84b9-3b115f47e632 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.472339 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe750-d7ce-4673-84b9-3b115f47e632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.472752 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfe750-d7ce-4673-84b9-3b115f47e632 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.473412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfe750-d7ce-4673-84b9-3b115f47e632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.475329 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfe750-d7ce-4673-84b9-3b115f47e632 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.567328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1239/2469] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:25:22 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:22.572015 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707ab43-b68b-42dd-b457-de06f25f126b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.582634 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707ab43-b68b-42dd-b457-de06f25f126b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.587551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65310148-1482-4a19-966a-e10651f662a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.593153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310148-1482-4a19-966a-e10651f662a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.593153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310148-1482-4a19-966a-e10651f662a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.593153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310148-1482-4a19-966a-e10651f662a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.593153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65310148-1482-4a19-966a-e10651f662a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.593153 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65310148-1482-4a19-966a-e10651f662a3 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.607101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1231/2470] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:25:22.609313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfe750-d7ce-4673-84b9-3b115f47e632 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.621888 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfe750-d7ce-4673-84b9-3b115f47e632 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.627467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0356a3-5def-4c08-9f6f-2f4db44500a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.628384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0356a3-5def-4c08-9f6f-2f4db44500a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.628733 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0356a3-5def-4c08-9f6f-2f4db44500a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.629012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0356a3-5def-4c08-9f6f-2f4db44500a7 admin admin] PATH_INFO: `/v3/projects/0d9fd2ccbd5840da9f9d1406b64c2ce5/users/da3ac5dcc84d42e6a780e6ac2276bf15/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.650494 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0356a3-5def-4c08-9f6f-2f4db44500a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9fd2ccbd5840da9f9d1406b64c2ce5, user_id=da3ac5dcc84d42e6a780e6ac2276bf15, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.650494 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0356a3-5def-4c08-9f6f-2f4db44500a7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.734914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1240/2471] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:22 2022] PUT /identity/v3/projects/0d9fd2ccbd5840da9f9d1406b64c2ce5/users/da3ac5dcc84d42e6a780e6ac2276bf15/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:22.739033 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65310148-1482-4a19-966a-e10651f662a3 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.750197 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65310148-1482-4a19-966a-e10651f662a3 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.812797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae1b24-3ac0-490e-96ca-ebb4844ba840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.813419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae1b24-3ac0-490e-96ca-ebb4844ba840 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.813697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae1b24-3ac0-490e-96ca-ebb4844ba840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.813969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae1b24-3ac0-490e-96ca-ebb4844ba840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.814640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae1b24-3ac0-490e-96ca-ebb4844ba840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.816256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae1b24-3ac0-490e-96ca-ebb4844ba840 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.828774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1232/2472] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:25:22.832781 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0356a3-5def-4c08-9f6f-2f4db44500a7 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:22.843440 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0356a3-5def-4c08-9f6f-2f4db44500a7 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:22.848009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60ac5a-4ec0-4d45-9e02-8717d63a0dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:22.848697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60ac5a-4ec0-4d45-9e02-8717d63a0dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.848977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60ac5a-4ec0-4d45-9e02-8717d63a0dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.849257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60ac5a-4ec0-4d45-9e02-8717d63a0dbf admin admin] PATH_INFO: `/v3/projects/0d9fd2ccbd5840da9f9d1406b64c2ce5/users/da3ac5dcc84d42e6a780e6ac2276bf15/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.851197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60ac5a-4ec0-4d45-9e02-8717d63a0dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d9fd2ccbd5840da9f9d1406b64c2ce5, user_id=da3ac5dcc84d42e6a780e6ac2276bf15, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:22.854707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60ac5a-4ec0-4d45-9e02-8717d63a0dbf admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:22.866177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1241/2473] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:22 2022] PUT /identity/v3/projects/0d9fd2ccbd5840da9f9d1406b64c2ce5/users/da3ac5dcc84d42e6a780e6ac2276bf15/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:22.935724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922b277-faef-4741-bd1b-69d61f2b095b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:22.936011 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922b277-faef-4741-bd1b-69d61f2b095b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:22.936216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922b277-faef-4741-bd1b-69d61f2b095b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:22.967992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0922b277-faef-4741-bd1b-69d61f2b095b None None] MFA Rules not processed for user `da3ac5dcc84d42e6a780e6ac2276bf15`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:22.969375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0922b277-faef-4741-bd1b-69d61f2b095b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:23.042397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1233/2474] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:23.054901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60ac5a-4ec0-4d45-9e02-8717d63a0dbf admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:23.056753 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-cf60ac5a-4ec0-4d45-9e02-8717d63a0dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:23.125513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60ac5a-4ec0-4d45-9e02-8717d63a0dbf admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:23.129391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c1c11-d0d0-482d-aa0c-3d244a600306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:23.130247 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c1c11-d0d0-482d-aa0c-3d244a600306 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:23.130528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c1c11-d0d0-482d-aa0c-3d244a600306 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:23.130791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c1c11-d0d0-482d-aa0c-3d244a600306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:23.140913 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c1c11-d0d0-482d-aa0c-3d244a600306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:23.142822 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c1c11-d0d0-482d-aa0c-3d244a600306 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:23.153732 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1242/2475] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:24.177571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922b277-faef-4741-bd1b-69d61f2b095b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:24.188284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922b277-faef-4741-bd1b-69d61f2b095b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:24.197137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b8a43-dd04-41bf-be3a-7ded3c49cf2c tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ac5dcc84d42e6a780e6ac2276bf15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d9fd2ccbd5840da9f9d1406b64c2ce5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:24.197137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8a43-dd04-41bf-be3a-7ded3c49cf2c tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:24.197137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8a43-dd04-41bf-be3a-7ded3c49cf2c tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:24.197463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b8a43-dd04-41bf-be3a-7ded3c49cf2c tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:24.197463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b8a43-dd04-41bf-be3a-7ded3c49cf2c tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:24.197463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b8a43-dd04-41bf-be3a-7ded3c49cf2c tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:24.197463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b8a43-dd04-41bf-be3a-7ded3c49cf2c tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:24.210193 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1234/2476] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:24.215315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c1c11-d0d0-482d-aa0c-3d244a600306 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:24.225566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c1c11-d0d0-482d-aa0c-3d244a600306 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:24.231049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb55fe-c631-4ef9-b12d-d7d687f198a2 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ac5dcc84d42e6a780e6ac2276bf15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d9fd2ccbd5840da9f9d1406b64c2ce5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:24.231657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb55fe-c631-4ef9-b12d-d7d687f198a2 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:24.231940 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb55fe-c631-4ef9-b12d-d7d687f198a2 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:24.232276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb55fe-c631-4ef9-b12d-d7d687f198a2 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:24.232893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb55fe-c631-4ef9-b12d-d7d687f198a2 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:24.234836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb55fe-c631-4ef9-b12d-d7d687f198a2 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:24.364923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1243/2477] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:25:24 2022] POST /identity/v3/projects => generated 353 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:24.369495 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b8a43-dd04-41bf-be3a-7ded3c49cf2c tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:24.380621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b8a43-dd04-41bf-be3a-7ded3c49cf2c tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:24.441379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:24.464397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02942f-6f41-443d-89dd-861593e1f814 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ac5dcc84d42e6a780e6ac2276bf15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d9fd2ccbd5840da9f9d1406b64c2ce5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:24.465795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02942f-6f41-443d-89dd-861593e1f814 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:24.465795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02942f-6f41-443d-89dd-861593e1f814 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:24.465795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02942f-6f41-443d-89dd-861593e1f814 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:24.467753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02942f-6f41-443d-89dd-861593e1f814 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:24.467753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02942f-6f41-443d-89dd-861593e1f814 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:24.469291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02942f-6f41-443d-89dd-861593e1f814 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:24.481951 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1235/2478] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:24.525104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb55fe-c631-4ef9-b12d-d7d687f198a2 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:24.535586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb55fe-c631-4ef9-b12d-d7d687f198a2 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:24.540791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da3ac5dcc84d42e6a780e6ac2276bf15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d9fd2ccbd5840da9f9d1406b64c2ce5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:24.541461 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:24.541863 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:24.542145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] PATH_INFO: `/v3/projects/80b65acb40f8440e926d6db5560a5a4e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:24.543404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: Authorizing `identity:delete_project(project_id=80b65acb40f8440e926d6db5560a5a4e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:24.546152 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:24.848056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b65acb40f8440e926d6db5560a5a4e', 'request_id': 'req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:25.169591 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b65acb40f8440e926d6db5560a5a4e', 'request_id': 'req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:25.178978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b65acb40f8440e926d6db5560a5a4e', 'request_id': 'req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:25.198455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] The token cache is being invalidate because project 80b65acb40f8440e926d6db5560a5a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:25.198822 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:25.199448 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f549e8b1-0b6e-40ce-87a9-c4675b92b72b tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:25.203512 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1244/2479] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:24 2022] DELETE /identity/v3/projects/80b65acb40f8440e926d6db5560a5a4e => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:26.117718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02942f-6f41-443d-89dd-861593e1f814 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:26.120722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-af02942f-6f41-443d-89dd-861593e1f814 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:26.195171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02942f-6f41-443d-89dd-861593e1f814 tempest-VolumeQuotaClassesTest-2092781495 tempest-VolumeQuotaClassesTest-2092781495-project-admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:26.257873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:26.258519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:26.259421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:26.259902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] PATH_INFO: `/v3/users/9f8851bbe91e47c6bc75d7bef3166e3f` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:26.261364 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8851bbe91e47c6bc75d7bef3166e3f)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:26.279154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:26.564240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8851bbe91e47c6bc75d7bef3166e3f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:26.564936 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8851bbe91e47c6bc75d7bef3166e3f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:26.565571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8851bbe91e47c6bc75d7bef3166e3f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:26.579086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8851bbe91e47c6bc75d7bef3166e3f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:26.657315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8851bbe91e47c6bc75d7bef3166e3f'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:26.668017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:26.672871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1236/2480] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:26 2022] DELETE /identity/v3/users/9f8851bbe91e47c6bc75d7bef3166e3f => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:26.677506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f5bf-1542-4d9e-bd1e-ad44fb17b5e1 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:26.677988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f5bf-1542-4d9e-bd1e-ad44fb17b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:26.678098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f5bf-1542-4d9e-bd1e-ad44fb17b5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:26.693930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:26.707751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b1e9f5bf-1542-4d9e-bd1e-ad44fb17b5e1 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:26.710085 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b1e9f5bf-1542-4d9e-bd1e-ad44fb17b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:26.780897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1245/2481] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:26.791213 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:26.792907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:26.862794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01f56e-a17b-4bad-907c-9bdb82127584 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:26.868724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839da025-f363-415a-92ba-a85a38266f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:26.869944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839da025-f363-415a-92ba-a85a38266f6f service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:26.870301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839da025-f363-415a-92ba-a85a38266f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:26.870727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839da025-f363-415a-92ba-a85a38266f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:26.882121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839da025-f363-415a-92ba-a85a38266f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:26.884269 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839da025-f363-415a-92ba-a85a38266f6f service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:26.896800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1237/2482] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:27.855467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9f5bf-1542-4d9e-bd1e-ad44fb17b5e1 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:27.857164 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b1e9f5bf-1542-4d9e-bd1e-ad44fb17b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:27.872313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9f5bf-1542-4d9e-bd1e-ad44fb17b5e1 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:27.877254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:27.877942 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:27.878247 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:27.878525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] PATH_INFO: `/v3/projects/070c66274c6a494783a8602075b4e099` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:27.880610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070c66274c6a494783a8602075b4e099)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:27.891219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:27.996530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070c66274c6a494783a8602075b4e099', 'request_id': 'req-4dbfaf5f-0bf9-4020-8cdb-808376224c22'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:28.085565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070c66274c6a494783a8602075b4e099', 'request_id': 'req-4dbfaf5f-0bf9-4020-8cdb-808376224c22'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:28.093279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070c66274c6a494783a8602075b4e099', 'request_id': 'req-4dbfaf5f-0bf9-4020-8cdb-808376224c22'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:28.104843 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] The token cache is being invalidate because project 070c66274c6a494783a8602075b4e099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:28.105138 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:28.105815 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:28.107356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1246/2483] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:27 2022] DELETE /identity/v3/projects/070c66274c6a494783a8602075b4e099 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:28.111679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839da025-f363-415a-92ba-a85a38266f6f service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:28.122920 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839da025-f363-415a-92ba-a85a38266f6f service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:28.182228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0198ec3-2b65-4794-89c3-8d28d3d36714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:28.182862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0198ec3-2b65-4794-89c3-8d28d3d36714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:28.183149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0198ec3-2b65-4794-89c3-8d28d3d36714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:28.183423 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0198ec3-2b65-4794-89c3-8d28d3d36714 admin admin] PATH_INFO: `/v3/users/da3ac5dcc84d42e6a780e6ac2276bf15` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:28.184610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0198ec3-2b65-4794-89c3-8d28d3d36714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3ac5dcc84d42e6a780e6ac2276bf15)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:28.186523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0198ec3-2b65-4794-89c3-8d28d3d36714 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:28.399893 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c0198ec3-2b65-4794-89c3-8d28d3d36714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3ac5dcc84d42e6a780e6ac2276bf15'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:28.400530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c0198ec3-2b65-4794-89c3-8d28d3d36714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3ac5dcc84d42e6a780e6ac2276bf15'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:28.401149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c0198ec3-2b65-4794-89c3-8d28d3d36714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3ac5dcc84d42e6a780e6ac2276bf15'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:28.413449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c0198ec3-2b65-4794-89c3-8d28d3d36714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3ac5dcc84d42e6a780e6ac2276bf15'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:28.468551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-c0198ec3-2b65-4794-89c3-8d28d3d36714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3ac5dcc84d42e6a780e6ac2276bf15'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:28.482363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1238/2484] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:28 2022] DELETE /identity/v3/users/da3ac5dcc84d42e6a780e6ac2276bf15 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:28.917232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:28.919136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:28.936664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfaf5f-0bf9-4020-8cdb-808376224c22 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:28.996423 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:28.997082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:28.997366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:28.998506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] PATH_INFO: `/v3/projects/0d9fd2ccbd5840da9f9d1406b64c2ce5` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:28.999679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d9fd2ccbd5840da9f9d1406b64c2ce5)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:29.001709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:29.097023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:29.110871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d9fd2ccbd5840da9f9d1406b64c2ce5', 'request_id': 'req-57c1d80e-f70f-404e-a883-e579a47e8344'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:29.177087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d9fd2ccbd5840da9f9d1406b64c2ce5', 'request_id': 'req-57c1d80e-f70f-404e-a883-e579a47e8344'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:29.186557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d9fd2ccbd5840da9f9d1406b64c2ce5', 'request_id': 'req-57c1d80e-f70f-404e-a883-e579a47e8344'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:29.196675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] The token cache is being invalidate because project 0d9fd2ccbd5840da9f9d1406b64c2ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:29.197157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:29.197962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-57c1d80e-f70f-404e-a883-e579a47e8344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:29.199521 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1247/2485] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:28 2022] DELETE /identity/v3/projects/0d9fd2ccbd5840da9f9d1406b64c2ce5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:29.204356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fe14c-f72d-4a91-9ee0-047843135437 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.204813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fe14c-f72d-4a91-9ee0-047843135437 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.204917 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fe14c-f72d-4a91-9ee0-047843135437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.225807 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-9a2fe14c-f72d-4a91-9ee0-047843135437 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:29.228252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9a2fe14c-f72d-4a91-9ee0-047843135437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:29.248416 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:29.295915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1239/2486] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:29.303509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fb69b-a31a-4e9c-bba2-301e2d58ab2b None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.303962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fb69b-a31a-4e9c-bba2-301e2d58ab2b None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.304264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fb69b-a31a-4e9c-bba2-301e2d58ab2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.325649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-869fb69b-a31a-4e9c-bba2-301e2d58ab2b None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:29.326871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-869fb69b-a31a-4e9c-bba2-301e2d58ab2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:29.335154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1248/2487] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:29.340115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fe14c-f72d-4a91-9ee0-047843135437 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:29.349925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fe14c-f72d-4a91-9ee0-047843135437 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:29.355375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52deab-727c-4ea2-a358-826c85f7c445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:29.355978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52deab-727c-4ea2-a358-826c85f7c445 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.356291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52deab-727c-4ea2-a358-826c85f7c445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.356645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52deab-727c-4ea2-a358-826c85f7c445 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.357216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52deab-727c-4ea2-a358-826c85f7c445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:29.357522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52deab-727c-4ea2-a358-826c85f7c445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:29.359189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52deab-727c-4ea2-a358-826c85f7c445 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:29.370854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1240/2488] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:29.375271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fb69b-a31a-4e9c-bba2-301e2d58ab2b None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:29.385721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fb69b-a31a-4e9c-bba2-301e2d58ab2b None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:29.390674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec145-d3dd-4218-8be4-d5a3e987db5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:29.391281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec145-d3dd-4218-8be4-d5a3e987db5a admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.391561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec145-d3dd-4218-8be4-d5a3e987db5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.391860 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bec145-d3dd-4218-8be4-d5a3e987db5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.392535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bec145-d3dd-4218-8be4-d5a3e987db5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:29.394418 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bec145-d3dd-4218-8be4-d5a3e987db5a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:29.476114 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1249/2489] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:25:29 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:29.485380 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52deab-727c-4ea2-a358-826c85f7c445 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:29.495679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52deab-727c-4ea2-a358-826c85f7c445 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:29.554074 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed917b0-08e6-4ae6-8cf7-31d4e3df55b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:29.554686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed917b0-08e6-4ae6-8cf7-31d4e3df55b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.555009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed917b0-08e6-4ae6-8cf7-31d4e3df55b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.555278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed917b0-08e6-4ae6-8cf7-31d4e3df55b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.556331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed917b0-08e6-4ae6-8cf7-31d4e3df55b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:29.558238 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed917b0-08e6-4ae6-8cf7-31d4e3df55b3 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:29.674661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1241/2490] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:25:29 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:29.678808 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec145-d3dd-4218-8be4-d5a3e987db5a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:29.689988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bec145-d3dd-4218-8be4-d5a3e987db5a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:29.694711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70d2fd-d64c-4096-80b5-1ef45a8f2f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:29.695321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70d2fd-d64c-4096-80b5-1ef45a8f2f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.695600 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70d2fd-d64c-4096-80b5-1ef45a8f2f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.695916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70d2fd-d64c-4096-80b5-1ef45a8f2f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.697279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70d2fd-d64c-4096-80b5-1ef45a8f2f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:29.698875 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70d2fd-d64c-4096-80b5-1ef45a8f2f4d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:29.709755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1250/2491] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:29.714850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed917b0-08e6-4ae6-8cf7-31d4e3df55b3 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:29.725234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed917b0-08e6-4ae6-8cf7-31d4e3df55b3 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:29.730561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eec56a-4499-4798-9209-d93a581756fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:29.731101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eec56a-4499-4798-9209-d93a581756fe admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.731380 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eec56a-4499-4798-9209-d93a581756fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.731651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eec56a-4499-4798-9209-d93a581756fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.732328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eec56a-4499-4798-9209-d93a581756fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:29.733969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eec56a-4499-4798-9209-d93a581756fe admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:29.745060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1242/2492] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:29.749196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70d2fd-d64c-4096-80b5-1ef45a8f2f4d admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:29.760480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70d2fd-d64c-4096-80b5-1ef45a8f2f4d admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:29.765110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ff6d7-a1db-4bd5-8623-1431119a908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:29.765761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ff6d7-a1db-4bd5-8623-1431119a908d admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.766042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ff6d7-a1db-4bd5-8623-1431119a908d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.766324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ff6d7-a1db-4bd5-8623-1431119a908d admin admin] PATH_INFO: `/v3/projects/7111118d9122473680d99f62297f8f8f/users/6b9d2c36ca4a4566a3660a32ff130bef/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.781692 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ff6d7-a1db-4bd5-8623-1431119a908d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7111118d9122473680d99f62297f8f8f, user_id=6b9d2c36ca4a4566a3660a32ff130bef, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:29.784371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ff6d7-a1db-4bd5-8623-1431119a908d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:29.851291 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1251/2493] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:29 2022] PUT /identity/v3/projects/7111118d9122473680d99f62297f8f8f/users/6b9d2c36ca4a4566a3660a32ff130bef/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:29.863216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d4bf-0e54-4d5f-9a5e-7e69102be502 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:29.863542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d4bf-0e54-4d5f-9a5e-7e69102be502 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:29.863819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d4bf-0e54-4d5f-9a5e-7e69102be502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:29.894183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0a59d4bf-0e54-4d5f-9a5e-7e69102be502 None None] MFA Rules not processed for user `6b9d2c36ca4a4566a3660a32ff130bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:29.895436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0a59d4bf-0e54-4d5f-9a5e-7e69102be502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:29.962472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1243/2494] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:29.967220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ff6d7-a1db-4bd5-8623-1431119a908d admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:30.039665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ff6d7-a1db-4bd5-8623-1431119a908d admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:30.045543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a6180-79af-4485-9b7d-9082189e74dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:30.045543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a6180-79af-4485-9b7d-9082189e74dd admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.045810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a6180-79af-4485-9b7d-9082189e74dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.046065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a6180-79af-4485-9b7d-9082189e74dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.046701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a6180-79af-4485-9b7d-9082189e74dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:30.048719 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a6180-79af-4485-9b7d-9082189e74dd admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:30.139649 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1252/2495] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:25:29 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:30.143872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59d4bf-0e54-4d5f-9a5e-7e69102be502 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:30.154744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59d4bf-0e54-4d5f-9a5e-7e69102be502 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:30.167092 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:30.210688 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b06560-2b39-4855-b44e-f6908d757288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:30.211404 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06560-2b39-4855-b44e-f6908d757288 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.211555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06560-2b39-4855-b44e-f6908d757288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.212054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b06560-2b39-4855-b44e-f6908d757288 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.212849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b06560-2b39-4855-b44e-f6908d757288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:30.214762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b06560-2b39-4855-b44e-f6908d757288 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:30.402108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1244/2496] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:25:30 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:30.403305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a6180-79af-4485-9b7d-9082189e74dd admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:30.403305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a6180-79af-4485-9b7d-9082189e74dd admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:30.403305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19a72e-1691-41fe-889d-55acbcd0bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:30.403305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19a72e-1691-41fe-889d-55acbcd0bcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.403691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19a72e-1691-41fe-889d-55acbcd0bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.403691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19a72e-1691-41fe-889d-55acbcd0bcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.403691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19a72e-1691-41fe-889d-55acbcd0bcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:30.403691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19a72e-1691-41fe-889d-55acbcd0bcb1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:30.410134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1253/2497] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:30.414331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b06560-2b39-4855-b44e-f6908d757288 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:30.425134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b06560-2b39-4855-b44e-f6908d757288 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:30.429797 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b4da7-0b7d-4163-bfeb-497f1222ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:30.431099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b4da7-0b7d-4163-bfeb-497f1222ad1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.431381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b4da7-0b7d-4163-bfeb-497f1222ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.431655 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b4da7-0b7d-4163-bfeb-497f1222ad1b admin admin] PATH_INFO: `/v3/projects/920cc82a5ed842ffb1b2a129cb3f7e3f/users/497b1ecdbca540c8900113da88786505/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.447394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b4da7-0b7d-4163-bfeb-497f1222ad1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=920cc82a5ed842ffb1b2a129cb3f7e3f, user_id=497b1ecdbca540c8900113da88786505, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:30.450104 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b4da7-0b7d-4163-bfeb-497f1222ad1b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:30.521040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1245/2498] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:30 2022] PUT /identity/v3/projects/920cc82a5ed842ffb1b2a129cb3f7e3f/users/497b1ecdbca540c8900113da88786505/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:30.527582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19a72e-1691-41fe-889d-55acbcd0bcb1 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:30.538712 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19a72e-1691-41fe-889d-55acbcd0bcb1 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:30.569855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:30.597554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5257657-377c-4eba-a515-2a5320ea0434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:30.598159 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5257657-377c-4eba-a515-2a5320ea0434 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.598435 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5257657-377c-4eba-a515-2a5320ea0434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.598707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5257657-377c-4eba-a515-2a5320ea0434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.599335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5257657-377c-4eba-a515-2a5320ea0434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:30.600949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5257657-377c-4eba-a515-2a5320ea0434 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:30.611165 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1254/2499] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:30.616070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b4da7-0b7d-4163-bfeb-497f1222ad1b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:30.627529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b4da7-0b7d-4163-bfeb-497f1222ad1b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:30.632690 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67762cdc-23b3-4e50-af25-1b8340974e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:30.633234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67762cdc-23b3-4e50-af25-1b8340974e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.633569 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67762cdc-23b3-4e50-af25-1b8340974e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.633933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67762cdc-23b3-4e50-af25-1b8340974e5b admin admin] PATH_INFO: `/v3/projects/920cc82a5ed842ffb1b2a129cb3f7e3f/users/497b1ecdbca540c8900113da88786505/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.635940 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67762cdc-23b3-4e50-af25-1b8340974e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=920cc82a5ed842ffb1b2a129cb3f7e3f, user_id=497b1ecdbca540c8900113da88786505, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:30.638588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67762cdc-23b3-4e50-af25-1b8340974e5b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:30.648969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1246/2500] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:30 2022] PUT /identity/v3/projects/920cc82a5ed842ffb1b2a129cb3f7e3f/users/497b1ecdbca540c8900113da88786505/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:30.659480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522c269-cbed-473f-9025-a79e85153534 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.661392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522c269-cbed-473f-9025-a79e85153534 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.661392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522c269-cbed-473f-9025-a79e85153534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.688560 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0522c269-cbed-473f-9025-a79e85153534 None None] MFA Rules not processed for user `497b1ecdbca540c8900113da88786505`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:30.689830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0522c269-cbed-473f-9025-a79e85153534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:30.759510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1255/2501] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:30.770846 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67762cdc-23b3-4e50-af25-1b8340974e5b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:30.772596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-67762cdc-23b3-4e50-af25-1b8340974e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:30.831231 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67762cdc-23b3-4e50-af25-1b8340974e5b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:30.834894 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0d3f2-1d65-4315-9078-31abacf5d030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:30.835518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0d3f2-1d65-4315-9078-31abacf5d030 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:30.835801 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0d3f2-1d65-4315-9078-31abacf5d030 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:30.836072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0d3f2-1d65-4315-9078-31abacf5d030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:30.845845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0d3f2-1d65-4315-9078-31abacf5d030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:30.847243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0d3f2-1d65-4315-9078-31abacf5d030 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:30.857621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1247/2502] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:31.093061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522c269-cbed-473f-9025-a79e85153534 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:31.102945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522c269-cbed-473f-9025-a79e85153534 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:31.107047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d98c3f-971b-48cc-9566-4dad0eafce9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:31.107726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d98c3f-971b-48cc-9566-4dad0eafce9e service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:31.108011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d98c3f-971b-48cc-9566-4dad0eafce9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:31.108321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d98c3f-971b-48cc-9566-4dad0eafce9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:31.167814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d98c3f-971b-48cc-9566-4dad0eafce9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:31.169335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d98c3f-971b-48cc-9566-4dad0eafce9e service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:31.178699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1256/2503] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:38.363157 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0d3f2-1d65-4315-9078-31abacf5d030 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:38.432377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0d3f2-1d65-4315-9078-31abacf5d030 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:38.438048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:38.438745 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.439030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.439302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] PATH_INFO: `/v3/users/6b9d2c36ca4a4566a3660a32ff130bef` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.440482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9d2c36ca4a4566a3660a32ff130bef)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:38.442495 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:38.463710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:38.616943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9d2c36ca4a4566a3660a32ff130bef'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:38.617650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9d2c36ca4a4566a3660a32ff130bef'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:38.618294 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9d2c36ca4a4566a3660a32ff130bef'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:38.635477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9d2c36ca4a4566a3660a32ff130bef'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:38.751415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9d2c36ca4a4566a3660a32ff130bef'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:38.766400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1248/2504] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:38 2022] DELETE /identity/v3/users/6b9d2c36ca4a4566a3660a32ff130bef => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:38.771037 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b7b7-3990-47a6-83cc-82217d2c7487 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.771519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b7b7-3990-47a6-83cc-82217d2c7487 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.771627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5b7b7-3990-47a6-83cc-82217d2c7487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.793644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-77e5b7b7-3990-47a6-83cc-82217d2c7487 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:38.794969 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-77e5b7b7-3990-47a6-83cc-82217d2c7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:38.839949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:38.854089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1257/2505] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:25:38.863888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:38.865395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:38.925046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e818b-e892-4fe7-ba81-ae4ea2134462 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:38.928655 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2275a-b020-4aee-8703-91fd7c43da21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:38.929256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2275a-b020-4aee-8703-91fd7c43da21 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:38.929535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2275a-b020-4aee-8703-91fd7c43da21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:38.929807 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2275a-b020-4aee-8703-91fd7c43da21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:38.939374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2275a-b020-4aee-8703-91fd7c43da21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:38.940827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2275a-b020-4aee-8703-91fd7c43da21 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:38.950351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1249/2506] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:39.077805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488db4-06d7-42aa-90bb-fc84f7f21fa5 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.078082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488db4-06d7-42aa-90bb-fc84f7f21fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.078350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488db4-06d7-42aa-90bb-fc84f7f21fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.098246 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-4a488db4-06d7-42aa-90bb-fc84f7f21fa5 None None] MFA Rules not processed for user `aa7e5d51065e4d7dba5b1a433998142e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:39.099388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4a488db4-06d7-42aa-90bb-fc84f7f21fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:39.162232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1258/2507] 10.222.0.20 () {58 vars in 967 bytes} [Wed Aug 24 17:25:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:39.177821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2275a-b020-4aee-8703-91fd7c43da21 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.179833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-f5a2275a-b020-4aee-8703-91fd7c43da21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:39.271885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2275a-b020-4aee-8703-91fd7c43da21 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.277957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531d1d7-57d6-4ad5-9875-c47e6eacd1c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84368e89b0b34a54996def03671a1454', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.278725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531d1d7-57d6-4ad5-9875-c47e6eacd1c9 service swift] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.278901 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531d1d7-57d6-4ad5-9875-c47e6eacd1c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.279140 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531d1d7-57d6-4ad5-9875-c47e6eacd1c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.295258 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531d1d7-57d6-4ad5-9875-c47e6eacd1c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:39.296144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531d1d7-57d6-4ad5-9875-c47e6eacd1c9 service swift] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:39.308881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1250/2508] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Aug 24 17:25:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:25:39.470804 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488db4-06d7-42aa-90bb-fc84f7f21fa5 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.472283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4a488db4-06d7-42aa-90bb-fc84f7f21fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:39.492502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488db4-06d7-42aa-90bb-fc84f7f21fa5 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.493853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.494503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.494780 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.495053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] PATH_INFO: `/v3/projects/7111118d9122473680d99f62297f8f8f` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.496364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7111118d9122473680d99f62297f8f8f)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:39.498276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:39.648799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7111118d9122473680d99f62297f8f8f', 'request_id': 'req-7cb8b28f-3df9-4187-b4f7-a7b18871950b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:39.722880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7111118d9122473680d99f62297f8f8f', 'request_id': 'req-7cb8b28f-3df9-4187-b4f7-a7b18871950b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:39.730169 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7111118d9122473680d99f62297f8f8f', 'request_id': 'req-7cb8b28f-3df9-4187-b4f7-a7b18871950b'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:39.740733 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] The token cache is being invalidate because project 7111118d9122473680d99f62297f8f8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:39.741023 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:39.741671 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:39.743162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1259/2509] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:39 2022] DELETE /identity/v3/projects/7111118d9122473680d99f62297f8f8f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:39.747838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531d1d7-57d6-4ad5-9875-c47e6eacd1c9 service swift] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:39.759700 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531d1d7-57d6-4ad5-9875-c47e6eacd1c9 service swift] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:39.784211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:39.837365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b63f2-f199-486a-bc95-f2758e13df99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:39.837365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b63f2-f199-486a-bc95-f2758e13df99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:39.837365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b63f2-f199-486a-bc95-f2758e13df99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:39.837365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b63f2-f199-486a-bc95-f2758e13df99 admin admin] PATH_INFO: `/v3/users/497b1ecdbca540c8900113da88786505` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:39.837714 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b63f2-f199-486a-bc95-f2758e13df99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=497b1ecdbca540c8900113da88786505)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:39.838739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b63f2-f199-486a-bc95-f2758e13df99 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.050475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-654b63f2-f199-486a-bc95-f2758e13df99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '497b1ecdbca540c8900113da88786505'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:40.051278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-654b63f2-f199-486a-bc95-f2758e13df99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '497b1ecdbca540c8900113da88786505'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:40.052029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-654b63f2-f199-486a-bc95-f2758e13df99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '497b1ecdbca540c8900113da88786505'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:40.065986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-654b63f2-f199-486a-bc95-f2758e13df99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '497b1ecdbca540c8900113da88786505'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:40.172719 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-654b63f2-f199-486a-bc95-f2758e13df99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '497b1ecdbca540c8900113da88786505'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:40.189106 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1251/2510] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:39 2022] DELETE /identity/v3/users/497b1ecdbca540c8900113da88786505 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:40.621955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:40.623884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:40.644154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8b28f-3df9-4187-b4f7-a7b18871950b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:40.711256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:40.711823 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.712661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.713015 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] PATH_INFO: `/v3/projects/920cc82a5ed842ffb1b2a129cb3f7e3f` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.714549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920cc82a5ed842ffb1b2a129cb3f7e3f)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:40.716499 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:40.741524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:40.849691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920cc82a5ed842ffb1b2a129cb3f7e3f', 'request_id': 'req-ee4f3026-8a93-4137-980e-70f6d4384629'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:40.934390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920cc82a5ed842ffb1b2a129cb3f7e3f', 'request_id': 'req-ee4f3026-8a93-4137-980e-70f6d4384629'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:40.941929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920cc82a5ed842ffb1b2a129cb3f7e3f', 'request_id': 'req-ee4f3026-8a93-4137-980e-70f6d4384629'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:40.953234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] The token cache is being invalidate because project 920cc82a5ed842ffb1b2a129cb3f7e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:40.953528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:40.954212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ee4f3026-8a93-4137-980e-70f6d4384629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:40.955690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1260/2511] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:40 2022] DELETE /identity/v3/projects/920cc82a5ed842ffb1b2a129cb3f7e3f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:40.960779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd383477-eea4-4ca0-825c-81a65e30cf26 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:40.969344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd383477-eea4-4ca0-825c-81a65e30cf26 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:40.969344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd383477-eea4-4ca0-825c-81a65e30cf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:40.987363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-cd383477-eea4-4ca0-825c-81a65e30cf26 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:40.988655 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-cd383477-eea4-4ca0-825c-81a65e30cf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:41.060838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1252/2512] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:41.069551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb318-6d99-49b3-a847-88db410cf467 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.070050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb318-6d99-49b3-a847-88db410cf467 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.070552 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832eb318-6d99-49b3-a847-88db410cf467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.095602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-832eb318-6d99-49b3-a847-88db410cf467 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:41.096870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-832eb318-6d99-49b3-a847-88db410cf467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:41.107020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1261/2513] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:41.111649 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd383477-eea4-4ca0-825c-81a65e30cf26 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.122611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd383477-eea4-4ca0-825c-81a65e30cf26 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.127837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177387bc-4b2b-4896-b0c4-4146028b2330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.129858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177387bc-4b2b-4896-b0c4-4146028b2330 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.129858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177387bc-4b2b-4896-b0c4-4146028b2330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.129858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177387bc-4b2b-4896-b0c4-4146028b2330 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.130148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177387bc-4b2b-4896-b0c4-4146028b2330 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:41.130357 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177387bc-4b2b-4896-b0c4-4146028b2330 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.131968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177387bc-4b2b-4896-b0c4-4146028b2330 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.145386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1253/2514] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:41.149474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eb318-6d99-49b3-a847-88db410cf467 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.159634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832eb318-6d99-49b3-a847-88db410cf467 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.164434 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af408d-c58d-4544-b91e-394fd01e40e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.165038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af408d-c58d-4544-b91e-394fd01e40e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.165557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af408d-c58d-4544-b91e-394fd01e40e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.166141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af408d-c58d-4544-b91e-394fd01e40e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.166797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af408d-c58d-4544-b91e-394fd01e40e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.168736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af408d-c58d-4544-b91e-394fd01e40e7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.258535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1262/2515] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:25:41 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:25:41.263384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177387bc-4b2b-4896-b0c4-4146028b2330 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.273680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177387bc-4b2b-4896-b0c4-4146028b2330 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.303624 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:41.334026 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd380-ecf1-4a61-9689-6b966f9bd9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.335056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd380-ecf1-4a61-9689-6b966f9bd9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.335558 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd380-ecf1-4a61-9689-6b966f9bd9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.336064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd380-ecf1-4a61-9689-6b966f9bd9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.337419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cd380-ecf1-4a61-9689-6b966f9bd9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.341246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cd380-ecf1-4a61-9689-6b966f9bd9d9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.452320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1254/2516] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:25:41 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:41.456628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af408d-c58d-4544-b91e-394fd01e40e7 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.467374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af408d-c58d-4544-b91e-394fd01e40e7 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.476911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbbe68-79f2-4a5b-8f91-792d06c4c376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.477632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbe68-79f2-4a5b-8f91-792d06c4c376 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.477925 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbe68-79f2-4a5b-8f91-792d06c4c376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.478235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbbe68-79f2-4a5b-8f91-792d06c4c376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.479031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbbe68-79f2-4a5b-8f91-792d06c4c376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.480683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccbbe68-79f2-4a5b-8f91-792d06c4c376 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.491127 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1263/2517] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:41.495848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd380-ecf1-4a61-9689-6b966f9bd9d9 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.506163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd380-ecf1-4a61-9689-6b966f9bd9d9 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.511792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4deda8e-c931-4ce3-aca0-74f1a41324ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.512425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deda8e-c931-4ce3-aca0-74f1a41324ad admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.512659 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deda8e-c931-4ce3-aca0-74f1a41324ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.512930 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4deda8e-c931-4ce3-aca0-74f1a41324ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.513577 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4deda8e-c931-4ce3-aca0-74f1a41324ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.515214 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4deda8e-c931-4ce3-aca0-74f1a41324ad admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.525872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1255/2518] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:25:41.530093 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbbe68-79f2-4a5b-8f91-792d06c4c376 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.540711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbbe68-79f2-4a5b-8f91-792d06c4c376 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.545636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb101-1654-46f9-9d80-03a3aca3c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.546285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb101-1654-46f9-9d80-03a3aca3c362 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.546568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb101-1654-46f9-9d80-03a3aca3c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.546871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb101-1654-46f9-9d80-03a3aca3c362 admin admin] PATH_INFO: `/v3/projects/66ee87b8294f40f797a317925be6795a/users/33d8e330aab44d92ada68b3c91bde347/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.562994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acb101-1654-46f9-9d80-03a3aca3c362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ee87b8294f40f797a317925be6795a, user_id=33d8e330aab44d92ada68b3c91bde347, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.565616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acb101-1654-46f9-9d80-03a3aca3c362 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.657324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1264/2519] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:41 2022] PUT /identity/v3/projects/66ee87b8294f40f797a317925be6795a/users/33d8e330aab44d92ada68b3c91bde347/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:41.670396 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d951e44-3689-4b57-8e6b-d9999014b1d0 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.670709 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d951e44-3689-4b57-8e6b-d9999014b1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.671057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d951e44-3689-4b57-8e6b-d9999014b1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.702410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-0d951e44-3689-4b57-8e6b-d9999014b1d0 None None] MFA Rules not processed for user `33d8e330aab44d92ada68b3c91bde347`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:41.703652 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0d951e44-3689-4b57-8e6b-d9999014b1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:41.773630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1256/2520] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:41.790821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb101-1654-46f9-9d80-03a3aca3c362 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:41.790821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-95acb101-1654-46f9-9d80-03a3aca3c362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:41.846080 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb101-1654-46f9-9d80-03a3aca3c362 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:41.849800 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69d5e7-d301-46b3-94f2-408b3e29bd82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:41.850419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69d5e7-d301-46b3-94f2-408b3e29bd82 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:41.850699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69d5e7-d301-46b3-94f2-408b3e29bd82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:41.851017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69d5e7-d301-46b3-94f2-408b3e29bd82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:41.861566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69d5e7-d301-46b3-94f2-408b3e29bd82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:41.863067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69d5e7-d301-46b3-94f2-408b3e29bd82 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:41.873858 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1265/2521] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:46.857464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d951e44-3689-4b57-8e6b-d9999014b1d0 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:46.859148 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0d951e44-3689-4b57-8e6b-d9999014b1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:46.921321 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d951e44-3689-4b57-8e6b-d9999014b1d0 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:46.925198 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930c6be-c363-4586-8c54-00224bce7449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:46.925799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c6be-c363-4586-8c54-00224bce7449 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:46.926078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c6be-c363-4586-8c54-00224bce7449 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:46.926349 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c6be-c363-4586-8c54-00224bce7449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:46.928150 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8930c6be-c363-4586-8c54-00224bce7449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:46.988756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:46.992947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930c6be-c363-4586-8c54-00224bce7449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:46.995440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930c6be-c363-4586-8c54-00224bce7449 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:47.005442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1257/2522] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:48.858235 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69d5e7-d301-46b3-94f2-408b3e29bd82 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:48.924200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:48.938213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69d5e7-d301-46b3-94f2-408b3e29bd82 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:48.942879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:48.943526 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:48.943809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:48.944087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] PATH_INFO: `/v3/users/33d8e330aab44d92ada68b3c91bde347` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:48.945276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d8e330aab44d92ada68b3c91bde347)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:48.947528 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:49.130380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d8e330aab44d92ada68b3c91bde347'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:49.131059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d8e330aab44d92ada68b3c91bde347'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:49.138740 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d8e330aab44d92ada68b3c91bde347'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:49.139386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d8e330aab44d92ada68b3c91bde347'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:49.151700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d8e330aab44d92ada68b3c91bde347'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:49.231137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1266/2523] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:25:48 2022] DELETE /identity/v3/users/33d8e330aab44d92ada68b3c91bde347 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:49.235631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01f83c-b2e0-4b16-8a3e-18169cc65606 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:49.236112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01f83c-b2e0-4b16-8a3e-18169cc65606 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:49.236208 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01f83c-b2e0-4b16-8a3e-18169cc65606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:49.256584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-7b01f83c-b2e0-4b16-8a3e-18169cc65606 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:49.257787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7b01f83c-b2e0-4b16-8a3e-18169cc65606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:49.322994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1258/2524] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:49.332808 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:49.334249 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:49.394289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b5a6f-6522-47ab-8b84-9ff53ad0e8f2 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:49.397934 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de71137-eb47-4d51-9e6d-1b2320f2aaa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:49.398540 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de71137-eb47-4d51-9e6d-1b2320f2aaa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:49.398819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de71137-eb47-4d51-9e6d-1b2320f2aaa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:49.399091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de71137-eb47-4d51-9e6d-1b2320f2aaa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:49.410543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de71137-eb47-4d51-9e6d-1b2320f2aaa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:49.411991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de71137-eb47-4d51-9e6d-1b2320f2aaa6 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:49.422181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1267/2525] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:50.056515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01f83c-b2e0-4b16-8a3e-18169cc65606 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.058620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7b01f83c-b2e0-4b16-8a3e-18169cc65606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:50.071216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01f83c-b2e0-4b16-8a3e-18169cc65606 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.076035 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.076709 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.076988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.077261 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] PATH_INFO: `/v3/projects/66ee87b8294f40f797a317925be6795a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.078400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ee87b8294f40f797a317925be6795a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.080381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.188012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ee87b8294f40f797a317925be6795a', 'request_id': 'req-d5d9b0f5-1649-4b7f-aab2-892372111194'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:50.260633 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ee87b8294f40f797a317925be6795a', 'request_id': 'req-d5d9b0f5-1649-4b7f-aab2-892372111194'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:50.264020 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ee87b8294f40f797a317925be6795a', 'request_id': 'req-d5d9b0f5-1649-4b7f-aab2-892372111194'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:50.275294 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] The token cache is being invalidate because project 66ee87b8294f40f797a317925be6795a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:25:50.275584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:50.276251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d5d9b0f5-1649-4b7f-aab2-892372111194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:25:50.277835 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1259/2526] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:25:50 2022] DELETE /identity/v3/projects/66ee87b8294f40f797a317925be6795a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:50.282790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e11bd-6700-4a09-a156-b1a2b8e6970c None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.283251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e11bd-6700-4a09-a156-b1a2b8e6970c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.283343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e11bd-6700-4a09-a156-b1a2b8e6970c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.304350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-fa3e11bd-6700-4a09-a156-b1a2b8e6970c None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:50.305941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fa3e11bd-6700-4a09-a156-b1a2b8e6970c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:50.367842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1268/2527] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:50.376295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394df65-b733-4aea-8366-c0f6031d6b92 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.376583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394df65-b733-4aea-8366-c0f6031d6b92 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.376860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394df65-b733-4aea-8366-c0f6031d6b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.396760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6394df65-b733-4aea-8366-c0f6031d6b92 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:50.398056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6394df65-b733-4aea-8366-c0f6031d6b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:50.407601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1260/2528] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:50.411944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e11bd-6700-4a09-a156-b1a2b8e6970c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.422387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e11bd-6700-4a09-a156-b1a2b8e6970c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.427020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed95f5-0a84-47ec-a9b1-192b69eec5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.427617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed95f5-0a84-47ec-a9b1-192b69eec5de admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.427893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed95f5-0a84-47ec-a9b1-192b69eec5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.428194 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed95f5-0a84-47ec-a9b1-192b69eec5de admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.428864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed95f5-0a84-47ec-a9b1-192b69eec5de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:25:50.429166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed95f5-0a84-47ec-a9b1-192b69eec5de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.431079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed95f5-0a84-47ec-a9b1-192b69eec5de admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.437826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:50.442967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1269/2529] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:25:50.447679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394df65-b733-4aea-8366-c0f6031d6b92 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.457224 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394df65-b733-4aea-8366-c0f6031d6b92 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.462428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d257d72-bb5e-4519-a29a-f8edd39b2433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.463472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d257d72-bb5e-4519-a29a-f8edd39b2433 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.463661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d257d72-bb5e-4519-a29a-f8edd39b2433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.463957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d257d72-bb5e-4519-a29a-f8edd39b2433 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.464686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d257d72-bb5e-4519-a29a-f8edd39b2433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.466689 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d257d72-bb5e-4519-a29a-f8edd39b2433 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.583322 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1261/2530] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:25:50 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:50.588098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed95f5-0a84-47ec-a9b1-192b69eec5de admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.599950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed95f5-0a84-47ec-a9b1-192b69eec5de admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.665174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1176fe-4eed-4dd3-a059-77ef70f92eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.666172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1176fe-4eed-4dd3-a059-77ef70f92eed admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.666555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1176fe-4eed-4dd3-a059-77ef70f92eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.666931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1176fe-4eed-4dd3-a059-77ef70f92eed admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.667688 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1176fe-4eed-4dd3-a059-77ef70f92eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.670280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1176fe-4eed-4dd3-a059-77ef70f92eed admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.777161 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1270/2531] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:25:50 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:25:50.781857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d257d72-bb5e-4519-a29a-f8edd39b2433 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.793961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d257d72-bb5e-4519-a29a-f8edd39b2433 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.799761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc4f94-70ff-4587-9ab8-f891d96ff292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.800586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4f94-70ff-4587-9ab8-f891d96ff292 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.800967 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4f94-70ff-4587-9ab8-f891d96ff292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.801342 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4f94-70ff-4587-9ab8-f891d96ff292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.802117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc4f94-70ff-4587-9ab8-f891d96ff292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.803983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc4f94-70ff-4587-9ab8-f891d96ff292 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.818787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1262/2532] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:25:50.820349 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1176fe-4eed-4dd3-a059-77ef70f92eed admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.834401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1176fe-4eed-4dd3-a059-77ef70f92eed admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.840921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d6867-7290-40b8-b238-9da643521e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.845905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d6867-7290-40b8-b238-9da643521e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.845905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d6867-7290-40b8-b238-9da643521e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.845905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d6867-7290-40b8-b238-9da643521e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.845905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d6867-7290-40b8-b238-9da643521e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.845905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d6867-7290-40b8-b238-9da643521e58 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:50.858139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1271/2533] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:25:50.862317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc4f94-70ff-4587-9ab8-f891d96ff292 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:50.875571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc4f94-70ff-4587-9ab8-f891d96ff292 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:50.886902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5afa4-d8eb-4fae-b897-24778dfe2398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:50.887575 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5afa4-d8eb-4fae-b897-24778dfe2398 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:50.887854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5afa4-d8eb-4fae-b897-24778dfe2398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:50.888128 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5afa4-d8eb-4fae-b897-24778dfe2398 admin admin] PATH_INFO: `/v3/projects/5c52baf4c5404324a89e1cbe5a24cf01/users/29394b1c1d79444ba1165529c2d01718/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:50.908799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5afa4-d8eb-4fae-b897-24778dfe2398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c52baf4c5404324a89e1cbe5a24cf01, user_id=29394b1c1d79444ba1165529c2d01718, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:50.911752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5afa4-d8eb-4fae-b897-24778dfe2398 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:51.012713 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1263/2534] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:25:50 2022] PUT /identity/v3/projects/5c52baf4c5404324a89e1cbe5a24cf01/users/29394b1c1d79444ba1165529c2d01718/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:25:51.023941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cf77c-804f-45dd-985e-c889646be924 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:51.025244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cf77c-804f-45dd-985e-c889646be924 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:51.025962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cf77c-804f-45dd-985e-c889646be924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:51.056040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-0b2cf77c-804f-45dd-985e-c889646be924 None None] MFA Rules not processed for user `29394b1c1d79444ba1165529c2d01718`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:25:51.057460 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0b2cf77c-804f-45dd-985e-c889646be924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:51.153747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1272/2535] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:25:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:25:51.166238 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5afa4-d8eb-4fae-b897-24778dfe2398 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:51.169017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-dda5afa4-d8eb-4fae-b897-24778dfe2398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:51.190790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:51.246744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5afa4-d8eb-4fae-b897-24778dfe2398 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:51.252519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c2f7d-f081-49b6-996f-2245efdb9a57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:51.253203 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2f7d-f081-49b6-996f-2245efdb9a57 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:51.253583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2f7d-f081-49b6-996f-2245efdb9a57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:51.253959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c2f7d-f081-49b6-996f-2245efdb9a57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:51.267937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c2f7d-f081-49b6-996f-2245efdb9a57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:51.267937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c2f7d-f081-49b6-996f-2245efdb9a57 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:51.280036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1264/2536] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:54.160518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cf77c-804f-45dd-985e-c889646be924 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:54.162010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-0b2cf77c-804f-45dd-985e-c889646be924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:54.224810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cf77c-804f-45dd-985e-c889646be924 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:54.229300 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c6071-2491-4188-9fb8-48747af82e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:54.229931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c6071-2491-4188-9fb8-48747af82e09 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:54.230620 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c6071-2491-4188-9fb8-48747af82e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:54.230620 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c6071-2491-4188-9fb8-48747af82e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:54.232539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-891c6071-2491-4188-9fb8-48747af82e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:54.253862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:25:54.306181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c6071-2491-4188-9fb8-48747af82e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:54.308341 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c6071-2491-4188-9fb8-48747af82e09 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:54.317716 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1273/2537] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:59.026583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c2f7d-f081-49b6-996f-2245efdb9a57 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:25:59.037728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c2f7d-f081-49b6-996f-2245efdb9a57 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:25:59.042235 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558bdda-2e57-458c-9e0e-583b8e47f5e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:25:59.043236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558bdda-2e57-458c-9e0e-583b8e47f5e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:25:59.043676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558bdda-2e57-458c-9e0e-583b8e47f5e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:25:59.044126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7558bdda-2e57-458c-9e0e-583b8e47f5e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:25:59.046014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7558bdda-2e57-458c-9e0e-583b8e47f5e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:25:59.060125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558bdda-2e57-458c-9e0e-583b8e47f5e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:25:59.061677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7558bdda-2e57-458c-9e0e-583b8e47f5e7 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:25:59.073619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1265/2538] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:03.250240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c6071-2491-4188-9fb8-48747af82e09 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:03.252654 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-891c6071-2491-4188-9fb8-48747af82e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:03.274972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c6071-2491-4188-9fb8-48747af82e09 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:03.282123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:03.283166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:03.292425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:03.292912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] PATH_INFO: `/v3/users/8d9354c3a83641ae974e857d476ed993` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:03.299964 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9354c3a83641ae974e857d476ed993)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:03.302844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:03.521621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9354c3a83641ae974e857d476ed993'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:03.522539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9354c3a83641ae974e857d476ed993'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:03.534451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9354c3a83641ae974e857d476ed993'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:03.535337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9354c3a83641ae974e857d476ed993'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:03.551891 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9354c3a83641ae974e857d476ed993'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:03.606045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558bdda-2e57-458c-9e0e-583b8e47f5e7 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:03.618642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7558bdda-2e57-458c-9e0e-583b8e47f5e7 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:03.624544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8720781-eb34-4bd1-9021-0a88ba0ee856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:03.625466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8720781-eb34-4bd1-9021-0a88ba0ee856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:03.625926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8720781-eb34-4bd1-9021-0a88ba0ee856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:03.626391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8720781-eb34-4bd1-9021-0a88ba0ee856 admin admin] PATH_INFO: `/v3/users/29394b1c1d79444ba1165529c2d01718` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:03.627804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8720781-eb34-4bd1-9021-0a88ba0ee856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29394b1c1d79444ba1165529c2d01718)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:03.630289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8720781-eb34-4bd1-9021-0a88ba0ee856 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:03.663764 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1274/2539] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:03 2022] DELETE /identity/v3/users/8d9354c3a83641ae974e857d476ed993 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:03.886084 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a8720781-eb34-4bd1-9021-0a88ba0ee856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29394b1c1d79444ba1165529c2d01718'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:03.886854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a8720781-eb34-4bd1-9021-0a88ba0ee856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29394b1c1d79444ba1165529c2d01718'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:03.887477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a8720781-eb34-4bd1-9021-0a88ba0ee856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29394b1c1d79444ba1165529c2d01718'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:03.901793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a8720781-eb34-4bd1-9021-0a88ba0ee856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29394b1c1d79444ba1165529c2d01718'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:03.941205 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:03.943758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:03.959500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a8720781-eb34-4bd1-9021-0a88ba0ee856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29394b1c1d79444ba1165529c2d01718'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:03.985216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1266/2540] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:03 2022] DELETE /identity/v3/users/29394b1c1d79444ba1165529c2d01718 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:03.989189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11622-1a88-4fa3-a078-8386e55446dc None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:03.989476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11622-1a88-4fa3-a078-8386e55446dc None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:03.989753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11622-1a88-4fa3-a078-8386e55446dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.010942 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-72d11622-1a88-4fa3-a078-8386e55446dc None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:04.012189 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-72d11622-1a88-4fa3-a078-8386e55446dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:04.031844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883c825-6db7-4891-893a-8c2e8dafacf3 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.068902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:04.095994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.096684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.096962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.097466 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] PATH_INFO: `/v3/projects/381091a266174387b925259fca3f7807` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.098384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=381091a266174387b925259fca3f7807)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.100535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.112462 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1267/2541] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:04.120377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d11622-1a88-4fa3-a078-8386e55446dc None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.122924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-72d11622-1a88-4fa3-a078-8386e55446dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:04.142674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:04.180534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d11622-1a88-4fa3-a078-8386e55446dc None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.184144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59666243-b28b-449f-aea5-9e4053caab88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.184783 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59666243-b28b-449f-aea5-9e4053caab88 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.185063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59666243-b28b-449f-aea5-9e4053caab88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.185330 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59666243-b28b-449f-aea5-9e4053caab88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.194445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59666243-b28b-449f-aea5-9e4053caab88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.196651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59666243-b28b-449f-aea5-9e4053caab88 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.206740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1268/2542] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:04.220828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59666243-b28b-449f-aea5-9e4053caab88 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.222596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-59666243-b28b-449f-aea5-9e4053caab88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:04.239605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59666243-b28b-449f-aea5-9e4053caab88 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.244803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.245519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.245787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.246241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] PATH_INFO: `/v3/users/a0ad0c892c464a7ab40a683ca588963a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.247402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ad0c892c464a7ab40a683ca588963a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.249353 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.274634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381091a266174387b925259fca3f7807', 'request_id': 'req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.385449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381091a266174387b925259fca3f7807', 'request_id': 'req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.392463 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381091a266174387b925259fca3f7807', 'request_id': 'req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.405855 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] The token cache is being invalidate because project 381091a266174387b925259fca3f7807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:04.406186 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.406853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.408410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1275/2543] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:03 2022] DELETE /identity/v3/projects/381091a266174387b925259fca3f7807 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:04.413107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.413766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:04.471804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ad0c892c464a7ab40a683ca588963a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.472617 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ad0c892c464a7ab40a683ca588963a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.473834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ad0c892c464a7ab40a683ca588963a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.490766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43728c4-7c31-4fe7-af7b-31c5d6eb1c05 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.496827 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ad0c892c464a7ab40a683ca588963a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.498864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.499577 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.499857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.501262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] PATH_INFO: `/v3/users/b3e5341b2bbd4983a334bf72530ef0d9` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.502953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e5341b2bbd4983a334bf72530ef0d9)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.505619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.565566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ad0c892c464a7ab40a683ca588963a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.579548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1269/2544] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:04 2022] DELETE /identity/v3/users/a0ad0c892c464a7ab40a683ca588963a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:04.686192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.687753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:04.706572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e5341b2bbd4983a334bf72530ef0d9'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.707524 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e5341b2bbd4983a334bf72530ef0d9'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.718690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e5341b2bbd4983a334bf72530ef0d9'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.720721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e5341b2bbd4983a334bf72530ef0d9'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.736816 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:04.743086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e5341b2bbd4983a334bf72530ef0d9'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.781303 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f138256-59e0-47e5-93a4-a89147346023 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:04.786139 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:04.786775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:04.787057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:04.787332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] PATH_INFO: `/v3/projects/5c52baf4c5404324a89e1cbe5a24cf01` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:04.788496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c52baf4c5404324a89e1cbe5a24cf01)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:04.790928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:04.860069 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1276/2545] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:04 2022] DELETE /identity/v3/users/b3e5341b2bbd4983a334bf72530ef0d9 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:04.915506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:04.925364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:04.926946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:04.937733 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c52baf4c5404324a89e1cbe5a24cf01', 'request_id': 'req-79211e14-6143-4996-bbee-ec218fa69b7a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:04.999483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c52baf4c5404324a89e1cbe5a24cf01', 'request_id': 'req-79211e14-6143-4996-bbee-ec218fa69b7a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.003383 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8f6dd-f780-4db4-9aaf-1fdd41f5f63c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.007573 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c52baf4c5404324a89e1cbe5a24cf01', 'request_id': 'req-79211e14-6143-4996-bbee-ec218fa69b7a'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.020351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] The token cache is being invalidate because project 5c52baf4c5404324a89e1cbe5a24cf01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:05.020636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.021326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.036932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1270/2546] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:04 2022] DELETE /identity/v3/projects/5c52baf4c5404324a89e1cbe5a24cf01 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:05.069998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.070870 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.071000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.071237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] PATH_INFO: `/v3/projects/469be12962204784857322668505a18b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.072520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469be12962204784857322668505a18b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.074475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.153605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.155274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:05.170414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79211e14-6143-4996-bbee-ec218fa69b7a admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.188045 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.189730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.189730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.190107 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] PATH_INFO: `/v3/projects/eed60fcd8ff049ed9f35075e7a332d87` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.191886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eed60fcd8ff049ed9f35075e7a332d87)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.194373 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.197164 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469be12962204784857322668505a18b', 'request_id': 'req-70083bd2-9f3f-414f-86fc-c72283f40d01'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.337662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469be12962204784857322668505a18b', 'request_id': 'req-70083bd2-9f3f-414f-86fc-c72283f40d01'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.344691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469be12962204784857322668505a18b', 'request_id': 'req-70083bd2-9f3f-414f-86fc-c72283f40d01'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.356490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eed60fcd8ff049ed9f35075e7a332d87', 'request_id': 'req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.356716 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] The token cache is being invalidate because project 469be12962204784857322668505a18b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:05.360302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.360302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-70083bd2-9f3f-414f-86fc-c72283f40d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.360302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1277/2547] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:04 2022] DELETE /identity/v3/projects/469be12962204784857322668505a18b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:05.364141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f161b2-6dd7-4372-9b97-c7379b813b0f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.364453 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f161b2-6dd7-4372-9b97-c7379b813b0f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.364725 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f161b2-6dd7-4372-9b97-c7379b813b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.384615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-05f161b2-6dd7-4372-9b97-c7379b813b0f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:05.385827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-05f161b2-6dd7-4372-9b97-c7379b813b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:05.413219 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:05.441583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eed60fcd8ff049ed9f35075e7a332d87', 'request_id': 'req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.449698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eed60fcd8ff049ed9f35075e7a332d87', 'request_id': 'req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.451103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1278/2548] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:05.459281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7de89-a615-4634-a5bd-5f3ae1ece71f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.459570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7de89-a615-4634-a5bd-5f3ae1ece71f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.459849 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7de89-a615-4634-a5bd-5f3ae1ece71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.462079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] The token cache is being invalidate because project eed60fcd8ff049ed9f35075e7a332d87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:05.462595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.463367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:05.464915 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1271/2549] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:05 2022] DELETE /identity/v3/projects/eed60fcd8ff049ed9f35075e7a332d87 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:05.484908 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-b5b7de89-a615-4634-a5bd-5f3ae1ece71f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:05.486182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b5b7de89-a615-4634-a5bd-5f3ae1ece71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:05.494766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1279/2550] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:05.499369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.510853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e309c-36a7-4bd8-a1bf-b3d40b3acbc4 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.515880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f2b01-7057-487d-bd72-9c794e2411d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.516556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f2b01-7057-487d-bd72-9c794e2411d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.516837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f2b01-7057-487d-bd72-9c794e2411d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.517111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f2b01-7057-487d-bd72-9c794e2411d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.517777 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f2b01-7057-487d-bd72-9c794e2411d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:05.518115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f2b01-7057-487d-bd72-9c794e2411d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.519742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f2b01-7057-487d-bd72-9c794e2411d3 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.537871 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1272/2551] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:05.543215 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7de89-a615-4634-a5bd-5f3ae1ece71f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.550147 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7de89-a615-4634-a5bd-5f3ae1ece71f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.555600 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec39ead-9f80-40e6-bffa-323af82fb02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.556258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39ead-9f80-40e6-bffa-323af82fb02c admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.556547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39ead-9f80-40e6-bffa-323af82fb02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.556820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec39ead-9f80-40e6-bffa-323af82fb02c admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.557498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec39ead-9f80-40e6-bffa-323af82fb02c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.559454 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec39ead-9f80-40e6-bffa-323af82fb02c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.670830 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1280/2552] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:05 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:05.672522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f2b01-7057-487d-bd72-9c794e2411d3 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.683607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f2b01-7057-487d-bd72-9c794e2411d3 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.745956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1b491-3633-47ed-b460-0700c880f0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.746704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1b491-3633-47ed-b460-0700c880f0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.746865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1b491-3633-47ed-b460-0700c880f0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.747144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1b491-3633-47ed-b460-0700c880f0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.747787 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1b491-3633-47ed-b460-0700c880f0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.749727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1b491-3633-47ed-b460-0700c880f0e0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.900549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1273/2553] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:05 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:05.905104 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec39ead-9f80-40e6-bffa-323af82fb02c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.916537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec39ead-9f80-40e6-bffa-323af82fb02c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.921346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d236b-28f9-4df2-b513-660a2a358bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.921950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d236b-28f9-4df2-b513-660a2a358bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.922228 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d236b-28f9-4df2-b513-660a2a358bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.922498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d236b-28f9-4df2-b513-660a2a358bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.923168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d236b-28f9-4df2-b513-660a2a358bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.924802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d236b-28f9-4df2-b513-660a2a358bcb admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.935491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1281/2554] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:05.939704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1b491-3633-47ed-b460-0700c880f0e0 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.950674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1b491-3633-47ed-b460-0700c880f0e0 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.955582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7af8ca-4e6f-4a4a-9f5e-739bd086f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.956185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7af8ca-4e6f-4a4a-9f5e-739bd086f52f admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.956502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7af8ca-4e6f-4a4a-9f5e-739bd086f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.956773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7af8ca-4e6f-4a4a-9f5e-739bd086f52f admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:05.957450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7af8ca-4e6f-4a4a-9f5e-739bd086f52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:05.959039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7af8ca-4e6f-4a4a-9f5e-739bd086f52f admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:05.970122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1274/2555] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:05.974301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d236b-28f9-4df2-b513-660a2a358bcb admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:05.984683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d236b-28f9-4df2-b513-660a2a358bcb admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:05.989445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02f38c-f0ad-4f34-ac8f-9c559533694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:05.990012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02f38c-f0ad-4f34-ac8f-9c559533694b admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:05.990292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02f38c-f0ad-4f34-ac8f-9c559533694b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:05.990573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02f38c-f0ad-4f34-ac8f-9c559533694b admin admin] PATH_INFO: `/v3/projects/ef723ec3183f429c9ccde7705b6b2958/users/5ed77f50980c400297307aff41c2e0dc/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.006787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02f38c-f0ad-4f34-ac8f-9c559533694b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef723ec3183f429c9ccde7705b6b2958, user_id=5ed77f50980c400297307aff41c2e0dc, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.010251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02f38c-f0ad-4f34-ac8f-9c559533694b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.081593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1282/2556] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:05 2022] PUT /identity/v3/projects/ef723ec3183f429c9ccde7705b6b2958/users/5ed77f50980c400297307aff41c2e0dc/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:06.093374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520c38-3599-4805-9e3b-d06851898bbf None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.093663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520c38-3599-4805-9e3b-d06851898bbf None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.093943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520c38-3599-4805-9e3b-d06851898bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.113944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:06.123126 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-30520c38-3599-4805-9e3b-d06851898bbf None None] MFA Rules not processed for user `5ed77f50980c400297307aff41c2e0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:06.124591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-30520c38-3599-4805-9e3b-d06851898bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:06.194640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1275/2557] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:06.206440 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02f38c-f0ad-4f34-ac8f-9c559533694b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:06.208143 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ed02f38c-f0ad-4f34-ac8f-9c559533694b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:06.267342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02f38c-f0ad-4f34-ac8f-9c559533694b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:06.270983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a735fa8-2a33-4d77-953b-81b53bf0e5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:06.271601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735fa8-2a33-4d77-953b-81b53bf0e5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:06.271868 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735fa8-2a33-4d77-953b-81b53bf0e5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:06.272139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735fa8-2a33-4d77-953b-81b53bf0e5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:06.281059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735fa8-2a33-4d77-953b-81b53bf0e5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:06.282501 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735fa8-2a33-4d77-953b-81b53bf0e5c7 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:06.292937 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1283/2558] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:16.191485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30520c38-3599-4805-9e3b-d06851898bbf None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:16.259297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30520c38-3599-4805-9e3b-d06851898bbf None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:16.264256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:16.264959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.265243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.265529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] PATH_INFO: `/v3/users/5ed77f50980c400297307aff41c2e0dc` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.266794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed77f50980c400297307aff41c2e0dc)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:16.268891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:16.288500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=70,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:16.487746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed77f50980c400297307aff41c2e0dc'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:16.488478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed77f50980c400297307aff41c2e0dc'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:16.492282 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed77f50980c400297307aff41c2e0dc'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:16.503275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed77f50980c400297307aff41c2e0dc'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:16.578729 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed77f50980c400297307aff41c2e0dc'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:16.593769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1276/2559] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:16 2022] DELETE /identity/v3/users/5ed77f50980c400297307aff41c2e0dc => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:16.598881 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e39c06-f4d0-4009-b134-51dc5aac97b9 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.599342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e39c06-f4d0-4009-b134-51dc5aac97b9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.599769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e39c06-f4d0-4009-b134-51dc5aac97b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.627929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-95e39c06-f4d0-4009-b134-51dc5aac97b9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:16.630068 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-95e39c06-f4d0-4009-b134-51dc5aac97b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:16.698317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1284/2560] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:16.708992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:16.710715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:16.732758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:16.774222 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198db74-f6ec-4f9b-9a9e-f152dd280671 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:16.778605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842775a8-353a-4e5f-bf24-d650eb401684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:16.779229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842775a8-353a-4e5f-bf24-d650eb401684 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:16.779501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842775a8-353a-4e5f-bf24-d650eb401684 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:16.779794 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842775a8-353a-4e5f-bf24-d650eb401684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:16.790155 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842775a8-353a-4e5f-bf24-d650eb401684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:16.791696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842775a8-353a-4e5f-bf24-d650eb401684 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:16.802698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1277/2561] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:17.244398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e39c06-f4d0-4009-b134-51dc5aac97b9 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:17.249991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-95e39c06-f4d0-4009-b134-51dc5aac97b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:17.262473 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e39c06-f4d0-4009-b134-51dc5aac97b9 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:17.267610 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:17.268351 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.268704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.269014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] PATH_INFO: `/v3/projects/ef723ec3183f429c9ccde7705b6b2958` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.270263 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef723ec3183f429c9ccde7705b6b2958)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:17.272517 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:17.416340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef723ec3183f429c9ccde7705b6b2958', 'request_id': 'req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:17.527423 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef723ec3183f429c9ccde7705b6b2958', 'request_id': 'req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:17.535337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef723ec3183f429c9ccde7705b6b2958', 'request_id': 'req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:17.549015 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] The token cache is being invalidate because project ef723ec3183f429c9ccde7705b6b2958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:17.549292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:17.550188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f2777485-1ec3-42cf-9cd5-15348b5f8ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:17.551726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1285/2562] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:17 2022] DELETE /identity/v3/projects/ef723ec3183f429c9ccde7705b6b2958 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:17.557194 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb93e-16e9-482c-af6d-ed059d6b559d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.557825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb93e-16e9-482c-af6d-ed059d6b559d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.557825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bb93e-16e9-482c-af6d-ed059d6b559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.578605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ff7bb93e-16e9-482c-af6d-ed059d6b559d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:17.579850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ff7bb93e-16e9-482c-af6d-ed059d6b559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:17.647263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1278/2563] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:17.656831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64bc50-d0e0-4367-90ff-337c8762efba None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.657516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64bc50-d0e0-4367-90ff-337c8762efba None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.657988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64bc50-d0e0-4367-90ff-337c8762efba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.683821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-be64bc50-d0e0-4367-90ff-337c8762efba None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:17.686022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-be64bc50-d0e0-4367-90ff-337c8762efba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:17.698014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1286/2564] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:17.703724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb93e-16e9-482c-af6d-ed059d6b559d None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:17.714470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7bb93e-16e9-482c-af6d-ed059d6b559d None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:17.721244 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fffd61-3ef0-4431-892f-ad88823ad79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:17.721926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fffd61-3ef0-4431-892f-ad88823ad79c admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.722271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fffd61-3ef0-4431-892f-ad88823ad79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.723235 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fffd61-3ef0-4431-892f-ad88823ad79c admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.723371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fffd61-3ef0-4431-892f-ad88823ad79c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:17.723731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fffd61-3ef0-4431-892f-ad88823ad79c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:17.725513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fffd61-3ef0-4431-892f-ad88823ad79c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:17.742981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1279/2565] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:17.744685 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64bc50-d0e0-4367-90ff-337c8762efba None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:17.755482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64bc50-d0e0-4367-90ff-337c8762efba None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:17.760457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb13c7c-70cf-4650-b0ce-1675bf727b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:17.761112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13c7c-70cf-4650-b0ce-1675bf727b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.761389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13c7c-70cf-4650-b0ce-1675bf727b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.761661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb13c7c-70cf-4650-b0ce-1675bf727b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.762298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb13c7c-70cf-4650-b0ce-1675bf727b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:17.764442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb13c7c-70cf-4650-b0ce-1675bf727b71 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:17.879075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1287/2566] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:17 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:17.883410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fffd61-3ef0-4431-892f-ad88823ad79c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:17.895031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fffd61-3ef0-4431-892f-ad88823ad79c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:17.961006 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc2036-5ad6-4023-8e66-7ca0d279c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:17.961798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc2036-5ad6-4023-8e66-7ca0d279c89b admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:17.962187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc2036-5ad6-4023-8e66-7ca0d279c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:17.962667 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc2036-5ad6-4023-8e66-7ca0d279c89b admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:17.963822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc2036-5ad6-4023-8e66-7ca0d279c89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:17.967694 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc2036-5ad6-4023-8e66-7ca0d279c89b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.110263 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1280/2567] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:17 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:18.114596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb13c7c-70cf-4650-b0ce-1675bf727b71 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:18.125257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb13c7c-70cf-4650-b0ce-1675bf727b71 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.133587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c73078-ce46-4f84-8d06-854e84cc72c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.133587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73078-ce46-4f84-8d06-854e84cc72c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.133587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73078-ce46-4f84-8d06-854e84cc72c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.133587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c73078-ce46-4f84-8d06-854e84cc72c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.134024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c73078-ce46-4f84-8d06-854e84cc72c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.134024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c73078-ce46-4f84-8d06-854e84cc72c7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.145303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1288/2568] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:18.149441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc2036-5ad6-4023-8e66-7ca0d279c89b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:18.161824 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc2036-5ad6-4023-8e66-7ca0d279c89b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.166803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11f20a-3791-4b16-8148-52c2b918a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.167434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f20a-3791-4b16-8148-52c2b918a341 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.167750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f20a-3791-4b16-8148-52c2b918a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.168090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f20a-3791-4b16-8148-52c2b918a341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.168775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11f20a-3791-4b16-8148-52c2b918a341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.170986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11f20a-3791-4b16-8148-52c2b918a341 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.182090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1281/2569] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:18.186506 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c73078-ce46-4f84-8d06-854e84cc72c7 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:18.196807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c73078-ce46-4f84-8d06-854e84cc72c7 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.201990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f610beb-2f59-4b9b-9879-4543cbe10425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.202648 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f610beb-2f59-4b9b-9879-4543cbe10425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.202946 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f610beb-2f59-4b9b-9879-4543cbe10425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.203216 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f610beb-2f59-4b9b-9879-4543cbe10425 admin admin] PATH_INFO: `/v3/projects/290306a1a0f44aae8f561c6eefcd011a/users/7812aca75eaa4dda93ebd1ab2dc025a5/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.218679 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f610beb-2f59-4b9b-9879-4543cbe10425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290306a1a0f44aae8f561c6eefcd011a, user_id=7812aca75eaa4dda93ebd1ab2dc025a5, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.221385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f610beb-2f59-4b9b-9879-4543cbe10425 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.309004 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1289/2570] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:18 2022] PUT /identity/v3/projects/290306a1a0f44aae8f561c6eefcd011a/users/7812aca75eaa4dda93ebd1ab2dc025a5/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:18.320724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be85e28-0b63-408a-8ec0-ccc8c95f724c None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.321013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be85e28-0b63-408a-8ec0-ccc8c95f724c None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.321289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be85e28-0b63-408a-8ec0-ccc8c95f724c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.350414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1be85e28-0b63-408a-8ec0-ccc8c95f724c None None] MFA Rules not processed for user `7812aca75eaa4dda93ebd1ab2dc025a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:18.351818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1be85e28-0b63-408a-8ec0-ccc8c95f724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:18.365118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:18.419585 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1282/2571] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:18.424783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f610beb-2f59-4b9b-9879-4543cbe10425 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:18.447449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:18.496267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f610beb-2f59-4b9b-9879-4543cbe10425 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.502391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef6054-3d21-4338-81d7-1ed16d371249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.503018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef6054-3d21-4338-81d7-1ed16d371249 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.503603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef6054-3d21-4338-81d7-1ed16d371249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.503887 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef6054-3d21-4338-81d7-1ed16d371249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.504594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef6054-3d21-4338-81d7-1ed16d371249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.506570 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef6054-3d21-4338-81d7-1ed16d371249 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.614293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1290/2572] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:18 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:18.618450 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be85e28-0b63-408a-8ec0-ccc8c95f724c None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:18.631356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be85e28-0b63-408a-8ec0-ccc8c95f724c None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.691073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92abfe9-bfe4-4bc6-8fa7-b0e6c4f17fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.691607 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92abfe9-bfe4-4bc6-8fa7-b0e6c4f17fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.691883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92abfe9-bfe4-4bc6-8fa7-b0e6c4f17fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.692150 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92abfe9-bfe4-4bc6-8fa7-b0e6c4f17fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.692804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92abfe9-bfe4-4bc6-8fa7-b0e6c4f17fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.694737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92abfe9-bfe4-4bc6-8fa7-b0e6c4f17fd1 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.794991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1283/2573] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:18 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:18.799772 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef6054-3d21-4338-81d7-1ed16d371249 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:18.812439 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef6054-3d21-4338-81d7-1ed16d371249 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.817596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb823e-ccc3-4040-94f9-a61fa71b4aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.818276 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb823e-ccc3-4040-94f9-a61fa71b4aab admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.818557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb823e-ccc3-4040-94f9-a61fa71b4aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.818831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb823e-ccc3-4040-94f9-a61fa71b4aab admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.819539 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb823e-ccc3-4040-94f9-a61fa71b4aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.821216 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb823e-ccc3-4040-94f9-a61fa71b4aab admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:18.832686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1291/2574] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:18.837165 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92abfe9-bfe4-4bc6-8fa7-b0e6c4f17fd1 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:18.847825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92abfe9-bfe4-4bc6-8fa7-b0e6c4f17fd1 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:18.852559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cd82c-5ebb-4599-99ae-f8cde7b10b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:18.853205 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd82c-5ebb-4599-99ae-f8cde7b10b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:18.853512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd82c-5ebb-4599-99ae-f8cde7b10b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:18.853764 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd82c-5ebb-4599-99ae-f8cde7b10b94 admin admin] PATH_INFO: `/v3/projects/1130930e92b2418eae797f5e1eeba66d/users/46b5f9d82dd84a36a91366a8eb69f4ef/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:18.869608 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cd82c-5ebb-4599-99ae-f8cde7b10b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1130930e92b2418eae797f5e1eeba66d, user_id=46b5f9d82dd84a36a91366a8eb69f4ef, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:18.872339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cd82c-5ebb-4599-99ae-f8cde7b10b94 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:19.009402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1284/2575] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:18 2022] PUT /identity/v3/projects/1130930e92b2418eae797f5e1eeba66d/users/46b5f9d82dd84a36a91366a8eb69f4ef/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:19.015733 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb823e-ccc3-4040-94f9-a61fa71b4aab admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:19.030501 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb823e-ccc3-4040-94f9-a61fa71b4aab admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:19.097266 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4213894-0903-4e60-9908-a63799d17de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:19.097857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4213894-0903-4e60-9908-a63799d17de8 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:19.098157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4213894-0903-4e60-9908-a63799d17de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:19.098428 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4213894-0903-4e60-9908-a63799d17de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:19.099076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4213894-0903-4e60-9908-a63799d17de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:19.100784 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4213894-0903-4e60-9908-a63799d17de8 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:19.114088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1292/2576] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:19.124368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cd82c-5ebb-4599-99ae-f8cde7b10b94 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:19.135513 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cd82c-5ebb-4599-99ae-f8cde7b10b94 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:19.141228 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb66ba-2311-4469-a71b-8cdb9b529da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:19.142009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb66ba-2311-4469-a71b-8cdb9b529da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:19.142389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb66ba-2311-4469-a71b-8cdb9b529da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:19.142684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb66ba-2311-4469-a71b-8cdb9b529da6 admin admin] PATH_INFO: `/v3/projects/1130930e92b2418eae797f5e1eeba66d/users/46b5f9d82dd84a36a91366a8eb69f4ef/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:19.144979 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb66ba-2311-4469-a71b-8cdb9b529da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1130930e92b2418eae797f5e1eeba66d, user_id=46b5f9d82dd84a36a91366a8eb69f4ef, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:19.148112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb66ba-2311-4469-a71b-8cdb9b529da6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:19.160619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1285/2577] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:19 2022] PUT /identity/v3/projects/1130930e92b2418eae797f5e1eeba66d/users/46b5f9d82dd84a36a91366a8eb69f4ef/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:19.175072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7ebd2-081d-496a-a4c1-c3321fa5db4a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:19.175961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7ebd2-081d-496a-a4c1-c3321fa5db4a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:19.175961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7ebd2-081d-496a-a4c1-c3321fa5db4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:19.206362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-f6f7ebd2-081d-496a-a4c1-c3321fa5db4a None None] MFA Rules not processed for user `46b5f9d82dd84a36a91366a8eb69f4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:19.207599 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f6f7ebd2-081d-496a-a4c1-c3321fa5db4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:19.276846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1293/2578] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:19.290818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb66ba-2311-4469-a71b-8cdb9b529da6 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:19.293184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-38fb66ba-2311-4469-a71b-8cdb9b529da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:19.353068 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb66ba-2311-4469-a71b-8cdb9b529da6 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:19.357357 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76f560-93ac-4257-8f29-3d60171f7671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:19.357958 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76f560-93ac-4257-8f29-3d60171f7671 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:19.358235 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76f560-93ac-4257-8f29-3d60171f7671 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:19.358503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76f560-93ac-4257-8f29-3d60171f7671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:19.367565 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76f560-93ac-4257-8f29-3d60171f7671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:19.369026 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76f560-93ac-4257-8f29-3d60171f7671 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:19.378967 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1286/2579] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:20.377641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7ebd2-081d-496a-a4c1-c3321fa5db4a None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:20.395594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:20.448017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7ebd2-081d-496a-a4c1-c3321fa5db4a None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:20.454520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:20.455154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.455435 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.455708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] PATH_INFO: `/v3/users/7812aca75eaa4dda93ebd1ab2dc025a5` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.456915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7812aca75eaa4dda93ebd1ab2dc025a5)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:20.459292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:20.652993 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7812aca75eaa4dda93ebd1ab2dc025a5'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:20.654136 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7812aca75eaa4dda93ebd1ab2dc025a5'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:20.661580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7812aca75eaa4dda93ebd1ab2dc025a5'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:20.662265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7812aca75eaa4dda93ebd1ab2dc025a5'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:20.676315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7812aca75eaa4dda93ebd1ab2dc025a5'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:20.772014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1294/2580] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:20 2022] DELETE /identity/v3/users/7812aca75eaa4dda93ebd1ab2dc025a5 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:20.776860 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1973f5-cd8c-41dd-bbbb-b57b7528a9ae None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.777386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1973f5-cd8c-41dd-bbbb-b57b7528a9ae None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.777975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1973f5-cd8c-41dd-bbbb-b57b7528a9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.797772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-3a1973f5-cd8c-41dd-bbbb-b57b7528a9ae None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:20.799005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3a1973f5-cd8c-41dd-bbbb-b57b7528a9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:20.804394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:20.862007 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1287/2581] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:20.876669 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:20.879044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:20.943298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572f905-68b1-4b5d-a8ac-3629b0738452 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:20.947039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835757fa-01bb-40d9-a7a8-995a527454ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:20.947645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835757fa-01bb-40d9-a7a8-995a527454ae service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.947924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835757fa-01bb-40d9-a7a8-995a527454ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.948193 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835757fa-01bb-40d9-a7a8-995a527454ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.958734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835757fa-01bb-40d9-a7a8-995a527454ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:20.963213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835757fa-01bb-40d9-a7a8-995a527454ae service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:20.971279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1295/2582] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:21.411605 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1973f5-cd8c-41dd-bbbb-b57b7528a9ae None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:21.413206 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-3a1973f5-cd8c-41dd-bbbb-b57b7528a9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:21.439238 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1973f5-cd8c-41dd-bbbb-b57b7528a9ae None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:21.444395 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:21.444961 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:21.445218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:21.445630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] PATH_INFO: `/v3/projects/290306a1a0f44aae8f561c6eefcd011a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:21.446773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290306a1a0f44aae8f561c6eefcd011a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:21.448727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:21.604528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290306a1a0f44aae8f561c6eefcd011a', 'request_id': 'req-584ee081-b7ac-4506-b225-73ec9dfbd4c0'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:21.710055 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290306a1a0f44aae8f561c6eefcd011a', 'request_id': 'req-584ee081-b7ac-4506-b225-73ec9dfbd4c0'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:21.717922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290306a1a0f44aae8f561c6eefcd011a', 'request_id': 'req-584ee081-b7ac-4506-b225-73ec9dfbd4c0'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:21.729746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] The token cache is being invalidate because project 290306a1a0f44aae8f561c6eefcd011a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:21.730066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:21.730758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:21.732333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1288/2583] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:21 2022] DELETE /identity/v3/projects/290306a1a0f44aae8f561c6eefcd011a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:21.736688 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835757fa-01bb-40d9-a7a8-995a527454ae service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:21.748334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835757fa-01bb-40d9-a7a8-995a527454ae service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:21.786162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:21.811070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88459cf6-4fc2-40bc-9ce0-b57072559e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:21.811684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88459cf6-4fc2-40bc-9ce0-b57072559e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:21.811960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88459cf6-4fc2-40bc-9ce0-b57072559e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:21.812253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88459cf6-4fc2-40bc-9ce0-b57072559e83 admin admin] PATH_INFO: `/v3/users/46b5f9d82dd84a36a91366a8eb69f4ef` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:21.813412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88459cf6-4fc2-40bc-9ce0-b57072559e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b5f9d82dd84a36a91366a8eb69f4ef)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:21.815361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88459cf6-4fc2-40bc-9ce0-b57072559e83 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:21.993451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-88459cf6-4fc2-40bc-9ce0-b57072559e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b5f9d82dd84a36a91366a8eb69f4ef'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:21.994211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-88459cf6-4fc2-40bc-9ce0-b57072559e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b5f9d82dd84a36a91366a8eb69f4ef'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:22.003116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-88459cf6-4fc2-40bc-9ce0-b57072559e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b5f9d82dd84a36a91366a8eb69f4ef'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:22.004091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-88459cf6-4fc2-40bc-9ce0-b57072559e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b5f9d82dd84a36a91366a8eb69f4ef'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:22.017451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-88459cf6-4fc2-40bc-9ce0-b57072559e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b5f9d82dd84a36a91366a8eb69f4ef'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:22.108215 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1296/2584] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:21 2022] DELETE /identity/v3/users/46b5f9d82dd84a36a91366a8eb69f4ef => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:22.563853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:22.565381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:22.581938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ee081-b7ac-4506-b225-73ec9dfbd4c0 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:22.652826 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:22.653470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.653754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.654028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] PATH_INFO: `/v3/projects/1130930e92b2418eae797f5e1eeba66d` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.655284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1130930e92b2418eae797f5e1eeba66d)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:22.657692 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:22.803117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:22.813955 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1130930e92b2418eae797f5e1eeba66d', 'request_id': 'req-101d0a41-2f99-4775-99a2-a5a69786f7bd'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:22.886765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1130930e92b2418eae797f5e1eeba66d', 'request_id': 'req-101d0a41-2f99-4775-99a2-a5a69786f7bd'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:22.894466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1130930e92b2418eae797f5e1eeba66d', 'request_id': 'req-101d0a41-2f99-4775-99a2-a5a69786f7bd'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:22.905185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] The token cache is being invalidate because project 1130930e92b2418eae797f5e1eeba66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:22.905476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:22.906645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-101d0a41-2f99-4775-99a2-a5a69786f7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:22.908267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1289/2585] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:22 2022] DELETE /identity/v3/projects/1130930e92b2418eae797f5e1eeba66d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:22.913430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabb58c-3e26-4ebb-bd12-05efd3219f0f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:22.913931 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabb58c-3e26-4ebb-bd12-05efd3219f0f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:22.914044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabb58c-3e26-4ebb-bd12-05efd3219f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:22.934618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-3aabb58c-3e26-4ebb-bd12-05efd3219f0f None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:22.935985 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3aabb58c-3e26-4ebb-bd12-05efd3219f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:22.998823 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1297/2586] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:23.007187 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770cc9a-baf8-43ba-b5ae-df207c665c1d None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.007424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770cc9a-baf8-43ba-b5ae-df207c665c1d None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.007696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770cc9a-baf8-43ba-b5ae-df207c665c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.028019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-d770cc9a-baf8-43ba-b5ae-df207c665c1d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:23.029365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d770cc9a-baf8-43ba-b5ae-df207c665c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:23.038622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1290/2587] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:23.042927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabb58c-3e26-4ebb-bd12-05efd3219f0f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.053956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabb58c-3e26-4ebb-bd12-05efd3219f0f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.058687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a580ad-c04d-476d-b38d-58e27562e716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.059229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a580ad-c04d-476d-b38d-58e27562e716 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.059507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a580ad-c04d-476d-b38d-58e27562e716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.059778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a580ad-c04d-476d-b38d-58e27562e716 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.060451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a580ad-c04d-476d-b38d-58e27562e716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:23.060751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a580ad-c04d-476d-b38d-58e27562e716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.062779 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a580ad-c04d-476d-b38d-58e27562e716 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.074480 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1298/2588] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:23.079529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770cc9a-baf8-43ba-b5ae-df207c665c1d None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.090037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770cc9a-baf8-43ba-b5ae-df207c665c1d None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.095514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2914128-2043-4469-9ed0-5d3cb3d85112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.096110 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2914128-2043-4469-9ed0-5d3cb3d85112 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.096453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2914128-2043-4469-9ed0-5d3cb3d85112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.096728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2914128-2043-4469-9ed0-5d3cb3d85112 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.097368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2914128-2043-4469-9ed0-5d3cb3d85112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.099276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2914128-2043-4469-9ed0-5d3cb3d85112 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.209855 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1291/2589] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:23 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:23.214924 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a580ad-c04d-476d-b38d-58e27562e716 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.228082 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a580ad-c04d-476d-b38d-58e27562e716 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.271844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:23.287951 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011ccf-eb2c-44ad-a01a-91125f30df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.288827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011ccf-eb2c-44ad-a01a-91125f30df31 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.289132 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011ccf-eb2c-44ad-a01a-91125f30df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.289484 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011ccf-eb2c-44ad-a01a-91125f30df31 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.290322 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0011ccf-eb2c-44ad-a01a-91125f30df31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.292639 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0011ccf-eb2c-44ad-a01a-91125f30df31 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.474392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1299/2590] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:23 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:23.478795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2914128-2043-4469-9ed0-5d3cb3d85112 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.489487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2914128-2043-4469-9ed0-5d3cb3d85112 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.496063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974db8f-4a0e-416f-86a9-5a4c2791aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.496861 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974db8f-4a0e-416f-86a9-5a4c2791aea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.497236 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974db8f-4a0e-416f-86a9-5a4c2791aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.503054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974db8f-4a0e-416f-86a9-5a4c2791aea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.503054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974db8f-4a0e-416f-86a9-5a4c2791aea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.503054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974db8f-4a0e-416f-86a9-5a4c2791aea8 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.513673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1292/2591] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:23.518408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011ccf-eb2c-44ad-a01a-91125f30df31 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.529474 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011ccf-eb2c-44ad-a01a-91125f30df31 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.534433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddc928-1cf4-44aa-849d-3200bffeeae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.535144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddc928-1cf4-44aa-849d-3200bffeeae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.535503 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddc928-1cf4-44aa-849d-3200bffeeae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.535698 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddc928-1cf4-44aa-849d-3200bffeeae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.536525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddc928-1cf4-44aa-849d-3200bffeeae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.538469 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddc928-1cf4-44aa-849d-3200bffeeae5 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.550711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1300/2592] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:23.555085 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974db8f-4a0e-416f-86a9-5a4c2791aea8 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.566472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974db8f-4a0e-416f-86a9-5a4c2791aea8 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.571402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b96ce-25ab-4f5a-9522-5c3ed691f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.572097 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b96ce-25ab-4f5a-9522-5c3ed691f59b admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.572485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b96ce-25ab-4f5a-9522-5c3ed691f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.572755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b96ce-25ab-4f5a-9522-5c3ed691f59b admin admin] PATH_INFO: `/v3/projects/9db2ddb2969e4634b549ff2b2be90a1e/users/4011a8bcab0e4171861c3812577ce56e/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.589041 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b96ce-25ab-4f5a-9522-5c3ed691f59b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db2ddb2969e4634b549ff2b2be90a1e, user_id=4011a8bcab0e4171861c3812577ce56e, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.591698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b96ce-25ab-4f5a-9522-5c3ed691f59b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.675936 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1293/2593] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:23 2022] PUT /identity/v3/projects/9db2ddb2969e4634b549ff2b2be90a1e/users/4011a8bcab0e4171861c3812577ce56e/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:23.688672 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc044d1b-2d18-48cb-afaf-f66ee670918a None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.689042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc044d1b-2d18-48cb-afaf-f66ee670918a None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.689249 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc044d1b-2d18-48cb-afaf-f66ee670918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.721040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-fc044d1b-2d18-48cb-afaf-f66ee670918a None None] MFA Rules not processed for user `4011a8bcab0e4171861c3812577ce56e`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:23.722284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fc044d1b-2d18-48cb-afaf-f66ee670918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:23.790543 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1301/2594] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:23.795260 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b96ce-25ab-4f5a-9522-5c3ed691f59b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.862113 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b96ce-25ab-4f5a-9522-5c3ed691f59b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.867424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c4d6c-8104-4aa9-9ba2-bcabe7068ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.868093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c4d6c-8104-4aa9-9ba2-bcabe7068ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.868550 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c4d6c-8104-4aa9-9ba2-bcabe7068ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.868809 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c4d6c-8104-4aa9-9ba2-bcabe7068ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.869522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c4d6c-8104-4aa9-9ba2-bcabe7068ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.871719 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c4d6c-8104-4aa9-9ba2-bcabe7068ae3 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.962290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1294/2595] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:23 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:23.966992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc044d1b-2d18-48cb-afaf-f66ee670918a None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.979457 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc044d1b-2d18-48cb-afaf-f66ee670918a None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:24.040516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2291c7-0a82-439e-bb8a-ed650a0534de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:24.041137 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2291c7-0a82-439e-bb8a-ed650a0534de admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.041414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2291c7-0a82-439e-bb8a-ed650a0534de admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.041683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2291c7-0a82-439e-bb8a-ed650a0534de admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.042313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2291c7-0a82-439e-bb8a-ed650a0534de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:24.044242 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2291c7-0a82-439e-bb8a-ed650a0534de admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:24.133710 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1302/2596] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:23 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:24.137281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c4d6c-8104-4aa9-9ba2-bcabe7068ae3 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:24.148204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c4d6c-8104-4aa9-9ba2-bcabe7068ae3 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:24.161482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a0daf-a4fa-4d05-bfdb-ffed66286490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:24.161482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0daf-a4fa-4d05-bfdb-ffed66286490 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.161482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0daf-a4fa-4d05-bfdb-ffed66286490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.161482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a0daf-a4fa-4d05-bfdb-ffed66286490 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.161975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a0daf-a4fa-4d05-bfdb-ffed66286490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:24.161975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a0daf-a4fa-4d05-bfdb-ffed66286490 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:24.173183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1295/2597] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:24.177602 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2291c7-0a82-439e-bb8a-ed650a0534de admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:24.188915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2291c7-0a82-439e-bb8a-ed650a0534de admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:24.193756 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a6c24-798b-4c69-abf6-0d78063ad14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:24.194426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a6c24-798b-4c69-abf6-0d78063ad14a admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.194709 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a6c24-798b-4c69-abf6-0d78063ad14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.195014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a6c24-798b-4c69-abf6-0d78063ad14a admin admin] PATH_INFO: `/v3/projects/ea0259d889b248fe8d5089f63d4a379f/users/a9d9696618154f9ca7705d62ff250444/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.211112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a6c24-798b-4c69-abf6-0d78063ad14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0259d889b248fe8d5089f63d4a379f, user_id=a9d9696618154f9ca7705d62ff250444, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:24.213848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a6c24-798b-4c69-abf6-0d78063ad14a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:24.305411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1303/2598] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:24 2022] PUT /identity/v3/projects/ea0259d889b248fe8d5089f63d4a379f/users/a9d9696618154f9ca7705d62ff250444/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:24.309545 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a0daf-a4fa-4d05-bfdb-ffed66286490 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:24.319886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a0daf-a4fa-4d05-bfdb-ffed66286490 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:24.357455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:24.382386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e92a4-1212-4ed6-9cdf-60b4bfcf41af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:24.383044 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e92a4-1212-4ed6-9cdf-60b4bfcf41af admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.383322 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e92a4-1212-4ed6-9cdf-60b4bfcf41af admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.383596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e92a4-1212-4ed6-9cdf-60b4bfcf41af admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.384306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e92a4-1212-4ed6-9cdf-60b4bfcf41af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:24.385858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e92a4-1212-4ed6-9cdf-60b4bfcf41af admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:24.399314 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1296/2599] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:26:24.406032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a6c24-798b-4c69-abf6-0d78063ad14a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:24.426244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a6c24-798b-4c69-abf6-0d78063ad14a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:24.432140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade162c-4014-45ae-8bea-4ef66743ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:24.432858 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade162c-4014-45ae-8bea-4ef66743ac74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.433269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade162c-4014-45ae-8bea-4ef66743ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.433550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade162c-4014-45ae-8bea-4ef66743ac74 admin admin] PATH_INFO: `/v3/projects/ea0259d889b248fe8d5089f63d4a379f/users/a9d9696618154f9ca7705d62ff250444/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.435547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade162c-4014-45ae-8bea-4ef66743ac74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea0259d889b248fe8d5089f63d4a379f, user_id=a9d9696618154f9ca7705d62ff250444, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:24.438925 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade162c-4014-45ae-8bea-4ef66743ac74 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:24.455712 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1304/2600] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:24 2022] PUT /identity/v3/projects/ea0259d889b248fe8d5089f63d4a379f/users/a9d9696618154f9ca7705d62ff250444/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:24.470552 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9a15e-6469-4052-8510-21e018a1a2b7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.470848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9a15e-6469-4052-8510-21e018a1a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.471740 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9a15e-6469-4052-8510-21e018a1a2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.503900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-d4e9a15e-6469-4052-8510-21e018a1a2b7 None None] MFA Rules not processed for user `a9d9696618154f9ca7705d62ff250444`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:24.503900 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d4e9a15e-6469-4052-8510-21e018a1a2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:24.575468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1297/2601] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:24.597420 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade162c-4014-45ae-8bea-4ef66743ac74 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:24.599555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fade162c-4014-45ae-8bea-4ef66743ac74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:24.607608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:24.670140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade162c-4014-45ae-8bea-4ef66743ac74 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:24.674056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270e96e-9b31-4f7b-a317-ec9cb8485215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:24.674734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270e96e-9b31-4f7b-a317-ec9cb8485215 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:24.675021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270e96e-9b31-4f7b-a317-ec9cb8485215 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:24.675288 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270e96e-9b31-4f7b-a317-ec9cb8485215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:24.685085 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270e96e-9b31-4f7b-a317-ec9cb8485215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:24.686664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270e96e-9b31-4f7b-a317-ec9cb8485215 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:24.701819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1305/2602] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:27.832433 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9a15e-6469-4052-8510-21e018a1a2b7 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:27.900877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9a15e-6469-4052-8510-21e018a1a2b7 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:27.906354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:27.908306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:27.908306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:27.908306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] PATH_INFO: `/v3/users/4011a8bcab0e4171861c3812577ce56e` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:27.908837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4011a8bcab0e4171861c3812577ce56e)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:27.910824 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:28.113178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4011a8bcab0e4171861c3812577ce56e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:28.113682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4011a8bcab0e4171861c3812577ce56e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:28.114351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4011a8bcab0e4171861c3812577ce56e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:28.123443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:28.130095 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4011a8bcab0e4171861c3812577ce56e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:28.224144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4011a8bcab0e4171861c3812577ce56e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:28.239519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1298/2603] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:27 2022] DELETE /identity/v3/users/4011a8bcab0e4171861c3812577ce56e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:28.244049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b164f9-03f9-42bc-890d-3a0ec15a1b94 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:28.244618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b164f9-03f9-42bc-890d-3a0ec15a1b94 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:28.244742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b164f9-03f9-42bc-890d-3a0ec15a1b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:28.265953 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-33b164f9-03f9-42bc-890d-3a0ec15a1b94 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:28.267207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-33b164f9-03f9-42bc-890d-3a0ec15a1b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:28.354306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1306/2604] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:28.370916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:28.370916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:28.436212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2573ca-89c2-426c-98b5-4c8acead8474 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:28.441570 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9ba91-52a3-4fd8-94a3-6d74ab63ae36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:28.442195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9ba91-52a3-4fd8-94a3-6d74ab63ae36 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:28.442480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9ba91-52a3-4fd8-94a3-6d74ab63ae36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:28.442754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9ba91-52a3-4fd8-94a3-6d74ab63ae36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:28.456265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9ba91-52a3-4fd8-94a3-6d74ab63ae36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:28.457758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9ba91-52a3-4fd8-94a3-6d74ab63ae36 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:28.468212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1299/2605] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:28.986824 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b164f9-03f9-42bc-890d-3a0ec15a1b94 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:28.992534 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-33b164f9-03f9-42bc-890d-3a0ec15a1b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:29.004416 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b164f9-03f9-42bc-890d-3a0ec15a1b94 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:29.009358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:29.010014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:29.010293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:29.010603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] PATH_INFO: `/v3/projects/9db2ddb2969e4634b549ff2b2be90a1e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:29.011991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db2ddb2969e4634b549ff2b2be90a1e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:29.015190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:29.112220 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db2ddb2969e4634b549ff2b2be90a1e', 'request_id': 'req-c8ee0915-50c1-4846-8466-2ee09b69db00'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:29.189735 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db2ddb2969e4634b549ff2b2be90a1e', 'request_id': 'req-c8ee0915-50c1-4846-8466-2ee09b69db00'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:29.197010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db2ddb2969e4634b549ff2b2be90a1e', 'request_id': 'req-c8ee0915-50c1-4846-8466-2ee09b69db00'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:29.208564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] The token cache is being invalidate because project 9db2ddb2969e4634b549ff2b2be90a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:29.208851 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:29.209516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:29.211244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1307/2606] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:28 2022] DELETE /identity/v3/projects/9db2ddb2969e4634b549ff2b2be90a1e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:29.215098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9ba91-52a3-4fd8-94a3-6d74ab63ae36 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:29.225721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9ba91-52a3-4fd8-94a3-6d74ab63ae36 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:29.283438 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36ccd7-fa86-4084-8972-dbb4df5906fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:29.284053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36ccd7-fa86-4084-8972-dbb4df5906fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:29.284363 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36ccd7-fa86-4084-8972-dbb4df5906fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:29.284649 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36ccd7-fa86-4084-8972-dbb4df5906fe admin admin] PATH_INFO: `/v3/users/a9d9696618154f9ca7705d62ff250444` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:29.285799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36ccd7-fa86-4084-8972-dbb4df5906fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d9696618154f9ca7705d62ff250444)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:29.287719 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36ccd7-fa86-4084-8972-dbb4df5906fe admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:29.442325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-fb36ccd7-fa86-4084-8972-dbb4df5906fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d9696618154f9ca7705d62ff250444'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:29.442998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-fb36ccd7-fa86-4084-8972-dbb4df5906fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d9696618154f9ca7705d62ff250444'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:29.443675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-fb36ccd7-fa86-4084-8972-dbb4df5906fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d9696618154f9ca7705d62ff250444'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:29.457122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-fb36ccd7-fa86-4084-8972-dbb4df5906fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d9696618154f9ca7705d62ff250444'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:29.513418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-fb36ccd7-fa86-4084-8972-dbb4df5906fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d9696618154f9ca7705d62ff250444'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:29.524106 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:29.529681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1300/2607] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:29 2022] DELETE /identity/v3/users/a9d9696618154f9ca7705d62ff250444 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:30.129486 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:30.136970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:30.146743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee0915-50c1-4846-8466-2ee09b69db00 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:30.187505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:30.219859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:30.220542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.220833 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.221107 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] PATH_INFO: `/v3/projects/ea0259d889b248fe8d5089f63d4a379f` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.222259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea0259d889b248fe8d5089f63d4a379f)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:30.224183 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:30.357617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea0259d889b248fe8d5089f63d4a379f', 'request_id': 'req-be506e5c-35c1-4153-9078-42859cab21d7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:30.440905 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea0259d889b248fe8d5089f63d4a379f', 'request_id': 'req-be506e5c-35c1-4153-9078-42859cab21d7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:30.448102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea0259d889b248fe8d5089f63d4a379f', 'request_id': 'req-be506e5c-35c1-4153-9078-42859cab21d7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:30.459403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] The token cache is being invalidate because project ea0259d889b248fe8d5089f63d4a379f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:30.459696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:30.460391 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-be506e5c-35c1-4153-9078-42859cab21d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:30.461898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1308/2608] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:30 2022] DELETE /identity/v3/projects/ea0259d889b248fe8d5089f63d4a379f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:30.468679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b8875-c7ff-43a7-a315-90ba9082e3f4 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.469254 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b8875-c7ff-43a7-a315-90ba9082e3f4 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.469391 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b8875-c7ff-43a7-a315-90ba9082e3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.490343 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e31b8875-c7ff-43a7-a315-90ba9082e3f4 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:30.491563 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e31b8875-c7ff-43a7-a315-90ba9082e3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:30.554371 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1301/2609] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:30.562411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b57d4-af35-4d26-ba6d-c6d4775726a2 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.565467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b57d4-af35-4d26-ba6d-c6d4775726a2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.565467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b57d4-af35-4d26-ba6d-c6d4775726a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.584091 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-fe8b57d4-af35-4d26-ba6d-c6d4775726a2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:30.585712 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fe8b57d4-af35-4d26-ba6d-c6d4775726a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:30.598148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1309/2610] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:30.599164 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b8875-c7ff-43a7-a315-90ba9082e3f4 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:30.610072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b8875-c7ff-43a7-a315-90ba9082e3f4 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:30.614977 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd82429-8a8f-4d61-8a50-56d4a9d662f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:30.615597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd82429-8a8f-4d61-8a50-56d4a9d662f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.615873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd82429-8a8f-4d61-8a50-56d4a9d662f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.616146 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd82429-8a8f-4d61-8a50-56d4a9d662f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.616847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd82429-8a8f-4d61-8a50-56d4a9d662f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:30.617150 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd82429-8a8f-4d61-8a50-56d4a9d662f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:30.618759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd82429-8a8f-4d61-8a50-56d4a9d662f4 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:30.636143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1302/2611] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:30.637354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b57d4-af35-4d26-ba6d-c6d4775726a2 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:30.648171 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b57d4-af35-4d26-ba6d-c6d4775726a2 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:30.658523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae2107-1167-493e-99af-01223a2755e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:30.658523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae2107-1167-493e-99af-01223a2755e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.658523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae2107-1167-493e-99af-01223a2755e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.658523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae2107-1167-493e-99af-01223a2755e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.658982 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae2107-1167-493e-99af-01223a2755e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:30.659335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae2107-1167-493e-99af-01223a2755e2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:30.788364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1310/2612] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:30 2022] POST /identity/v3/projects => generated 371 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:30.789741 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd82429-8a8f-4d61-8a50-56d4a9d662f4 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:30.800911 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd82429-8a8f-4d61-8a50-56d4a9d662f4 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:30.883386 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b941-5689-41bd-931f-83a832e56eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:30.883922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b941-5689-41bd-931f-83a832e56eee admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:30.884207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b941-5689-41bd-931f-83a832e56eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:30.884573 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606b941-5689-41bd-931f-83a832e56eee admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:30.885166 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606b941-5689-41bd-931f-83a832e56eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:30.887219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606b941-5689-41bd-931f-83a832e56eee admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:31.030596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1303/2613] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:30 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:31.032024 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae2107-1167-493e-99af-01223a2755e2 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:31.046149 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae2107-1167-493e-99af-01223a2755e2 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:31.051774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cf1fb-f300-4654-b05e-a1ca671455c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:31.056278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cf1fb-f300-4654-b05e-a1ca671455c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:31.056278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cf1fb-f300-4654-b05e-a1ca671455c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:31.056278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cf1fb-f300-4654-b05e-a1ca671455c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:31.056278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cf1fb-f300-4654-b05e-a1ca671455c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:31.056278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cf1fb-f300-4654-b05e-a1ca671455c4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:31.068628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1311/2614] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:31.072684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b941-5689-41bd-931f-83a832e56eee admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:31.084284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606b941-5689-41bd-931f-83a832e56eee admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:31.089221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af0406-2bcd-4752-9cd7-022e64629e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:31.090521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af0406-2bcd-4752-9cd7-022e64629e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:31.090521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af0406-2bcd-4752-9cd7-022e64629e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:31.090521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af0406-2bcd-4752-9cd7-022e64629e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:31.091011 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af0406-2bcd-4752-9cd7-022e64629e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:31.092686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af0406-2bcd-4752-9cd7-022e64629e88 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:31.104867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1304/2615] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:31.109481 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cf1fb-f300-4654-b05e-a1ca671455c4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:31.120969 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cf1fb-f300-4654-b05e-a1ca671455c4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:31.131556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33e79-669c-40a4-bed6-508ae673ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:31.132419 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33e79-669c-40a4-bed6-508ae673ca35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:31.132802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33e79-669c-40a4-bed6-508ae673ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:31.133163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33e79-669c-40a4-bed6-508ae673ca35 admin admin] PATH_INFO: `/v3/projects/8f6e5a35d78e4a7d9572b5016e528675/users/8a588eee072f446d8e7c38f8770dfb3b/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:31.151664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a33e79-669c-40a4-bed6-508ae673ca35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6e5a35d78e4a7d9572b5016e528675, user_id=8a588eee072f446d8e7c38f8770dfb3b, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:31.154675 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a33e79-669c-40a4-bed6-508ae673ca35 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:31.225093 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1312/2616] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:31 2022] PUT /identity/v3/projects/8f6e5a35d78e4a7d9572b5016e528675/users/8a588eee072f446d8e7c38f8770dfb3b/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:31.237485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a670-307e-4f3a-97b2-634f9f19383b None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:31.237769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a670-307e-4f3a-97b2-634f9f19383b None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:31.238052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402a670-307e-4f3a-97b2-634f9f19383b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:31.273012 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6402a670-307e-4f3a-97b2-634f9f19383b None None] MFA Rules not processed for user `8a588eee072f446d8e7c38f8770dfb3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:31.274697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6402a670-307e-4f3a-97b2-634f9f19383b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:31.369156 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:31.384756 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1305/2617] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:31.393017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33e79-669c-40a4-bed6-508ae673ca35 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:31.394879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b5a33e79-669c-40a4-bed6-508ae673ca35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:31.456615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33e79-669c-40a4-bed6-508ae673ca35 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:31.460436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884769e-3bcd-43b6-ad6e-eecd6658c6d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:31.461049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884769e-3bcd-43b6-ad6e-eecd6658c6d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:31.461332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884769e-3bcd-43b6-ad6e-eecd6658c6d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:31.461601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884769e-3bcd-43b6-ad6e-eecd6658c6d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:31.471214 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884769e-3bcd-43b6-ad6e-eecd6658c6d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:31.472717 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884769e-3bcd-43b6-ad6e-eecd6658c6d7 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:31.478443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:31.484442 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1313/2618] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:31.508633 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402a670-307e-4f3a-97b2-634f9f19383b None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:31.587460 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402a670-307e-4f3a-97b2-634f9f19383b None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:31.595121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:31.596143 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:31.596478 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:31.596757 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] PATH_INFO: `/v3/users/8a588eee072f446d8e7c38f8770dfb3b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:31.597988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a588eee072f446d8e7c38f8770dfb3b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:31.600062 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:31.891393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a588eee072f446d8e7c38f8770dfb3b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:31.893240 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a588eee072f446d8e7c38f8770dfb3b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:31.896715 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a588eee072f446d8e7c38f8770dfb3b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:31.912200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a588eee072f446d8e7c38f8770dfb3b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:32.006769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a588eee072f446d8e7c38f8770dfb3b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:32.021366 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1306/2619] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:31 2022] DELETE /identity/v3/users/8a588eee072f446d8e7c38f8770dfb3b => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:32.025842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36f27-e238-42ed-a7c5-55b32198d915 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:32.026125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36f27-e238-42ed-a7c5-55b32198d915 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:32.026404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd36f27-e238-42ed-a7c5-55b32198d915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:32.048265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-1bd36f27-e238-42ed-a7c5-55b32198d915 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:32.049525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1bd36f27-e238-42ed-a7c5-55b32198d915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:32.121260 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1314/2620] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:32.132593 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:32.134927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:32.222328 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7c954-a033-409d-99e2-d529542628c5 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:32.226098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b01f6-4614-4c06-8b3d-943edff57d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:32.226723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b01f6-4614-4c06-8b3d-943edff57d98 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:32.227002 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b01f6-4614-4c06-8b3d-943edff57d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:32.227273 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b01f6-4614-4c06-8b3d-943edff57d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:32.238609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b01f6-4614-4c06-8b3d-943edff57d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:32.240175 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b01f6-4614-4c06-8b3d-943edff57d98 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:32.252007 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1307/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:32.854562 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd36f27-e238-42ed-a7c5-55b32198d915 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:32.863881 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1bd36f27-e238-42ed-a7c5-55b32198d915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:32.868865 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd36f27-e238-42ed-a7c5-55b32198d915 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:32.873676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:32.876674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:32.876958 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:32.877298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] PATH_INFO: `/v3/projects/8f6e5a35d78e4a7d9572b5016e528675` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:32.878821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6e5a35d78e4a7d9572b5016e528675)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:32.880835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.013582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6e5a35d78e4a7d9572b5016e528675', 'request_id': 'req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.092278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6e5a35d78e4a7d9572b5016e528675', 'request_id': 'req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.100158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6e5a35d78e4a7d9572b5016e528675', 'request_id': 'req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.111371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] The token cache is being invalidate because project 8f6e5a35d78e4a7d9572b5016e528675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:33.111653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.112342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c5f934f9-89b8-4dc2-9cbb-11cdf8f63958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.113965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1315/2622] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:32 2022] DELETE /identity/v3/projects/8f6e5a35d78e4a7d9572b5016e528675 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:33.118847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f94da-f2cb-4e59-97e2-0d3f8d79d5f2 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.119347 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f94da-f2cb-4e59-97e2-0d3f8d79d5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.119463 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f94da-f2cb-4e59-97e2-0d3f8d79d5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.141278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-9b7f94da-f2cb-4e59-97e2-0d3f8d79d5f2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:33.142508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9b7f94da-f2cb-4e59-97e2-0d3f8d79d5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:33.153264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:33.205594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1308/2623] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:33.213629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4da2e3-3d47-4e68-aa6d-9b011feee2a1 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.213913 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4da2e3-3d47-4e68-aa6d-9b011feee2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.214186 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4da2e3-3d47-4e68-aa6d-9b011feee2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.234807 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-dc4da2e3-3d47-4e68-aa6d-9b011feee2a1 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:33.236032 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-dc4da2e3-3d47-4e68-aa6d-9b011feee2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:33.244322 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1316/2624] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:33.251303 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f94da-f2cb-4e59-97e2-0d3f8d79d5f2 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:33.261754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f94da-f2cb-4e59-97e2-0d3f8d79d5f2 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:33.267516 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7ce0d-6955-4897-ae44-0cf9909326a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:33.268086 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ce0d-6955-4897-ae44-0cf9909326a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.268698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ce0d-6955-4897-ae44-0cf9909326a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.276105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7ce0d-6955-4897-ae44-0cf9909326a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.276105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7ce0d-6955-4897-ae44-0cf9909326a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:33.276105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7ce0d-6955-4897-ae44-0cf9909326a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:33.276105 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7ce0d-6955-4897-ae44-0cf9909326a6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.285475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1309/2625] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:33.290509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4da2e3-3d47-4e68-aa6d-9b011feee2a1 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:33.301402 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4da2e3-3d47-4e68-aa6d-9b011feee2a1 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:33.306212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb91e0-e138-4de9-9909-7e5c84ae6df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:33.306829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb91e0-e138-4de9-9909-7e5c84ae6df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.307131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb91e0-e138-4de9-9909-7e5c84ae6df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.307401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb91e0-e138-4de9-9909-7e5c84ae6df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.308074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb91e0-e138-4de9-9909-7e5c84ae6df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:33.310040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb91e0-e138-4de9-9909-7e5c84ae6df8 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.425896 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1317/2626] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:33 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:33.430305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7ce0d-6955-4897-ae44-0cf9909326a6 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:33.441147 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7ce0d-6955-4897-ae44-0cf9909326a6 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:33.501858 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f301a9-2e5c-43b1-80e8-22adae1cd607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:33.502482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f301a9-2e5c-43b1-80e8-22adae1cd607 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.502762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f301a9-2e5c-43b1-80e8-22adae1cd607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.503372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f301a9-2e5c-43b1-80e8-22adae1cd607 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.503916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f301a9-2e5c-43b1-80e8-22adae1cd607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:33.505946 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f301a9-2e5c-43b1-80e8-22adae1cd607 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.641774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1310/2627] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:33 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:33.646249 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb91e0-e138-4de9-9909-7e5c84ae6df8 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:33.659116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb91e0-e138-4de9-9909-7e5c84ae6df8 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:33.663930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b23559-972d-4d55-928f-91a81376e29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:33.664592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b23559-972d-4d55-928f-91a81376e29b admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.664872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b23559-972d-4d55-928f-91a81376e29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.665188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b23559-972d-4d55-928f-91a81376e29b admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.665840 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b23559-972d-4d55-928f-91a81376e29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:33.667450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b23559-972d-4d55-928f-91a81376e29b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.679173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1318/2628] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:33.684080 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f301a9-2e5c-43b1-80e8-22adae1cd607 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:33.696076 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f301a9-2e5c-43b1-80e8-22adae1cd607 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:33.706064 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bf264-6883-4a05-a73c-505549bfc0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:33.706896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bf264-6883-4a05-a73c-505549bfc0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.707273 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bf264-6883-4a05-a73c-505549bfc0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.707647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bf264-6883-4a05-a73c-505549bfc0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.708503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bf264-6883-4a05-a73c-505549bfc0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:33.710118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bf264-6883-4a05-a73c-505549bfc0c0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.728560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1311/2629] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:33.730972 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b23559-972d-4d55-928f-91a81376e29b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:33.747838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b23559-972d-4d55-928f-91a81376e29b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:33.755128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d91f0-0d4f-4b1c-9a93-b4ee03286dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:33.760532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d91f0-0d4f-4b1c-9a93-b4ee03286dac admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.760532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d91f0-0d4f-4b1c-9a93-b4ee03286dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.760532 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d91f0-0d4f-4b1c-9a93-b4ee03286dac admin admin] PATH_INFO: `/v3/projects/6fb7b51d9c8b4729b582cab30ff03fa2/users/c6aa9c0fa5dd44649022ac3d81590a90/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.772478 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d91f0-0d4f-4b1c-9a93-b4ee03286dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb7b51d9c8b4729b582cab30ff03fa2, user_id=c6aa9c0fa5dd44649022ac3d81590a90, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:33.775154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d91f0-0d4f-4b1c-9a93-b4ee03286dac admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.883168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1319/2630] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:33 2022] PUT /identity/v3/projects/6fb7b51d9c8b4729b582cab30ff03fa2/users/c6aa9c0fa5dd44649022ac3d81590a90/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:33.894384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45d503-1e6b-42f5-86db-09b4a18e3877 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.894674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45d503-1e6b-42f5-86db-09b4a18e3877 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.894950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45d503-1e6b-42f5-86db-09b4a18e3877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.938352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-ba45d503-1e6b-42f5-86db-09b4a18e3877 None None] MFA Rules not processed for user `c6aa9c0fa5dd44649022ac3d81590a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:33.939720 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ba45d503-1e6b-42f5-86db-09b4a18e3877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:34.016586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1312/2631] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:34.028500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d91f0-0d4f-4b1c-9a93-b4ee03286dac admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:34.031402 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-905d91f0-0d4f-4b1c-9a93-b4ee03286dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:34.057696 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:34.097441 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d91f0-0d4f-4b1c-9a93-b4ee03286dac admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:34.101133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9914db-31a8-4667-af38-fafed7a27e7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1684abe7e6aa44a0873e43dfc146c1b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:34.101760 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9914db-31a8-4667-af38-fafed7a27e7d service glance] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:34.102038 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9914db-31a8-4667-af38-fafed7a27e7d service glance] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:34.102310 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9914db-31a8-4667-af38-fafed7a27e7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:34.113859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9914db-31a8-4667-af38-fafed7a27e7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:34.115668 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9914db-31a8-4667-af38-fafed7a27e7d service glance] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:34.126020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1320/2632] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:39.137514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45d503-1e6b-42f5-86db-09b4a18e3877 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:39.139116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ba45d503-1e6b-42f5-86db-09b4a18e3877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:39.153124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:39.198600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45d503-1e6b-42f5-86db-09b4a18e3877 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:39.202830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eab93-a567-48d4-9612-a31a34635f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:39.203656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eab93-a567-48d4-9612-a31a34635f8d service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:39.203938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eab93-a567-48d4-9612-a31a34635f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:39.204209 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0eab93-a567-48d4-9612-a31a34635f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:39.206122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4a0eab93-a567-48d4-9612-a31a34635f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:39.269921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eab93-a567-48d4-9612-a31a34635f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:39.271365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0eab93-a567-48d4-9612-a31a34635f8d service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:39.282276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1313/2633] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:41.179630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9914db-31a8-4667-af38-fafed7a27e7d service glance] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:41.194782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9914db-31a8-4667-af38-fafed7a27e7d service glance] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:41.199195 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362514f-a62a-4c05-8bc4-2ab4c0606344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:41.200074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362514f-a62a-4c05-8bc4-2ab4c0606344 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:41.200594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362514f-a62a-4c05-8bc4-2ab4c0606344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:41.201044 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362514f-a62a-4c05-8bc4-2ab4c0606344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:41.203673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7362514f-a62a-4c05-8bc4-2ab4c0606344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:41.356170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362514f-a62a-4c05-8bc4-2ab4c0606344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:41.356170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362514f-a62a-4c05-8bc4-2ab4c0606344 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:41.397475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1321/2634] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:43.346312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eab93-a567-48d4-9612-a31a34635f8d service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:43.348943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4a0eab93-a567-48d4-9612-a31a34635f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:43.365621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0eab93-a567-48d4-9612-a31a34635f8d service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:43.370582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619bd45-6867-4629-8223-9348f261166b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:43.371219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619bd45-6867-4629-8223-9348f261166b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:43.371509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619bd45-6867-4629-8223-9348f261166b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:43.371773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619bd45-6867-4629-8223-9348f261166b admin admin] PATH_INFO: `/v3/users/9b22f661cc524dd2a58a499badb8e661` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:43.386537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619bd45-6867-4629-8223-9348f261166b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b22f661cc524dd2a58a499badb8e661)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:43.388562 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619bd45-6867-4629-8223-9348f261166b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:43.614515 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9619bd45-6867-4629-8223-9348f261166b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b22f661cc524dd2a58a499badb8e661'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:43.615142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9619bd45-6867-4629-8223-9348f261166b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b22f661cc524dd2a58a499badb8e661'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:43.615766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9619bd45-6867-4629-8223-9348f261166b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b22f661cc524dd2a58a499badb8e661'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:43.628730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9619bd45-6867-4629-8223-9348f261166b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b22f661cc524dd2a58a499badb8e661'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:43.726188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-9619bd45-6867-4629-8223-9348f261166b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b22f661cc524dd2a58a499badb8e661'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:43.740761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1314/2635] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:43 2022] DELETE /identity/v3/users/9b22f661cc524dd2a58a499badb8e661 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:44.080766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362514f-a62a-4c05-8bc4-2ab4c0606344 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:44.092493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362514f-a62a-4c05-8bc4-2ab4c0606344 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:44.153835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:44.154470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.154762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.155064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] PATH_INFO: `/v3/projects/a607ed86a17a409797f0e22b3d919c43` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.165977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a607ed86a17a409797f0e22b3d919c43)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:44.167970 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:44.193116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=100 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:44.373424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a607ed86a17a409797f0e22b3d919c43', 'request_id': 'req-acebfed5-63f6-4e3c-928c-4dcdd4b65697'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:44.457609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a607ed86a17a409797f0e22b3d919c43', 'request_id': 'req-acebfed5-63f6-4e3c-928c-4dcdd4b65697'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:44.466233 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a607ed86a17a409797f0e22b3d919c43', 'request_id': 'req-acebfed5-63f6-4e3c-928c-4dcdd4b65697'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:44.479702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] The token cache is being invalidate because project a607ed86a17a409797f0e22b3d919c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:44.480058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:44.480724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-acebfed5-63f6-4e3c-928c-4dcdd4b65697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:44.482455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1322/2636] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:44 2022] DELETE /identity/v3/projects/a607ed86a17a409797f0e22b3d919c43 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:44.487381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47476c-f064-40c4-b894-d99308cb9db9 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.487907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47476c-f064-40c4-b894-d99308cb9db9 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.488042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47476c-f064-40c4-b894-d99308cb9db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.508813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5f47476c-f064-40c4-b894-d99308cb9db9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:44.510098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5f47476c-f064-40c4-b894-d99308cb9db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:44.528111 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:44.570587 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1315/2637] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:44.580313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83dee-e456-4337-91fa-d265a07b4e41 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.580622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83dee-e456-4337-91fa-d265a07b4e41 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.580892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e83dee-e456-4337-91fa-d265a07b4e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.600509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-11e83dee-e456-4337-91fa-d265a07b4e41 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:44.601718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-11e83dee-e456-4337-91fa-d265a07b4e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:44.610258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1323/2638] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:44.615523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47476c-f064-40c4-b894-d99308cb9db9 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:44.626271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47476c-f064-40c4-b894-d99308cb9db9 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:44.635398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe290b6-d368-4370-a402-275b4bfa1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:44.636007 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe290b6-d368-4370-a402-275b4bfa1448 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.636306 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe290b6-d368-4370-a402-275b4bfa1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.636578 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe290b6-d368-4370-a402-275b4bfa1448 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.637233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe290b6-d368-4370-a402-275b4bfa1448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:44.637531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe290b6-d368-4370-a402-275b4bfa1448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:44.639224 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe290b6-d368-4370-a402-275b4bfa1448 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:44.653449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1316/2639] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:44.658064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e83dee-e456-4337-91fa-d265a07b4e41 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:44.668844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e83dee-e456-4337-91fa-d265a07b4e41 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:44.673920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515aad8-b3ca-4be1-88a3-3584073c5262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:44.679704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515aad8-b3ca-4be1-88a3-3584073c5262 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.679704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515aad8-b3ca-4be1-88a3-3584073c5262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.679704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515aad8-b3ca-4be1-88a3-3584073c5262 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.679704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515aad8-b3ca-4be1-88a3-3584073c5262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:44.679704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515aad8-b3ca-4be1-88a3-3584073c5262 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:44.806449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1324/2640] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:44 2022] POST /identity/v3/projects => generated 405 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:44.810880 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe290b6-d368-4370-a402-275b4bfa1448 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:44.821219 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe290b6-d368-4370-a402-275b4bfa1448 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:44.881805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca9a4-1b59-4d16-bafd-d98fef07a029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:44.882938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca9a4-1b59-4d16-bafd-d98fef07a029 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:44.883211 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca9a4-1b59-4d16-bafd-d98fef07a029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:44.883683 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca9a4-1b59-4d16-bafd-d98fef07a029 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:44.884364 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaca9a4-1b59-4d16-bafd-d98fef07a029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:44.886287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaca9a4-1b59-4d16-bafd-d98fef07a029 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:45.000125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1317/2641] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:44 2022] POST /identity/v3/users => generated 303 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:45.004177 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515aad8-b3ca-4be1-88a3-3584073c5262 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.015067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515aad8-b3ca-4be1-88a3-3584073c5262 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:45.019770 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e94fa-b828-46e9-af11-fa7104598d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:45.020437 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e94fa-b828-46e9-af11-fa7104598d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.020721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e94fa-b828-46e9-af11-fa7104598d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.020993 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e94fa-b828-46e9-af11-fa7104598d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.026209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e94fa-b828-46e9-af11-fa7104598d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:45.026209 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e94fa-b828-46e9-af11-fa7104598d85 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:45.034537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1325/2642] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:45.038724 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca9a4-1b59-4d16-bafd-d98fef07a029 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.049768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca9a4-1b59-4d16-bafd-d98fef07a029 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:45.054721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b977be-f5c6-4535-8756-ed39bfa4a481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:45.055439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b977be-f5c6-4535-8756-ed39bfa4a481 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.055727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b977be-f5c6-4535-8756-ed39bfa4a481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.056005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b977be-f5c6-4535-8756-ed39bfa4a481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.060639 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b977be-f5c6-4535-8756-ed39bfa4a481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:45.060639 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b977be-f5c6-4535-8756-ed39bfa4a481 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:45.068670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1318/2643] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:45.072974 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e94fa-b828-46e9-af11-fa7104598d85 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.083554 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e94fa-b828-46e9-af11-fa7104598d85 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:45.088188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263f2f3-d6c9-49f6-a1d2-cfbee95b26c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:45.088872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263f2f3-d6c9-49f6-a1d2-cfbee95b26c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.089154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263f2f3-d6c9-49f6-a1d2-cfbee95b26c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.089428 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263f2f3-d6c9-49f6-a1d2-cfbee95b26c6 admin admin] PATH_INFO: `/v3/projects/2c22a6db5dc44bae9966b7cce1b8c0ed/users/5c6a6d19c5b54b44acdb5fcf09641652/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.106081 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263f2f3-d6c9-49f6-a1d2-cfbee95b26c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c22a6db5dc44bae9966b7cce1b8c0ed, user_id=5c6a6d19c5b54b44acdb5fcf09641652, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:45.108834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263f2f3-d6c9-49f6-a1d2-cfbee95b26c6 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:45.220262 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1326/2644] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:45 2022] PUT /identity/v3/projects/2c22a6db5dc44bae9966b7cce1b8c0ed/users/5c6a6d19c5b54b44acdb5fcf09641652/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:45.222281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0bee-0c74-472c-b3ff-a029489e195e None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.222281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0bee-0c74-472c-b3ff-a029489e195e None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.222281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb0bee-0c74-472c-b3ff-a029489e195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.245147 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-15cb0bee-0c74-472c-b3ff-a029489e195e None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:45.246529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-15cb0bee-0c74-472c-b3ff-a029489e195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:45.309280 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1319/2645] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:45.320061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263f2f3-d6c9-49f6-a1d2-cfbee95b26c6 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:45.321845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7263f2f3-d6c9-49f6-a1d2-cfbee95b26c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:45.381910 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263f2f3-d6c9-49f6-a1d2-cfbee95b26c6 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:45.386113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3850ea-7ef3-413a-8445-3e31191d6f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:45.386751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3850ea-7ef3-413a-8445-3e31191d6f77 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:45.387030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3850ea-7ef3-413a-8445-3e31191d6f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:45.387303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3850ea-7ef3-413a-8445-3e31191d6f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:45.397737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3850ea-7ef3-413a-8445-3e31191d6f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:45.399133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3850ea-7ef3-413a-8445-3e31191d6f77 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:45.409175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1327/2646] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:46.580735 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb0bee-0c74-472c-b3ff-a029489e195e None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:46.590551 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb0bee-0c74-472c-b3ff-a029489e195e None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:46.594751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc974e0-d6d7-45fd-93fd-de4bb3af388a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:46.595356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc974e0-d6d7-45fd-93fd-de4bb3af388a service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:46.595663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc974e0-d6d7-45fd-93fd-de4bb3af388a service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:46.595889 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc974e0-d6d7-45fd-93fd-de4bb3af388a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:46.597678 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-acc974e0-d6d7-45fd-93fd-de4bb3af388a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:46.610074 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc974e0-d6d7-45fd-93fd-de4bb3af388a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:46.611509 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc974e0-d6d7-45fd-93fd-de4bb3af388a service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:46.621554 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1320/2647] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:46.740968 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c2b0-4727-4c94-9c84-0192734077a8 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:46.741549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c2b0-4727-4c94-9c84-0192734077a8 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:46.741549 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76c2b0-4727-4c94-9c84-0192734077a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:46.775098 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-8b76c2b0-4727-4c94-9c84-0192734077a8 None None] MFA Rules not processed for user `5c6a6d19c5b54b44acdb5fcf09641652`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:46.776605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-8b76c2b0-4727-4c94-9c84-0192734077a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:46.831776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:46.874663 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1328/2648] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:46 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:46.879559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc974e0-d6d7-45fd-93fd-de4bb3af388a service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:46.895623 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc974e0-d6d7-45fd-93fd-de4bb3af388a service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:46.901147 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0418-a4b2-4897-b8da-959498a7a0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:46.901909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0418-a4b2-4897-b8da-959498a7a0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:46.902184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0418-a4b2-4897-b8da-959498a7a0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:46.902451 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f0418-a4b2-4897-b8da-959498a7a0a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:46.903287 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f0418-a4b2-4897-b8da-959498a7a0a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:46.905774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f0418-a4b2-4897-b8da-959498a7a0a6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:46.923598 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:47.010162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1321/2649] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:46 2022] POST /identity/v3/projects => generated 403 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:47.012404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76c2b0-4727-4c94-9c84-0192734077a8 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:47.023639 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76c2b0-4727-4c94-9c84-0192734077a8 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:47.086912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48d7ba-5b75-4a56-a973-ae6a820a6519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:47.087462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48d7ba-5b75-4a56-a973-ae6a820a6519 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:47.087744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48d7ba-5b75-4a56-a973-ae6a820a6519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:47.088016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48d7ba-5b75-4a56-a973-ae6a820a6519 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:47.088715 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48d7ba-5b75-4a56-a973-ae6a820a6519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:47.090665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec48d7ba-5b75-4a56-a973-ae6a820a6519 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:47.210046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1329/2650] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:47 2022] POST /identity/v3/users => generated 308 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:47.212124 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0418-a4b2-4897-b8da-959498a7a0a6 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:47.223584 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f0418-a4b2-4897-b8da-959498a7a0a6 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:47.228324 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775e002-2c87-46f2-b426-18c606df7907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:47.228937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775e002-2c87-46f2-b426-18c606df7907 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:47.229217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775e002-2c87-46f2-b426-18c606df7907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:47.229492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775e002-2c87-46f2-b426-18c606df7907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:47.230173 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775e002-2c87-46f2-b426-18c606df7907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:47.231774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775e002-2c87-46f2-b426-18c606df7907 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:47.243686 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1322/2651] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:47.246893 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48d7ba-5b75-4a56-a973-ae6a820a6519 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:47.258545 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48d7ba-5b75-4a56-a973-ae6a820a6519 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:47.263715 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b667f5-42f2-45bf-aa5c-614121e3419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:47.265427 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b667f5-42f2-45bf-aa5c-614121e3419c admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:47.265427 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b667f5-42f2-45bf-aa5c-614121e3419c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:47.265678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b667f5-42f2-45bf-aa5c-614121e3419c admin admin] PATH_INFO: `/v3/projects/1e02baa7a46b4cb3b32f9b803ac36f86/users/fd89f4c1516647bc97608ff38ac53480/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:47.289468 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b667f5-42f2-45bf-aa5c-614121e3419c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e02baa7a46b4cb3b32f9b803ac36f86, user_id=fd89f4c1516647bc97608ff38ac53480, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:47.292192 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b667f5-42f2-45bf-aa5c-614121e3419c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:47.372631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1330/2652] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:47 2022] PUT /identity/v3/projects/1e02baa7a46b4cb3b32f9b803ac36f86/users/fd89f4c1516647bc97608ff38ac53480/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:47.376765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775e002-2c87-46f2-b426-18c606df7907 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:47.387119 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775e002-2c87-46f2-b426-18c606df7907 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:47.449127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720f093-f3cc-49b4-b0f3-c5583c2323e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:47.449790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720f093-f3cc-49b4-b0f3-c5583c2323e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:47.450091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720f093-f3cc-49b4-b0f3-c5583c2323e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:47.450434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720f093-f3cc-49b4-b0f3-c5583c2323e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:47.451078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720f093-f3cc-49b4-b0f3-c5583c2323e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:47.453723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720f093-f3cc-49b4-b0f3-c5583c2323e6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:47.467060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1323/2653] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:47.468401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b667f5-42f2-45bf-aa5c-614121e3419c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:47.479618 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b667f5-42f2-45bf-aa5c-614121e3419c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:47.484869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbe07b-4492-46e3-afef-4d50e91dbfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:47.485616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbe07b-4492-46e3-afef-4d50e91dbfb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:47.485962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbe07b-4492-46e3-afef-4d50e91dbfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:47.486327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbe07b-4492-46e3-afef-4d50e91dbfb6 admin admin] PATH_INFO: `/v3/projects/1e02baa7a46b4cb3b32f9b803ac36f86/users/fd89f4c1516647bc97608ff38ac53480/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:47.488390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbe07b-4492-46e3-afef-4d50e91dbfb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e02baa7a46b4cb3b32f9b803ac36f86, user_id=fd89f4c1516647bc97608ff38ac53480, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:47.491086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbe07b-4492-46e3-afef-4d50e91dbfb6 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:47.503251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1331/2654] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:47 2022] PUT /identity/v3/projects/1e02baa7a46b4cb3b32f9b803ac36f86/users/fd89f4c1516647bc97608ff38ac53480/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:49.380106 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468276-0eae-46ea-b25a-3cf4b863c4c4 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:49.380626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468276-0eae-46ea-b25a-3cf4b863c4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:49.380746 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e468276-0eae-46ea-b25a-3cf4b863c4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:49.413884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1e468276-0eae-46ea-b25a-3cf4b863c4c4 None None] MFA Rules not processed for user `fd89f4c1516647bc97608ff38ac53480`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:49.415135 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1e468276-0eae-46ea-b25a-3cf4b863c4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:49.518776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1324/2655] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:49 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:50.944809 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbe07b-4492-46e3-afef-4d50e91dbfb6 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:50.946994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-51bbe07b-4492-46e3-afef-4d50e91dbfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:51.016814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbe07b-4492-46e3-afef-4d50e91dbfb6 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:51.021363 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:51.021997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:51.022278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:51.023173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] PATH_INFO: `/v3/users/60efa77075d94402a0cb8e9e427772cc` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:51.037680 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60efa77075d94402a0cb8e9e427772cc)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:51.039647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:51.074344 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:51.254217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60efa77075d94402a0cb8e9e427772cc'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.256646 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60efa77075d94402a0cb8e9e427772cc'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.262033 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60efa77075d94402a0cb8e9e427772cc'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.262665 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60efa77075d94402a0cb8e9e427772cc'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.275358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60efa77075d94402a0cb8e9e427772cc'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.394894 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1332/2656] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:50 2022] DELETE /identity/v3/users/60efa77075d94402a0cb8e9e427772cc => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:51.438703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e468276-0eae-46ea-b25a-3cf4b863c4c4 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:51.450166 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e468276-0eae-46ea-b25a-3cf4b863c4c4 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:51.514981 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b04e2e-e68b-4aa7-9cc5-e7975c6ed11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:51.515625 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04e2e-e68b-4aa7-9cc5-e7975c6ed11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:51.515905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04e2e-e68b-4aa7-9cc5-e7975c6ed11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:51.516179 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b04e2e-e68b-4aa7-9cc5-e7975c6ed11f admin admin] PATH_INFO: `/v3/users/5c6a6d19c5b54b44acdb5fcf09641652` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:51.517385 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b04e2e-e68b-4aa7-9cc5-e7975c6ed11f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6a6d19c5b54b44acdb5fcf09641652)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:51.519400 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b04e2e-e68b-4aa7-9cc5-e7975c6ed11f admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:51.524818 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:51.689277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:51.690801 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:51.705420 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2640d-4f9e-4683-95b3-1264d66f8dd0 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:51.710799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:51.711580 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:51.711861 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:51.712135 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] PATH_INFO: `/v3/projects/16c251eb5c6d424b96c53cf3ae3a4256` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:51.726311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c251eb5c6d424b96c53cf3ae3a4256)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:51.728799 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:51.739139 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d4b04e2e-e68b-4aa7-9cc5-e7975c6ed11f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6a6d19c5b54b44acdb5fcf09641652'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.740431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d4b04e2e-e68b-4aa7-9cc5-e7975c6ed11f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6a6d19c5b54b44acdb5fcf09641652'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.740788 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d4b04e2e-e68b-4aa7-9cc5-e7975c6ed11f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6a6d19c5b54b44acdb5fcf09641652'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.757212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d4b04e2e-e68b-4aa7-9cc5-e7975c6ed11f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6a6d19c5b54b44acdb5fcf09641652'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.864925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d4b04e2e-e68b-4aa7-9cc5-e7975c6ed11f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6a6d19c5b54b44acdb5fcf09641652'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.881246 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1325/2657] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:51 2022] DELETE /identity/v3/users/5c6a6d19c5b54b44acdb5fcf09641652 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:51.886722 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c251eb5c6d424b96c53cf3ae3a4256', 'request_id': 'req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.977664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c251eb5c6d424b96c53cf3ae3a4256', 'request_id': 'req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.985494 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c251eb5c6d424b96c53cf3ae3a4256', 'request_id': 'req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.996495 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] The token cache is being invalidate because project 16c251eb5c6d424b96c53cf3ae3a4256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:51.996775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.997426 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-bf7f0ff8-e4e4-4ca0-838a-36dadad05551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:51.999664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1333/2658] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:51 2022] DELETE /identity/v3/projects/16c251eb5c6d424b96c53cf3ae3a4256 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:52.005114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379e5f-01a7-4e70-89b3-1eb9b63d29a7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.005446 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379e5f-01a7-4e70-89b3-1eb9b63d29a7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.005723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379e5f-01a7-4e70-89b3-1eb9b63d29a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.026602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-87379e5f-01a7-4e70-89b3-1eb9b63d29a7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:52.027994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-87379e5f-01a7-4e70-89b3-1eb9b63d29a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:52.091256 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1326/2659] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:52.099915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d5232-2ee6-4848-ae9a-028816ab4d70 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.100196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d5232-2ee6-4848-ae9a-028816ab4d70 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.100493 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d5232-2ee6-4848-ae9a-028816ab4d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.121557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-d31d5232-2ee6-4848-ae9a-028816ab4d70 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:52.123049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d31d5232-2ee6-4848-ae9a-028816ab4d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:52.131673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1334/2660] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:52.136120 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87379e5f-01a7-4e70-89b3-1eb9b63d29a7 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.146671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87379e5f-01a7-4e70-89b3-1eb9b63d29a7 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.151503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db330a6-55c6-4094-b2bc-e8633c433efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.152106 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db330a6-55c6-4094-b2bc-e8633c433efe admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.152425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db330a6-55c6-4094-b2bc-e8633c433efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.152699 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db330a6-55c6-4094-b2bc-e8633c433efe admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.153348 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db330a6-55c6-4094-b2bc-e8633c433efe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:52.153654 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db330a6-55c6-4094-b2bc-e8633c433efe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.156307 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db330a6-55c6-4094-b2bc-e8633c433efe admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.168545 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1327/2661] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:52.177372 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d5232-2ee6-4848-ae9a-028816ab4d70 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.187196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d5232-2ee6-4848-ae9a-028816ab4d70 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.192134 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691ff82-bdcf-479d-ba86-0dc4e28fcf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.192768 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ff82-bdcf-479d-ba86-0dc4e28fcf45 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.193053 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ff82-bdcf-479d-ba86-0dc4e28fcf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.193327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691ff82-bdcf-479d-ba86-0dc4e28fcf45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.193962 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691ff82-bdcf-479d-ba86-0dc4e28fcf45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.195856 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691ff82-bdcf-479d-ba86-0dc4e28fcf45 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.211876 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db330a6-55c6-4094-b2bc-e8633c433efe admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.213790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8db330a6-55c6-4094-b2bc-e8633c433efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:52.228042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db330a6-55c6-4094-b2bc-e8633c433efe admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.234332 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.237398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.237398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.237398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] PATH_INFO: `/v3/projects/2c22a6db5dc44bae9966b7cce1b8c0ed` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.237398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c22a6db5dc44bae9966b7cce1b8c0ed)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.238772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.299919 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1335/2662] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:52 2022] POST /identity/v3/projects => generated 405 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:52.304354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691ff82-bdcf-479d-ba86-0dc4e28fcf45 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.353224 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:52.355523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c22a6db5dc44bae9966b7cce1b8c0ed', 'request_id': 'req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:52.369797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691ff82-bdcf-479d-ba86-0dc4e28fcf45 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.427947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01040c22-1db3-4d0c-9c9b-85355bb7f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.428592 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01040c22-1db3-4d0c-9c9b-85355bb7f024 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.428876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01040c22-1db3-4d0c-9c9b-85355bb7f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.429175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01040c22-1db3-4d0c-9c9b-85355bb7f024 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.429806 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01040c22-1db3-4d0c-9c9b-85355bb7f024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.431724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01040c22-1db3-4d0c-9c9b-85355bb7f024 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.467633 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c22a6db5dc44bae9966b7cce1b8c0ed', 'request_id': 'req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:52.476060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c22a6db5dc44bae9966b7cce1b8c0ed', 'request_id': 'req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:52.480312 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:52.487251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] The token cache is being invalidate because project 2c22a6db5dc44bae9966b7cce1b8c0ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:52.487540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:52.488204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:52.490088 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1328/2663] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:52 2022] DELETE /identity/v3/projects/2c22a6db5dc44bae9966b7cce1b8c0ed => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:52.493586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.494924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:52.508060 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa57cfe2-eaa0-45af-8dd4-d36b137e9173 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.512751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.513415 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.513691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.514476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] PATH_INFO: `/v3/users/fd89f4c1516647bc97608ff38ac53480` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.515832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd89f4c1516647bc97608ff38ac53480)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.517777 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.584188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1336/2664] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:52 2022] POST /identity/v3/users => generated 303 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:52.588371 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01040c22-1db3-4d0c-9c9b-85355bb7f024 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.589981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-01040c22-1db3-4d0c-9c9b-85355bb7f024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:52.602898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01040c22-1db3-4d0c-9c9b-85355bb7f024 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.607729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63476028-715a-4630-9412-c0476486125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.608627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63476028-715a-4630-9412-c0476486125b admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.608912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63476028-715a-4630-9412-c0476486125b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.609186 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63476028-715a-4630-9412-c0476486125b admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.609831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63476028-715a-4630-9412-c0476486125b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.611416 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63476028-715a-4630-9412-c0476486125b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.621322 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1337/2665] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:26:52.625837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63476028-715a-4630-9412-c0476486125b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.636676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63476028-715a-4630-9412-c0476486125b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.643073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24b0a7-5958-49ea-a13e-5776449c2206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.643707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24b0a7-5958-49ea-a13e-5776449c2206 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.643988 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24b0a7-5958-49ea-a13e-5776449c2206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.644297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24b0a7-5958-49ea-a13e-5776449c2206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.644941 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24b0a7-5958-49ea-a13e-5776449c2206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.646605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24b0a7-5958-49ea-a13e-5776449c2206 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.658254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1338/2666] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:26:52.662513 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24b0a7-5958-49ea-a13e-5776449c2206 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:52.672364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24b0a7-5958-49ea-a13e-5776449c2206 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:52.677226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e67525-ca28-4cf8-9c97-458e28d822f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:52.677874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e67525-ca28-4cf8-9c97-458e28d822f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.684967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e67525-ca28-4cf8-9c97-458e28d822f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.684967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e67525-ca28-4cf8-9c97-458e28d822f3 admin admin] PATH_INFO: `/v3/projects/64faa83e4d824f3aa5aa49fdadb8ee06/users/f85b46938b814057b8367ccf2e30486b/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.694034 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e67525-ca28-4cf8-9c97-458e28d822f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64faa83e4d824f3aa5aa49fdadb8ee06, user_id=f85b46938b814057b8367ccf2e30486b, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:52.696787 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e67525-ca28-4cf8-9c97-458e28d822f3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:52.814902 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd89f4c1516647bc97608ff38ac53480'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:52.815549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd89f4c1516647bc97608ff38ac53480'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:52.816613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd89f4c1516647bc97608ff38ac53480'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:52.828772 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd89f4c1516647bc97608ff38ac53480'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:52.903114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd89f4c1516647bc97608ff38ac53480'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:52.909446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1339/2667] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:52 2022] PUT /identity/v3/projects/64faa83e4d824f3aa5aa49fdadb8ee06/users/f85b46938b814057b8367ccf2e30486b/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:52.919836 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376eab4-ffea-41d8-aaf7-3f10ccd47a7f None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:52.922978 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1329/2668] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:52 2022] DELETE /identity/v3/users/fd89f4c1516647bc97608ff38ac53480 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:52.923140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376eab4-ffea-41d8-aaf7-3f10ccd47a7f None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:52.923140 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376eab4-ffea-41d8-aaf7-3f10ccd47a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:52.950488 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c376eab4-ffea-41d8-aaf7-3f10ccd47a7f None None] MFA Rules not processed for user `f85b46938b814057b8367ccf2e30486b`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:52.952501 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c376eab4-ffea-41d8-aaf7-3f10ccd47a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:53.019491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1340/2669] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:52 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:53.023925 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:53.025491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:53.095952 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474d896-ec68-4b67-9b68-2a23881a009c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:53.100647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf53f24-f283-4a45-b070-a4f6504ccf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:53.101270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf53f24-f283-4a45-b070-a4f6504ccf86 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.101687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf53f24-f283-4a45-b070-a4f6504ccf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.101963 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf53f24-f283-4a45-b070-a4f6504ccf86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.102622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf53f24-f283-4a45-b070-a4f6504ccf86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:53.104566 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf53f24-f283-4a45-b070-a4f6504ccf86 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:53.190998 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376eab4-ffea-41d8-aaf7-3f10ccd47a7f None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:53.192502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c376eab4-ffea-41d8-aaf7-3f10ccd47a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:53.207954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376eab4-ffea-41d8-aaf7-3f10ccd47a7f None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:53.214332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:53.214979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.215263 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.215691 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] PATH_INFO: `/v3/projects/1e02baa7a46b4cb3b32f9b803ac36f86` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.227064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e02baa7a46b4cb3b32f9b803ac36f86)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:53.227064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:53.244144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:53.254339 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1330/2670] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:53 2022] POST /identity/v3/projects => generated 405 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:53.258673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf53f24-f283-4a45-b070-a4f6504ccf86 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:53.312560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:53.324407 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf53f24-f283-4a45-b070-a4f6504ccf86 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:53.330261 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee2a71-f06d-4ba4-9822-ec412137e92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:53.330877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee2a71-f06d-4ba4-9822-ec412137e92b admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.331158 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee2a71-f06d-4ba4-9822-ec412137e92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.331448 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee2a71-f06d-4ba4-9822-ec412137e92b admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.332118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee2a71-f06d-4ba4-9822-ec412137e92b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:53.334129 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee2a71-f06d-4ba4-9822-ec412137e92b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:53.339820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e02baa7a46b4cb3b32f9b803ac36f86', 'request_id': 'req-a7f8cd54-654d-454c-8fd2-f42ea0895d39'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:53.440574 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e02baa7a46b4cb3b32f9b803ac36f86', 'request_id': 'req-a7f8cd54-654d-454c-8fd2-f42ea0895d39'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:53.446656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1331/2671] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:53 2022] POST /identity/v3/users => generated 309 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:53.448186 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e02baa7a46b4cb3b32f9b803ac36f86', 'request_id': 'req-a7f8cd54-654d-454c-8fd2-f42ea0895d39'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:53.452504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee2a71-f06d-4ba4-9822-ec412137e92b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:53.460869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] The token cache is being invalidate because project 1e02baa7a46b4cb3b32f9b803ac36f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:53.461188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:53.461897 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a7f8cd54-654d-454c-8fd2-f42ea0895d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:53.462598 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee2a71-f06d-4ba4-9822-ec412137e92b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:53.463476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1341/2672] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:53 2022] DELETE /identity/v3/projects/1e02baa7a46b4cb3b32f9b803ac36f86 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:53.468429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09859a6-a237-455a-96cb-9700ff56d360 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.468791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09859a6-a237-455a-96cb-9700ff56d360 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.469146 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09859a6-a237-455a-96cb-9700ff56d360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.489070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c09859a6-a237-455a-96cb-9700ff56d360 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:53.490305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c09859a6-a237-455a-96cb-9700ff56d360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:53.529866 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ddd33-9090-493e-8ddd-11a7a837d3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:53.530758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ddd33-9090-493e-8ddd-11a7a837d3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.531015 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ddd33-9090-493e-8ddd-11a7a837d3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.531293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ddd33-9090-493e-8ddd-11a7a837d3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.531957 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ddd33-9090-493e-8ddd-11a7a837d3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:53.533643 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ddd33-9090-493e-8ddd-11a7a837d3a2 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:53.545583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1332/2673] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:53.549867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ddd33-9090-493e-8ddd-11a7a837d3a2 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:53.558854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1342/2674] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:53.561498 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-141ddd33-9090-493e-8ddd-11a7a837d3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:53.574022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ddd33-9090-493e-8ddd-11a7a837d3a2 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:53.578065 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297055f-335a-4e4f-9b12-efd8eda79ef3 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.578366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297055f-335a-4e4f-9b12-efd8eda79ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.578641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297055f-335a-4e4f-9b12-efd8eda79ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.580422 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d085db-d7a0-40c8-8b1c-ff385d612a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:53.581083 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d085db-d7a0-40c8-8b1c-ff385d612a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.581403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d085db-d7a0-40c8-8b1c-ff385d612a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.581677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d085db-d7a0-40c8-8b1c-ff385d612a2d admin admin] PATH_INFO: `/v3/projects/3bca67606a92422a9c89feec3b446656/users/fd984300cc08493d87ec960eac58fa4f/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.597319 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d085db-d7a0-40c8-8b1c-ff385d612a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bca67606a92422a9c89feec3b446656, user_id=fd984300cc08493d87ec960eac58fa4f, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:53.599516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-9297055f-335a-4e4f-9b12-efd8eda79ef3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:53.599935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-9297055f-335a-4e4f-9b12-efd8eda79ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:53.600057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d085db-d7a0-40c8-8b1c-ff385d612a2d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:53.609417 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1343/2675] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:53.613728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297055f-335a-4e4f-9b12-efd8eda79ef3 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:53.623070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297055f-335a-4e4f-9b12-efd8eda79ef3 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:53.628619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580b53b-c028-441e-8777-f7045430660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:53.629225 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580b53b-c028-441e-8777-f7045430660a admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.629504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580b53b-c028-441e-8777-f7045430660a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.629776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580b53b-c028-441e-8777-f7045430660a admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.630451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580b53b-c028-441e-8777-f7045430660a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:53.630755 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580b53b-c028-441e-8777-f7045430660a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:53.632432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580b53b-c028-441e-8777-f7045430660a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:53.644958 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1344/2676] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:53.649216 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580b53b-c028-441e-8777-f7045430660a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:53.659656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580b53b-c028-441e-8777-f7045430660a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:53.664389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b51db-2a76-4f68-b9fb-91bda27faa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:53.665055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b51db-2a76-4f68-b9fb-91bda27faa4f admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.665335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b51db-2a76-4f68-b9fb-91bda27faa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.665648 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b51db-2a76-4f68-b9fb-91bda27faa4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.666294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b51db-2a76-4f68-b9fb-91bda27faa4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:53.668189 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b51db-2a76-4f68-b9fb-91bda27faa4f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:53.686699 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1333/2677] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:53 2022] PUT /identity/v3/projects/3bca67606a92422a9c89feec3b446656/users/fd984300cc08493d87ec960eac58fa4f/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:53.690798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d085db-d7a0-40c8-8b1c-ff385d612a2d admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:53.754141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d085db-d7a0-40c8-8b1c-ff385d612a2d admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:53.759175 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff9fbe-d63f-4d55-b772-99a415bafa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:53.759790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9fbe-d63f-4d55-b772-99a415bafa05 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.760069 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9fbe-d63f-4d55-b772-99a415bafa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.760850 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9fbe-d63f-4d55-b772-99a415bafa05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.761151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff9fbe-d63f-4d55-b772-99a415bafa05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:53.762775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff9fbe-d63f-4d55-b772-99a415bafa05 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:53.773663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1334/2678] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:26:53.777742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff9fbe-d63f-4d55-b772-99a415bafa05 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:53.787954 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff9fbe-d63f-4d55-b772-99a415bafa05 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:53.792597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfd6ef-0808-473c-b846-38fa44c158f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:53.793242 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd6ef-0808-473c-b846-38fa44c158f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.793523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd6ef-0808-473c-b846-38fa44c158f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.793798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd6ef-0808-473c-b846-38fa44c158f6 admin admin] PATH_INFO: `/v3/projects/3bca67606a92422a9c89feec3b446656/users/fd984300cc08493d87ec960eac58fa4f/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.796523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfd6ef-0808-473c-b846-38fa44c158f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bca67606a92422a9c89feec3b446656, user_id=fd984300cc08493d87ec960eac58fa4f, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:53.799089 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfd6ef-0808-473c-b846-38fa44c158f6 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:53.809195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1335/2679] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:53 2022] PUT /identity/v3/projects/3bca67606a92422a9c89feec3b446656/users/fd984300cc08493d87ec960eac58fa4f/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:53.821867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05bb8-84f2-45eb-9652-3a71224f8a47 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.822154 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05bb8-84f2-45eb-9652-3a71224f8a47 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.822431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05bb8-84f2-45eb-9652-3a71224f8a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.836546 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1345/2680] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:53 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:53.840410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b51db-2a76-4f68-b9fb-91bda27faa4f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:53.851347 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-63d05bb8-84f2-45eb-9652-3a71224f8a47 None None] MFA Rules not processed for user `fd984300cc08493d87ec960eac58fa4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:53.852770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-63d05bb8-84f2-45eb-9652-3a71224f8a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:53.878888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:53.912236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b51db-2a76-4f68-b9fb-91bda27faa4f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:53.916984 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66430e5f-5490-406c-942f-8185f2a72836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:53.917594 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66430e5f-5490-406c-942f-8185f2a72836 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:53.917871 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66430e5f-5490-406c-942f-8185f2a72836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:53.918139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66430e5f-5490-406c-942f-8185f2a72836 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:53.918762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66430e5f-5490-406c-942f-8185f2a72836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:53.921742 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66430e5f-5490-406c-942f-8185f2a72836 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:53.928674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1336/2681] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:53.933284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:53.940243 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d05bb8-84f2-45eb-9652-3a71224f8a47 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:53.941834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-63d05bb8-84f2-45eb-9652-3a71224f8a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:54.000716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d05bb8-84f2-45eb-9652-3a71224f8a47 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:54.004690 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdcba4-6dc4-494c-b3b7-8e4b8f102258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:54.005290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdcba4-6dc4-494c-b3b7-8e4b8f102258 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.005642 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdcba4-6dc4-494c-b3b7-8e4b8f102258 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.005843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdcba4-6dc4-494c-b3b7-8e4b8f102258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.015381 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdcba4-6dc4-494c-b3b7-8e4b8f102258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:54.016865 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdcba4-6dc4-494c-b3b7-8e4b8f102258 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:54.022153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1346/2682] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:53 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:54.027729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66430e5f-5490-406c-942f-8185f2a72836 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:54.029036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1337/2683] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:53 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:26:54.036879 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66430e5f-5490-406c-942f-8185f2a72836 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:54.042945 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c032ae-3490-4062-8651-bc0f16768089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:54.043568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c032ae-3490-4062-8651-bc0f16768089 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.044062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c032ae-3490-4062-8651-bc0f16768089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.044529 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c032ae-3490-4062-8651-bc0f16768089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.048277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c032ae-3490-4062-8651-bc0f16768089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:54.048277 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c032ae-3490-4062-8651-bc0f16768089 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:54.064699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1347/2684] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:26:54.068639 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdcba4-6dc4-494c-b3b7-8e4b8f102258 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:54.080046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdcba4-6dc4-494c-b3b7-8e4b8f102258 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:54.086145 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a98213-ce70-4f33-aede-83a1f5b0f6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:54.087044 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a98213-ce70-4f33-aede-83a1f5b0f6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.087323 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a98213-ce70-4f33-aede-83a1f5b0f6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.088038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a98213-ce70-4f33-aede-83a1f5b0f6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.088725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a98213-ce70-4f33-aede-83a1f5b0f6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:54.090419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a98213-ce70-4f33-aede-83a1f5b0f6c5 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:54.102484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1338/2685] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:54.106622 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c032ae-3490-4062-8651-bc0f16768089 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:54.117937 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c032ae-3490-4062-8651-bc0f16768089 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:54.122738 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845070e3-d665-4f28-b5dc-4f3825d53399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:54.124020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845070e3-d665-4f28-b5dc-4f3825d53399 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.124327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845070e3-d665-4f28-b5dc-4f3825d53399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.124607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845070e3-d665-4f28-b5dc-4f3825d53399 admin admin] PATH_INFO: `/v3/projects/6e5a6c9c1a314508a16461ca05371229/users/a3cfab1d68fb43e1a03806b6dc99b26f/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.141476 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845070e3-d665-4f28-b5dc-4f3825d53399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e5a6c9c1a314508a16461ca05371229, user_id=a3cfab1d68fb43e1a03806b6dc99b26f, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:54.144174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845070e3-d665-4f28-b5dc-4f3825d53399 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:54.172118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a98213-ce70-4f33-aede-83a1f5b0f6c5 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:54.183007 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a98213-ce70-4f33-aede-83a1f5b0f6c5 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:54.188820 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d50a2-5c9c-4495-abe6-b519e2b311e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:54.189525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d50a2-5c9c-4495-abe6-b519e2b311e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.189998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d50a2-5c9c-4495-abe6-b519e2b311e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.190291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d50a2-5c9c-4495-abe6-b519e2b311e8 admin admin] PATH_INFO: `/v3/users/f85b46938b814057b8367ccf2e30486b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.191684 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d50a2-5c9c-4495-abe6-b519e2b311e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85b46938b814057b8367ccf2e30486b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:54.193693 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d50a2-5c9c-4495-abe6-b519e2b311e8 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:54.206690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1348/2686] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:54 2022] PUT /identity/v3/projects/6e5a6c9c1a314508a16461ca05371229/users/a3cfab1d68fb43e1a03806b6dc99b26f/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:54.216775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc034a4-c319-433b-998f-930489b9154c None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.217551 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc034a4-c319-433b-998f-930489b9154c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.218051 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc034a4-c319-433b-998f-930489b9154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.247175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-fcc034a4-c319-433b-998f-930489b9154c None None] MFA Rules not processed for user `a3cfab1d68fb43e1a03806b6dc99b26f`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:54.252131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fcc034a4-c319-433b-998f-930489b9154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:54.320176 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1349/2687] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:54.324788 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc034a4-c319-433b-998f-930489b9154c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:54.384276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-922d50a2-5c9c-4495-abe6-b519e2b311e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85b46938b814057b8367ccf2e30486b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:54.384989 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-922d50a2-5c9c-4495-abe6-b519e2b311e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85b46938b814057b8367ccf2e30486b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:54.385628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-922d50a2-5c9c-4495-abe6-b519e2b311e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85b46938b814057b8367ccf2e30486b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:54.390302 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc034a4-c319-433b-998f-930489b9154c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:54.395164 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047a3c3-ebd9-437b-8620-38cc1c62f50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:54.395884 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047a3c3-ebd9-437b-8620-38cc1c62f50c admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.396321 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047a3c3-ebd9-437b-8620-38cc1c62f50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.396700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047a3c3-ebd9-437b-8620-38cc1c62f50c admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.397482 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047a3c3-ebd9-437b-8620-38cc1c62f50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:54.399138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-922d50a2-5c9c-4495-abe6-b519e2b311e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85b46938b814057b8367ccf2e30486b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:54.399489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047a3c3-ebd9-437b-8620-38cc1c62f50c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:54.486185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-922d50a2-5c9c-4495-abe6-b519e2b311e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85b46938b814057b8367ccf2e30486b'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:54.499745 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1339/2688] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:54 2022] DELETE /identity/v3/users/f85b46938b814057b8367ccf2e30486b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:54.504279 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235bd89-dcd1-4ddb-8ffe-6eddacef78a3 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.504568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235bd89-dcd1-4ddb-8ffe-6eddacef78a3 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.504840 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235bd89-dcd1-4ddb-8ffe-6eddacef78a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.526197 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8235bd89-dcd1-4ddb-8ffe-6eddacef78a3 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:54.527413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8235bd89-dcd1-4ddb-8ffe-6eddacef78a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:54.542939 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1350/2689] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:54 2022] POST /identity/v3/projects => generated 363 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:54.547766 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047a3c3-ebd9-437b-8620-38cc1c62f50c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:54.548547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:54.549702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3047a3c3-ebd9-437b-8620-38cc1c62f50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:54.591410 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1340/2690] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:54.595002 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:54.603024 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235bd89-dcd1-4ddb-8ffe-6eddacef78a3 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:54.604612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8235bd89-dcd1-4ddb-8ffe-6eddacef78a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:54.620381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047a3c3-ebd9-437b-8620-38cc1c62f50c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:54.625364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706245a4-84d7-41a8-8785-b74f5d9f60c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:54.626006 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706245a4-84d7-41a8-8785-b74f5d9f60c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.627550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706245a4-84d7-41a8-8785-b74f5d9f60c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.627550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706245a4-84d7-41a8-8785-b74f5d9f60c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.627814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706245a4-84d7-41a8-8785-b74f5d9f60c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:54.629712 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706245a4-84d7-41a8-8785-b74f5d9f60c4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:54.663464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235bd89-dcd1-4ddb-8ffe-6eddacef78a3 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:54.720194 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1351/2691] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:54 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:54.720456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4184f56-3041-4284-9529-402fb60537a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:54.720456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184f56-3041-4284-9529-402fb60537a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.720456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184f56-3041-4284-9529-402fb60537a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.720456 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184f56-3041-4284-9529-402fb60537a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.722295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706245a4-84d7-41a8-8785-b74f5d9f60c4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:54.737914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4184f56-3041-4284-9529-402fb60537a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:54.740313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706245a4-84d7-41a8-8785-b74f5d9f60c4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:54.740490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4184f56-3041-4284-9529-402fb60537a6 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:54.749586 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15059d0-15ad-46ad-921e-69f901966ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:54.750642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15059d0-15ad-46ad-921e-69f901966ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.751244 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15059d0-15ad-46ad-921e-69f901966ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.751801 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15059d0-15ad-46ad-921e-69f901966ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.753443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15059d0-15ad-46ad-921e-69f901966ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:54.756124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15059d0-15ad-46ad-921e-69f901966ca0 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:54.758825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1341/2692] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:54.780366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1352/2693] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:26:54.783750 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4184f56-3041-4284-9529-402fb60537a6 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:54.794775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4184f56-3041-4284-9529-402fb60537a6 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:54.799691 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc459c9-b2d8-4356-a6f4-82f4ac48cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:54.800394 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc459c9-b2d8-4356-a6f4-82f4ac48cab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:54.800675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc459c9-b2d8-4356-a6f4-82f4ac48cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:54.800950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc459c9-b2d8-4356-a6f4-82f4ac48cab4 admin admin] PATH_INFO: `/v3/projects/dc2ce57a1fc74a22988ba0e539e2294a/users/5d0a2522379f4f1687b7cd7598db9840/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:54.818134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc459c9-b2d8-4356-a6f4-82f4ac48cab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2ce57a1fc74a22988ba0e539e2294a, user_id=5d0a2522379f4f1687b7cd7598db9840, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:54.820768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc459c9-b2d8-4356-a6f4-82f4ac48cab4 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:54.926563 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1342/2694] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:54 2022] PUT /identity/v3/projects/dc2ce57a1fc74a22988ba0e539e2294a/users/5d0a2522379f4f1687b7cd7598db9840/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:54.930615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15059d0-15ad-46ad-921e-69f901966ca0 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:54.941475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15059d0-15ad-46ad-921e-69f901966ca0 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:55.023963 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905041a-a661-483f-8c48-3600bae66006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:55.024789 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905041a-a661-483f-8c48-3600bae66006 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:55.025398 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905041a-a661-483f-8c48-3600bae66006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:55.025682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905041a-a661-483f-8c48-3600bae66006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:55.026635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905041a-a661-483f-8c48-3600bae66006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:55.028445 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905041a-a661-483f-8c48-3600bae66006 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:55.045128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1353/2695] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:55.049375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc459c9-b2d8-4356-a6f4-82f4ac48cab4 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:55.061959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc459c9-b2d8-4356-a6f4-82f4ac48cab4 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:55.066747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba071d-d90d-4eb3-86de-e7c4d064a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:55.067453 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba071d-d90d-4eb3-86de-e7c4d064a776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:55.067733 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba071d-d90d-4eb3-86de-e7c4d064a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:55.068006 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba071d-d90d-4eb3-86de-e7c4d064a776 admin admin] PATH_INFO: `/v3/projects/dc2ce57a1fc74a22988ba0e539e2294a/users/5d0a2522379f4f1687b7cd7598db9840/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:55.070034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba071d-d90d-4eb3-86de-e7c4d064a776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2ce57a1fc74a22988ba0e539e2294a, user_id=5d0a2522379f4f1687b7cd7598db9840, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:55.072762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba071d-d90d-4eb3-86de-e7c4d064a776 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:55.086051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1343/2696] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:55 2022] PUT /identity/v3/projects/dc2ce57a1fc74a22988ba0e539e2294a/users/5d0a2522379f4f1687b7cd7598db9840/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:55.098352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3a70e-35bf-4be2-8e3a-b985434af3fc None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:55.103269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3a70e-35bf-4be2-8e3a-b985434af3fc None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:55.103269 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3a70e-35bf-4be2-8e3a-b985434af3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:55.129358 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-97c3a70e-35bf-4be2-8e3a-b985434af3fc None None] MFA Rules not processed for user `5d0a2522379f4f1687b7cd7598db9840`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:55.130609 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-97c3a70e-35bf-4be2-8e3a-b985434af3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:55.205661 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1354/2697] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:55.213845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba071d-d90d-4eb3-86de-e7c4d064a776 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:55.215520 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-04ba071d-d90d-4eb3-86de-e7c4d064a776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:55.218617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3a70e-35bf-4be2-8e3a-b985434af3fc None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:55.220141 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-97c3a70e-35bf-4be2-8e3a-b985434af3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:55.262459 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:55.274795 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:55.280862 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3a70e-35bf-4be2-8e3a-b985434af3fc None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:55.285063 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd03ca-b780-4c9a-b329-94b4c10720d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:55.285682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd03ca-b780-4c9a-b329-94b4c10720d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:55.285966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd03ca-b780-4c9a-b329-94b4c10720d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:55.286247 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd03ca-b780-4c9a-b329-94b4c10720d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:55.292737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba071d-d90d-4eb3-86de-e7c4d064a776 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:55.298548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:55.299196 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:55.299482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:55.299758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] PATH_INFO: `/v3/projects/64faa83e4d824f3aa5aa49fdadb8ee06` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:55.300559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd03ca-b780-4c9a-b329-94b4c10720d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:55.301025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64faa83e4d824f3aa5aa49fdadb8ee06)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:55.302151 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd03ca-b780-4c9a-b329-94b4c10720d3 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:55.303050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:55.312475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1355/2698] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:55.494859 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64faa83e4d824f3aa5aa49fdadb8ee06', 'request_id': 'req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:55.611561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64faa83e4d824f3aa5aa49fdadb8ee06', 'request_id': 'req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:55.622484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64faa83e4d824f3aa5aa49fdadb8ee06', 'request_id': 'req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:55.630170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] The token cache is being invalidate because project 64faa83e4d824f3aa5aa49fdadb8ee06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:55.630452 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:55.631130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:55.632730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1344/2699] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:55 2022] DELETE /identity/v3/projects/64faa83e4d824f3aa5aa49fdadb8ee06 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:55.637135 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd03ca-b780-4c9a-b329-94b4c10720d3 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:55.652950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd03ca-b780-4c9a-b329-94b4c10720d3 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:55.717559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:55.718110 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:55.718410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:55.718734 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] PATH_INFO: `/v3/users/fd984300cc08493d87ec960eac58fa4f` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:55.719968 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd984300cc08493d87ec960eac58fa4f)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:55.721803 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:55.916553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd984300cc08493d87ec960eac58fa4f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:55.917343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd984300cc08493d87ec960eac58fa4f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:55.924392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd984300cc08493d87ec960eac58fa4f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:55.925179 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd984300cc08493d87ec960eac58fa4f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:55.938718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd984300cc08493d87ec960eac58fa4f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.082703 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:56.084200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:56.101855 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c3f6d-6d75-4d9c-9a2f-04aa06a1073d admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:56.107264 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1356/2700] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:55 2022] DELETE /identity/v3/users/fd984300cc08493d87ec960eac58fa4f => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:56.112018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183480bc-f440-4c63-9893-a9ab29a1eade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:56.112018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183480bc-f440-4c63-9893-a9ab29a1eade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:56.112018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183480bc-f440-4c63-9893-a9ab29a1eade admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:56.112018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183480bc-f440-4c63-9893-a9ab29a1eade admin admin] PATH_INFO: `/v3/users/c6aa9c0fa5dd44649022ac3d81590a90` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:56.112485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183480bc-f440-4c63-9893-a9ab29a1eade admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6aa9c0fa5dd44649022ac3d81590a90)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:56.114941 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183480bc-f440-4c63-9893-a9ab29a1eade admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:56.322199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-183480bc-f440-4c63-9893-a9ab29a1eade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6aa9c0fa5dd44649022ac3d81590a90'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.322846 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-183480bc-f440-4c63-9893-a9ab29a1eade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6aa9c0fa5dd44649022ac3d81590a90'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.323445 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-183480bc-f440-4c63-9893-a9ab29a1eade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6aa9c0fa5dd44649022ac3d81590a90'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.335931 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-183480bc-f440-4c63-9893-a9ab29a1eade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6aa9c0fa5dd44649022ac3d81590a90'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.400370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:56.405340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:56.419630 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-183480bc-f440-4c63-9893-a9ab29a1eade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6aa9c0fa5dd44649022ac3d81590a90'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.438658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1345/2701] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:56 2022] DELETE /identity/v3/users/c6aa9c0fa5dd44649022ac3d81590a90 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:56.443190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742862b-a721-4a36-9362-4df2f69dffae None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:56.443611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742862b-a721-4a36-9362-4df2f69dffae None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:56.443951 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742862b-a721-4a36-9362-4df2f69dffae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:56.464727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-8742862b-a721-4a36-9362-4df2f69dffae None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:56.466034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8742862b-a721-4a36-9362-4df2f69dffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:56.482057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:56.486627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac7350-0449-4eaf-8849-680441a161e0 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:56.515697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:56.534128 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1346/2702] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:56.544127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742862b-a721-4a36-9362-4df2f69dffae None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:56.546579 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8742862b-a721-4a36-9362-4df2f69dffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:56.549525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15117944-26f4-4d92-b845-9f38961d77a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:56.550164 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15117944-26f4-4d92-b845-9f38961d77a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:56.550443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15117944-26f4-4d92-b845-9f38961d77a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:56.550718 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15117944-26f4-4d92-b845-9f38961d77a1 admin admin] PATH_INFO: `/v3/users/a3cfab1d68fb43e1a03806b6dc99b26f` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:56.551864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15117944-26f4-4d92-b845-9f38961d77a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3cfab1d68fb43e1a03806b6dc99b26f)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:56.554021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15117944-26f4-4d92-b845-9f38961d77a1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:56.613213 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742862b-a721-4a36-9362-4df2f69dffae None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:56.616883 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ca47c-9758-4cad-ad5c-e2ba8f602054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:56.617489 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ca47c-9758-4cad-ad5c-e2ba8f602054 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:56.617770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ca47c-9758-4cad-ad5c-e2ba8f602054 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:56.618039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ca47c-9758-4cad-ad5c-e2ba8f602054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:56.627592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ca47c-9758-4cad-ad5c-e2ba8f602054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:56.629075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ca47c-9758-4cad-ad5c-e2ba8f602054 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:56.638533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1347/2703] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:26:56.697924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ca47c-9758-4cad-ad5c-e2ba8f602054 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:56.697924 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c94ca47c-9758-4cad-ad5c-e2ba8f602054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:56.720848 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ca47c-9758-4cad-ad5c-e2ba8f602054 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:56.726503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:56.727100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:56.727412 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:56.727670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] PATH_INFO: `/v3/projects/3bca67606a92422a9c89feec3b446656` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:56.729535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bca67606a92422a9c89feec3b446656)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:56.731440 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:56.802536 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-15117944-26f4-4d92-b845-9f38961d77a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3cfab1d68fb43e1a03806b6dc99b26f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.803180 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-15117944-26f4-4d92-b845-9f38961d77a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3cfab1d68fb43e1a03806b6dc99b26f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.810111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-15117944-26f4-4d92-b845-9f38961d77a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3cfab1d68fb43e1a03806b6dc99b26f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.810839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-15117944-26f4-4d92-b845-9f38961d77a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3cfab1d68fb43e1a03806b6dc99b26f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.823027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-15117944-26f4-4d92-b845-9f38961d77a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3cfab1d68fb43e1a03806b6dc99b26f'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.894667 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bca67606a92422a9c89feec3b446656', 'request_id': 'req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.909736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1357/2704] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:56 2022] DELETE /identity/v3/users/a3cfab1d68fb43e1a03806b6dc99b26f => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:56.916431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b363be-f6e6-41bf-ac8a-a62f85c9fad7 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:56.916431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b363be-f6e6-41bf-ac8a-a62f85c9fad7 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:56.916431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b363be-f6e6-41bf-ac8a-a62f85c9fad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:56.935108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-00b363be-f6e6-41bf-ac8a-a62f85c9fad7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:56.936449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-00b363be-f6e6-41bf-ac8a-a62f85c9fad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:56.989462 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bca67606a92422a9c89feec3b446656', 'request_id': 'req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:56.999436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bca67606a92422a9c89feec3b446656', 'request_id': 'req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.007360 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1358/2705] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:57.011586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] The token cache is being invalidate because project 3bca67606a92422a9c89feec3b446656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:57.011885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.012601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-2cbbc781-31a5-421d-a9ed-3f5056c5b5c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.015178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1348/2706] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:56 2022] DELETE /identity/v3/projects/3bca67606a92422a9c89feec3b446656 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:57.015306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b363be-f6e6-41bf-ac8a-a62f85c9fad7 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.017703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-00b363be-f6e6-41bf-ac8a-a62f85c9fad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:57.019877 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69326ba7-e7ca-4bd1-a26e-420de1620846 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.020163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69326ba7-e7ca-4bd1-a26e-420de1620846 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.020470 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69326ba7-e7ca-4bd1-a26e-420de1620846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.042705 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-69326ba7-e7ca-4bd1-a26e-420de1620846 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:57.043956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-69326ba7-e7ca-4bd1-a26e-420de1620846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:57.052334 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:57.060108 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1349/2707] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:57.061904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d268a18-46d1-45e8-88eb-4d70efb180f7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.062230 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d268a18-46d1-45e8-88eb-4d70efb180f7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.062541 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d268a18-46d1-45e8-88eb-4d70efb180f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.082547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-6d268a18-46d1-45e8-88eb-4d70efb180f7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:57.083752 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-6d268a18-46d1-45e8-88eb-4d70efb180f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:57.090122 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b363be-f6e6-41bf-ac8a-a62f85c9fad7 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.092923 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1350/2708] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:57.094965 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eac51-91c8-4b99-a289-3e694763ebf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.095608 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eac51-91c8-4b99-a289-3e694763ebf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.095886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eac51-91c8-4b99-a289-3e694763ebf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.096162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eac51-91c8-4b99-a289-3e694763ebf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.097447 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d268a18-46d1-45e8-88eb-4d70efb180f7 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.097973 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d48eac51-91c8-4b99-a289-3e694763ebf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:57.106658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d268a18-46d1-45e8-88eb-4d70efb180f7 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.110298 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48eac51-91c8-4b99-a289-3e694763ebf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.111802 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48eac51-91c8-4b99-a289-3e694763ebf2 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:57.112077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1385a-e3a7-4108-b00a-acd6b8c14254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.112718 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1385a-e3a7-4108-b00a-acd6b8c14254 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.112999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1385a-e3a7-4108-b00a-acd6b8c14254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.113266 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1385a-e3a7-4108-b00a-acd6b8c14254 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.113906 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1385a-e3a7-4108-b00a-acd6b8c14254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:57.114207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1385a-e3a7-4108-b00a-acd6b8c14254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.115780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1385a-e3a7-4108-b00a-acd6b8c14254 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:57.122058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1359/2709] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:57.129508 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1351/2710] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:26:57.134017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eac51-91c8-4b99-a289-3e694763ebf2 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.134384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1385a-e3a7-4108-b00a-acd6b8c14254 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.135777 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-d48eac51-91c8-4b99-a289-3e694763ebf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:57.146595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1385a-e3a7-4108-b00a-acd6b8c14254 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.152144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaac1f-2733-4b03-8ff2-ed933c094c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.152535 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaac1f-2733-4b03-8ff2-ed933c094c22 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.152912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaac1f-2733-4b03-8ff2-ed933c094c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.153671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaac1f-2733-4b03-8ff2-ed933c094c22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.153886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaac1f-2733-4b03-8ff2-ed933c094c22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.157013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaac1f-2733-4b03-8ff2-ed933c094c22 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:57.164587 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eac51-91c8-4b99-a289-3e694763ebf2 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.170412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.171181 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.171556 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.171957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] PATH_INFO: `/v3/projects/6fb7b51d9c8b4729b582cab30ff03fa2` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.173248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb7b51d9c8b4729b582cab30ff03fa2)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.175284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:57.283904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1352/2711] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:57 2022] POST /identity/v3/projects => generated 357 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:57.285327 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaac1f-2733-4b03-8ff2-ed933c094c22 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.316912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb7b51d9c8b4729b582cab30ff03fa2', 'request_id': 'req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.321881 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:57.355405 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaac1f-2733-4b03-8ff2-ed933c094c22 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.412510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bace857-5d04-4233-9f43-3d3365a30fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.413150 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace857-5d04-4233-9f43-3d3365a30fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.413425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace857-5d04-4233-9f43-3d3365a30fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.413696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace857-5d04-4233-9f43-3d3365a30fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.414428 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bace857-5d04-4233-9f43-3d3365a30fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.416444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bace857-5d04-4233-9f43-3d3365a30fc8 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:57.423124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb7b51d9c8b4729b582cab30ff03fa2', 'request_id': 'req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.430450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb7b51d9c8b4729b582cab30ff03fa2', 'request_id': 'req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.442086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] The token cache is being invalidate because project 6fb7b51d9c8b4729b582cab30ff03fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:57.442374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.443057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-cd5d47a3-c2ac-4cda-953f-31553ee11a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.444599 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1360/2712] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:57 2022] DELETE /identity/v3/projects/6fb7b51d9c8b4729b582cab30ff03fa2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:57.449221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cbbfb-a831-4d16-a3c0-592c801f79b1 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.449507 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cbbfb-a831-4d16-a3c0-592c801f79b1 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.449898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cbbfb-a831-4d16-a3c0-592c801f79b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.470382 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-740cbbfb-a831-4d16-a3c0-592c801f79b1 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:57.471688 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-740cbbfb-a831-4d16-a3c0-592c801f79b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:57.480644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1361/2713] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:57.488443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51df7c-23e7-4621-921a-55b6a9eb143d None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.488726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51df7c-23e7-4621-921a-55b6a9eb143d None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.488997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51df7c-23e7-4621-921a-55b6a9eb143d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.509284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-3e51df7c-23e7-4621-921a-55b6a9eb143d None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:57.515427 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3e51df7c-23e7-4621-921a-55b6a9eb143d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:57.519044 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1353/2714] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:57 2022] POST /identity/v3/users => generated 279 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:57.520114 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bace857-5d04-4233-9f43-3d3365a30fc8 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.520270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1362/2715] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:57.521790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7bace857-5d04-4233-9f43-3d3365a30fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:57.524247 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51df7c-23e7-4621-921a-55b6a9eb143d None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.534007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51df7c-23e7-4621-921a-55b6a9eb143d None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.534488 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bace857-5d04-4233-9f43-3d3365a30fc8 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.539428 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a467e-d544-4a1a-a2b5-10c7b107b38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.540048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a467e-d544-4a1a-a2b5-10c7b107b38f admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.543188 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a467e-d544-4a1a-a2b5-10c7b107b38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.543430 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaadb19-1781-4fab-8a32-945c9560e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.546400 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a467e-d544-4a1a-a2b5-10c7b107b38f admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.546518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaadb19-1781-4fab-8a32-945c9560e2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.546741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a467e-d544-4a1a-a2b5-10c7b107b38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:57.546845 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaadb19-1781-4fab-8a32-945c9560e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.546929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a467e-d544-4a1a-a2b5-10c7b107b38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.547025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaadb19-1781-4fab-8a32-945c9560e2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.547025 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaadb19-1781-4fab-8a32-945c9560e2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.547207 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a467e-d544-4a1a-a2b5-10c7b107b38f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:57.547297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaadb19-1781-4fab-8a32-945c9560e2a5 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:57.560188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1354/2716] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:57.560188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaadb19-1781-4fab-8a32-945c9560e2a5 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.560188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-beaadb19-1781-4fab-8a32-945c9560e2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:57.562899 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1363/2717] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:57.563907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a467e-d544-4a1a-a2b5-10c7b107b38f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.575290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a467e-d544-4a1a-a2b5-10c7b107b38f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.578540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaadb19-1781-4fab-8a32-945c9560e2a5 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.581605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddc600-db59-45a3-b42a-faf77c12993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.582364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddc600-db59-45a3-b42a-faf77c12993a admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.582774 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddc600-db59-45a3-b42a-faf77c12993a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.583046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddc600-db59-45a3-b42a-faf77c12993a admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.583704 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddc600-db59-45a3-b42a-faf77c12993a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.584980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.585380 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddc600-db59-45a3-b42a-faf77c12993a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:57.585811 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.586158 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.586501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] PATH_INFO: `/v3/projects/6e5a6c9c1a314508a16461ca05371229` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.587731 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e5a6c9c1a314508a16461ca05371229)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.589780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:57.597031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1364/2718] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:57.601725 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddc600-db59-45a3-b42a-faf77c12993a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.608876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddc600-db59-45a3-b42a-faf77c12993a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.613867 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7bd0-9813-4641-ac8d-d02378e353c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.614472 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7bd0-9813-4641-ac8d-d02378e353c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.614745 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7bd0-9813-4641-ac8d-d02378e353c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.615013 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c7bd0-9813-4641-ac8d-d02378e353c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.615695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c7bd0-9813-4641-ac8d-d02378e353c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.617615 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c7bd0-9813-4641-ac8d-d02378e353c4 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:57.757155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1365/2719] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:57 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:57.758031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7bd0-9813-4641-ac8d-d02378e353c4 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.767644 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e5a6c9c1a314508a16461ca05371229', 'request_id': 'req-68ab30cf-2d24-46c6-be4b-dfbef106ca98'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.825229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c7bd0-9813-4641-ac8d-d02378e353c4 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.830352 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5293-c571-44c6-aea3-9ba0e1f91dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.831010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5293-c571-44c6-aea3-9ba0e1f91dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.831290 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5293-c571-44c6-aea3-9ba0e1f91dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.831561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c5293-c571-44c6-aea3-9ba0e1f91dd0 admin admin] PATH_INFO: `/v3/projects/d64b5d87d13f495fb09e3abefa569ded/users/23e8bfffa4534039bd3dc5a0a879d932/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.847514 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c5293-c571-44c6-aea3-9ba0e1f91dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64b5d87d13f495fb09e3abefa569ded, user_id=23e8bfffa4534039bd3dc5a0a879d932, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.850303 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c5293-c571-44c6-aea3-9ba0e1f91dd0 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:57.852041 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e5a6c9c1a314508a16461ca05371229', 'request_id': 'req-68ab30cf-2d24-46c6-be4b-dfbef106ca98'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.860103 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e5a6c9c1a314508a16461ca05371229', 'request_id': 'req-68ab30cf-2d24-46c6-be4b-dfbef106ca98'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.870329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] The token cache is being invalidate because project 6e5a6c9c1a314508a16461ca05371229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:57.870612 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.871270 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:57.872819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1355/2720] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:57 2022] DELETE /identity/v3/projects/6e5a6c9c1a314508a16461ca05371229 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:57.876744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.876744 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:57.876994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:57.902821 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1366/2721] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:57 2022] PUT /identity/v3/projects/d64b5d87d13f495fb09e3abefa569ded/users/23e8bfffa4534039bd3dc5a0a879d932/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:57.903754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5293-c571-44c6-aea3-9ba0e1f91dd0 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:57.905702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-668c5293-c571-44c6-aea3-9ba0e1f91dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:57.943662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab30cf-2d24-46c6-be4b-dfbef106ca98 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.973344 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:57.973697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c5293-c571-44c6-aea3-9ba0e1f91dd0 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:57.978721 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:57.979431 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:57.979778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:57.980122 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] PATH_INFO: `/v3/users/5d0a2522379f4f1687b7cd7598db9840` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:57.981462 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0a2522379f4f1687b7cd7598db9840)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:57.984194 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.001922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92d557-e9c8-4eb2-b040-47d90a98252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.002792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92d557-e9c8-4eb2-b040-47d90a98252e admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.003073 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92d557-e9c8-4eb2-b040-47d90a98252e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.003351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92d557-e9c8-4eb2-b040-47d90a98252e admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.003983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92d557-e9c8-4eb2-b040-47d90a98252e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.005932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d92d557-e9c8-4eb2-b040-47d90a98252e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.260497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1356/2722] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:57 2022] POST /identity/v3/users => generated 288 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:58.260497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea9123-576d-4e3b-904f-cbc32ada40e7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.260497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea9123-576d-4e3b-904f-cbc32ada40e7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.260497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea9123-576d-4e3b-904f-cbc32ada40e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.287927 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-15ea9123-576d-4e3b-904f-cbc32ada40e7 None None] MFA Rules not processed for user `23e8bfffa4534039bd3dc5a0a879d932`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:58.291650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-15ea9123-576d-4e3b-904f-cbc32ada40e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:58.328221 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0a2522379f4f1687b7cd7598db9840'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:58.329031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0a2522379f4f1687b7cd7598db9840'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:58.336002 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0a2522379f4f1687b7cd7598db9840'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:58.336751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0a2522379f4f1687b7cd7598db9840'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:58.349504 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0a2522379f4f1687b7cd7598db9840'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:58.357626 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1357/2723] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:58.358675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea9123-576d-4e3b-904f-cbc32ada40e7 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.360163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-15ea9123-576d-4e3b-904f-cbc32ada40e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:58.374411 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea9123-576d-4e3b-904f-cbc32ada40e7 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.379277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfa6f1-3f09-4478-a827-b0a502ec7367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.379910 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfa6f1-3f09-4478-a827-b0a502ec7367 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.380441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfa6f1-3f09-4478-a827-b0a502ec7367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.380884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfa6f1-3f09-4478-a827-b0a502ec7367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.381882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfa6f1-3f09-4478-a827-b0a502ec7367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.383533 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfa6f1-3f09-4478-a827-b0a502ec7367 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.394476 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1358/2724] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:58.395242 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfa6f1-3f09-4478-a827-b0a502ec7367 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.396886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-54bfa6f1-3f09-4478-a827-b0a502ec7367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:58.410028 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfa6f1-3f09-4478-a827-b0a502ec7367 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.414699 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc028f-a4da-4678-8a40-02eb8bf7d86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.415317 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc028f-a4da-4678-8a40-02eb8bf7d86e admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.415600 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc028f-a4da-4678-8a40-02eb8bf7d86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.415875 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc028f-a4da-4678-8a40-02eb8bf7d86e admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.416532 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc028f-a4da-4678-8a40-02eb8bf7d86e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.418399 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc028f-a4da-4678-8a40-02eb8bf7d86e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.474555 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1367/2725] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:57 2022] DELETE /identity/v3/users/5d0a2522379f4f1687b7cd7598db9840 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:58.475511 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.540647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1359/2726] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:58 2022] POST /identity/v3/projects => generated 357 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:58.541647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d475d-9143-44c1-abc3-93d64413b803 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.544482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc028f-a4da-4678-8a40-02eb8bf7d86e admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.601818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9550a4-1edb-4b61-9423-d511dd4944ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.602430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9550a4-1edb-4b61-9423-d511dd4944ab admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.602708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9550a4-1edb-4b61-9423-d511dd4944ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.602978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9550a4-1edb-4b61-9423-d511dd4944ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.604460 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9550a4-1edb-4b61-9423-d511dd4944ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.606088 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9550a4-1edb-4b61-9423-d511dd4944ab admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.609963 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc028f-a4da-4678-8a40-02eb8bf7d86e admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.614726 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa087d-bed1-4954-b893-d323da5145f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.615414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa087d-bed1-4954-b893-d323da5145f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.616336 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa087d-bed1-4954-b893-d323da5145f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.616699 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa087d-bed1-4954-b893-d323da5145f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.620270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1368/2727] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:58.620964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa087d-bed1-4954-b893-d323da5145f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.620964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa087d-bed1-4954-b893-d323da5145f7 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.622599 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9550a4-1edb-4b61-9423-d511dd4944ab admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.633248 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9550a4-1edb-4b61-9423-d511dd4944ab admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.638055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81338a-c279-4397-a7eb-b3ecc0f90eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.639604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81338a-c279-4397-a7eb-b3ecc0f90eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.639892 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81338a-c279-4397-a7eb-b3ecc0f90eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.640180 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81338a-c279-4397-a7eb-b3ecc0f90eeb admin admin] PATH_INFO: `/v3/projects/3721d3c5fba9400896c65e2d9baa5806/users/346664ed01a948d6be6a34b6d6c78b5a/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.657059 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81338a-c279-4397-a7eb-b3ecc0f90eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3721d3c5fba9400896c65e2d9baa5806, user_id=346664ed01a948d6be6a34b6d6c78b5a, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.659797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81338a-c279-4397-a7eb-b3ecc0f90eeb admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.688664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1360/2728] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:58 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:58.692791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa087d-bed1-4954-b893-d323da5145f7 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.704963 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa087d-bed1-4954-b893-d323da5145f7 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.707449 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:58.710739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e9bb2-1b5d-49f8-9859-83d8c0aadf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.711465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e9bb2-1b5d-49f8-9859-83d8c0aadf00 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.711762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e9bb2-1b5d-49f8-9859-83d8c0aadf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.712037 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e9bb2-1b5d-49f8-9859-83d8c0aadf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.712816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e9bb2-1b5d-49f8-9859-83d8c0aadf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.716595 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e9bb2-1b5d-49f8-9859-83d8c0aadf00 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.727775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1361/2729] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:58.728950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e9bb2-1b5d-49f8-9859-83d8c0aadf00 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.739425 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e9bb2-1b5d-49f8-9859-83d8c0aadf00 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.743444 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1369/2730] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:58 2022] PUT /identity/v3/projects/3721d3c5fba9400896c65e2d9baa5806/users/346664ed01a948d6be6a34b6d6c78b5a/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:58.761435 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086d679-4b02-4055-b2dc-09fbf8c8d7d6 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.762131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086d679-4b02-4055-b2dc-09fbf8c8d7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.762131 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086d679-4b02-4055-b2dc-09fbf8c8d7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.793384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-5086d679-4b02-4055-b2dc-09fbf8c8d7d6 None None] MFA Rules not processed for user `346664ed01a948d6be6a34b6d6c78b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:58.794666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5086d679-4b02-4055-b2dc-09fbf8c8d7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:58.809819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60845f07-a901-4ce2-bf53-20421ed0d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.811922 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845f07-a901-4ce2-bf53-20421ed0d9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.812329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845f07-a901-4ce2-bf53-20421ed0d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.812680 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60845f07-a901-4ce2-bf53-20421ed0d9f2 admin admin] PATH_INFO: `/v3/projects/1341c1b5944e4582b7a076551951e58a/users/d82fe70209174e4ba42058165f9663ea/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.829300 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:58.830377 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60845f07-a901-4ce2-bf53-20421ed0d9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1341c1b5944e4582b7a076551951e58a, user_id=d82fe70209174e4ba42058165f9663ea, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.833210 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60845f07-a901-4ce2-bf53-20421ed0d9f2 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.862612 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1370/2731] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:58.873861 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086d679-4b02-4055-b2dc-09fbf8c8d7d6 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.875292 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5086d679-4b02-4055-b2dc-09fbf8c8d7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:58.905301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1362/2732] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:58 2022] PUT /identity/v3/projects/1341c1b5944e4582b7a076551951e58a/users/d82fe70209174e4ba42058165f9663ea/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:26:58.906329 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60845f07-a901-4ce2-bf53-20421ed0d9f2 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:58.909991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-60845f07-a901-4ce2-bf53-20421ed0d9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:58.937035 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086d679-4b02-4055-b2dc-09fbf8c8d7d6 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.975793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60845f07-a901-4ce2-bf53-20421ed0d9f2 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:58.980790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.981454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.981997 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.982356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] PATH_INFO: `/v3/projects/dc2ce57a1fc74a22988ba0e539e2294a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:58.984200 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2ce57a1fc74a22988ba0e539e2294a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:58.987063 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:58.988854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75431911-7a6c-4d9b-b8f1-19bf6600df57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:58.989593 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75431911-7a6c-4d9b-b8f1-19bf6600df57 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:58.989741 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75431911-7a6c-4d9b-b8f1-19bf6600df57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:58.990175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75431911-7a6c-4d9b-b8f1-19bf6600df57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.048284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75431911-7a6c-4d9b-b8f1-19bf6600df57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.049635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75431911-7a6c-4d9b-b8f1-19bf6600df57 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.058619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1371/2733] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:59.059559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75431911-7a6c-4d9b-b8f1-19bf6600df57 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.070054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75431911-7a6c-4d9b-b8f1-19bf6600df57 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.074737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae21bc-8c8e-43eb-8839-37ab90813f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.075324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae21bc-8c8e-43eb-8839-37ab90813f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.075603 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae21bc-8c8e-43eb-8839-37ab90813f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.075874 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae21bc-8c8e-43eb-8839-37ab90813f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.077184 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae21bc-8c8e-43eb-8839-37ab90813f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.082168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae21bc-8c8e-43eb-8839-37ab90813f29 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.089744 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1372/2734] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:26:59.094515 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae21bc-8c8e-43eb-8839-37ab90813f29 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.098137 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2ce57a1fc74a22988ba0e539e2294a', 'request_id': 'req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:59.101651 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:59.106299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae21bc-8c8e-43eb-8839-37ab90813f29 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.153111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:59.166713 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b42d7-c8a7-4fe8-8bdc-15a4c2f69549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.179694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b42d7-c8a7-4fe8-8bdc-15a4c2f69549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.179694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b42d7-c8a7-4fe8-8bdc-15a4c2f69549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.179694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b42d7-c8a7-4fe8-8bdc-15a4c2f69549 admin admin] PATH_INFO: `/v3/projects/1341c1b5944e4582b7a076551951e58a/users/d82fe70209174e4ba42058165f9663ea/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.179694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b42d7-c8a7-4fe8-8bdc-15a4c2f69549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1341c1b5944e4582b7a076551951e58a, user_id=d82fe70209174e4ba42058165f9663ea, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.179694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b42d7-c8a7-4fe8-8bdc-15a4c2f69549 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.183912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1373/2735] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:59 2022] PUT /identity/v3/projects/1341c1b5944e4582b7a076551951e58a/users/d82fe70209174e4ba42058165f9663ea/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:59.195388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1bafa-77f9-4ffa-98a4-81a2c6f48934 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.195676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1bafa-77f9-4ffa-98a4-81a2c6f48934 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.195955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1bafa-77f9-4ffa-98a4-81a2c6f48934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.199805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2ce57a1fc74a22988ba0e539e2294a', 'request_id': 'req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:59.207928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2ce57a1fc74a22988ba0e539e2294a', 'request_id': 'req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:59.219375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] The token cache is being invalidate because project dc2ce57a1fc74a22988ba0e539e2294a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:59.219665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:59.220504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b4fb6c4c-7b34-4b58-beae-4cda9d5f9da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:59.221937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1363/2736] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:58 2022] DELETE /identity/v3/projects/dc2ce57a1fc74a22988ba0e539e2294a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:59.227495 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c73a6c-2c95-4a61-be2f-61930f56b0eb None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.227758 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-4ca1bafa-77f9-4ffa-98a4-81a2c6f48934 None None] MFA Rules not processed for user `d82fe70209174e4ba42058165f9663ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:59.228151 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c73a6c-2c95-4a61-be2f-61930f56b0eb None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.228699 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c73a6c-2c95-4a61-be2f-61930f56b0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.229047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4ca1bafa-77f9-4ffa-98a4-81a2c6f48934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:59.248765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e4c73a6c-2c95-4a61-be2f-61930f56b0eb None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:59.250070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e4c73a6c-2c95-4a61-be2f-61930f56b0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:59.305912 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1374/2737] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:59.314517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1364/2738] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:59.317498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1bafa-77f9-4ffa-98a4-81a2c6f48934 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.318990 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4ca1bafa-77f9-4ffa-98a4-81a2c6f48934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:59.322115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264325ff-0391-48bb-8186-362a6d9f49d7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.322406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264325ff-0391-48bb-8186-362a6d9f49d7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.322679 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264325ff-0391-48bb-8186-362a6d9f49d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.343592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-264325ff-0391-48bb-8186-362a6d9f49d7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:59.344831 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-264325ff-0391-48bb-8186-362a6d9f49d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:59.353790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1365/2739] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:26:59.360828 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264325ff-0391-48bb-8186-362a6d9f49d7 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.371238 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264325ff-0391-48bb-8186-362a6d9f49d7 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.376370 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9178c-73b6-4417-a669-ca62191c9d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.376975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9178c-73b6-4417-a669-ca62191c9d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.377506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9178c-73b6-4417-a669-ca62191c9d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.378022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9178c-73b6-4417-a669-ca62191c9d12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.378461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9178c-73b6-4417-a669-ca62191c9d12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:26:59.378747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9178c-73b6-4417-a669-ca62191c9d12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.380305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1bafa-77f9-4ffa-98a4-81a2c6f48934 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.380799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9178c-73b6-4417-a669-ca62191c9d12 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.384139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54f96e-93b0-43c0-8966-1242791f293b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.384775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54f96e-93b0-43c0-8966-1242791f293b service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.385054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54f96e-93b0-43c0-8966-1242791f293b service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.385326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54f96e-93b0-43c0-8966-1242791f293b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.393082 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1366/2740] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:26:59.395645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54f96e-93b0-43c0-8966-1242791f293b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.397111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54f96e-93b0-43c0-8966-1242791f293b service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.397758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9178c-73b6-4417-a669-ca62191c9d12 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.407660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1375/2741] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:59.408514 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9178c-73b6-4417-a669-ca62191c9d12 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.413534 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa9eb0-bf0e-4a4a-bfa2-5165b4e9c315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.414136 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9eb0-bf0e-4a4a-bfa2-5165b4e9c315 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.414419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9eb0-bf0e-4a4a-bfa2-5165b4e9c315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.414692 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa9eb0-bf0e-4a4a-bfa2-5165b4e9c315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.415323 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa9eb0-bf0e-4a4a-bfa2-5165b4e9c315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.417284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa9eb0-bf0e-4a4a-bfa2-5165b4e9c315 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.601819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1367/2742] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:26:59 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:26:59.606411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54f96e-93b0-43c0-8966-1242791f293b service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.617808 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54f96e-93b0-43c0-8966-1242791f293b service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.676403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085d80d-4144-4232-8714-b7c7078a89b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.677018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d80d-4144-4232-8714-b7c7078a89b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.677296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d80d-4144-4232-8714-b7c7078a89b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.677640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085d80d-4144-4232-8714-b7c7078a89b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.678333 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085d80d-4144-4232-8714-b7c7078a89b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.680401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085d80d-4144-4232-8714-b7c7078a89b1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.686117 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:59.724668 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa9eb0-bf0e-4a4a-bfa2-5165b4e9c315 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.784337 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa9eb0-bf0e-4a4a-bfa2-5165b4e9c315 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.788109 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c2c9c-caf6-4cf0-bb48-3a640d2fe83a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.788773 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c2c9c-caf6-4cf0-bb48-3a640d2fe83a service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.789053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c2c9c-caf6-4cf0-bb48-3a640d2fe83a service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.789356 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c2c9c-caf6-4cf0-bb48-3a640d2fe83a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.791185 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b74c2c9c-caf6-4cf0-bb48-3a640d2fe83a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:59.801197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1376/2743] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:26:59 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:26:59.811100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085d80d-4144-4232-8714-b7c7078a89b1 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.824317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085d80d-4144-4232-8714-b7c7078a89b1 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.830818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c33cb1-abf9-4735-9455-3e70475e4a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.831522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c33cb1-abf9-4735-9455-3e70475e4a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.831795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c33cb1-abf9-4735-9455-3e70475e4a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.832075 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c33cb1-abf9-4735-9455-3e70475e4a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.832762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c33cb1-abf9-4735-9455-3e70475e4a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.833491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:59.834408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c33cb1-abf9-4735-9455-3e70475e4a15 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.849408 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1377/2744] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:26:59.849810 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c33cb1-abf9-4735-9455-3e70475e4a15 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.861623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c33cb1-abf9-4735-9455-3e70475e4a15 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.866640 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bcf4c-a604-47cf-b105-4a7b358929a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.867255 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bcf4c-a604-47cf-b105-4a7b358929a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.867538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bcf4c-a604-47cf-b105-4a7b358929a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.867814 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bcf4c-a604-47cf-b105-4a7b358929a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.868497 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bcf4c-a604-47cf-b105-4a7b358929a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.870096 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bcf4c-a604-47cf-b105-4a7b358929a2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.872677 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c2c9c-caf6-4cf0-bb48-3a640d2fe83a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.875031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c2c9c-caf6-4cf0-bb48-3a640d2fe83a service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:59.882651 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1378/2745] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:26:59.884832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1368/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:26:59.887909 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bcf4c-a604-47cf-b105-4a7b358929a2 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:59.898311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bcf4c-a604-47cf-b105-4a7b358929a2 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:59.903440 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863725f-ba5c-4145-86e3-23d4f9dbce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:59.904222 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863725f-ba5c-4145-86e3-23d4f9dbce40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:59.904523 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863725f-ba5c-4145-86e3-23d4f9dbce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:59.904791 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863725f-ba5c-4145-86e3-23d4f9dbce40 admin admin] PATH_INFO: `/v3/projects/402359a6c7454acfb4c3458e90026e08/users/1ff5fa7997ed4b6285a6bb30cd6cd196/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:59.920699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863725f-ba5c-4145-86e3-23d4f9dbce40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402359a6c7454acfb4c3458e90026e08, user_id=1ff5fa7997ed4b6285a6bb30cd6cd196, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:59.923309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863725f-ba5c-4145-86e3-23d4f9dbce40 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:00.071099 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1379/2747] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:26:59 2022] PUT /identity/v3/projects/402359a6c7454acfb4c3458e90026e08/users/1ff5fa7997ed4b6285a6bb30cd6cd196/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:00.081834 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6693-fba0-433a-87f7-4f22ea00e5d3 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:00.082051 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6693-fba0-433a-87f7-4f22ea00e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:00.082359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6693-fba0-433a-87f7-4f22ea00e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:00.110471 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-89ac6693-fba0-433a-87f7-4f22ea00e5d3 None None] MFA Rules not processed for user `1ff5fa7997ed4b6285a6bb30cd6cd196`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:00.111775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-89ac6693-fba0-433a-87f7-4f22ea00e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:00.182227 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1369/2748] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:00.187644 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863725f-ba5c-4145-86e3-23d4f9dbce40 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:00.218055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:00.254838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863725f-ba5c-4145-86e3-23d4f9dbce40 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:00.259628 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca604-0808-430a-9eba-c6450cf8be66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:00.260279 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca604-0808-430a-9eba-c6450cf8be66 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:00.260559 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca604-0808-430a-9eba-c6450cf8be66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:00.263682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dca604-0808-430a-9eba-c6450cf8be66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:00.263682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dca604-0808-430a-9eba-c6450cf8be66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:00.263682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dca604-0808-430a-9eba-c6450cf8be66 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:00.367125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1380/2749] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:00 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:27:00.368393 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6693-fba0-433a-87f7-4f22ea00e5d3 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:00.379664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6693-fba0-433a-87f7-4f22ea00e5d3 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:00.440040 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb7977-f0ea-4474-bd74-cdaac238a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:00.440999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb7977-f0ea-4474-bd74-cdaac238a602 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:00.441434 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb7977-f0ea-4474-bd74-cdaac238a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:00.441796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb7977-f0ea-4474-bd74-cdaac238a602 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:00.442483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb7977-f0ea-4474-bd74-cdaac238a602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:00.444836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb7977-f0ea-4474-bd74-cdaac238a602 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:00.551106 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1370/2750] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:00 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:00.555350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca604-0808-430a-9eba-c6450cf8be66 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:00.567042 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dca604-0808-430a-9eba-c6450cf8be66 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:00.572986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64974c69-3d01-430a-9cf0-6c60f87b525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:00.573601 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64974c69-3d01-430a-9cf0-6c60f87b525b admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:00.573883 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64974c69-3d01-430a-9cf0-6c60f87b525b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:00.574156 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64974c69-3d01-430a-9cf0-6c60f87b525b admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:00.574944 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64974c69-3d01-430a-9cf0-6c60f87b525b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:00.577634 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64974c69-3d01-430a-9cf0-6c60f87b525b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:00.588971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1381/2751] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:00.594477 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb7977-f0ea-4474-bd74-cdaac238a602 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:00.604984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb7977-f0ea-4474-bd74-cdaac238a602 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:00.610747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59cff5-1d4b-4b12-8729-8c3a13a16afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:00.611418 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59cff5-1d4b-4b12-8729-8c3a13a16afd admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:00.611696 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59cff5-1d4b-4b12-8729-8c3a13a16afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:00.611965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59cff5-1d4b-4b12-8729-8c3a13a16afd admin admin] PATH_INFO: `/v3/projects/eefe4e40181d45e1af8637d169555d89/users/46acc37b4ffa40dd95903befb9edf641/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:00.628365 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59cff5-1d4b-4b12-8729-8c3a13a16afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefe4e40181d45e1af8637d169555d89, user_id=46acc37b4ffa40dd95903befb9edf641, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:00.630994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59cff5-1d4b-4b12-8729-8c3a13a16afd admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:00.714779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1371/2752] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:00 2022] PUT /identity/v3/projects/eefe4e40181d45e1af8637d169555d89/users/46acc37b4ffa40dd95903befb9edf641/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:00.720330 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64974c69-3d01-430a-9cf0-6c60f87b525b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:00.730778 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64974c69-3d01-430a-9cf0-6c60f87b525b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:00.793678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48664078-a04a-4b80-a20e-77ced2923a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:00.794297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48664078-a04a-4b80-a20e-77ced2923a9e admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:00.794582 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48664078-a04a-4b80-a20e-77ced2923a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:00.794901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48664078-a04a-4b80-a20e-77ced2923a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:00.795547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48664078-a04a-4b80-a20e-77ced2923a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:00.797168 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48664078-a04a-4b80-a20e-77ced2923a9e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:00.808154 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1382/2753] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:00.814017 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59cff5-1d4b-4b12-8729-8c3a13a16afd admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:00.829547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59cff5-1d4b-4b12-8729-8c3a13a16afd admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:00.839766 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836045bc-d8ca-4e5d-a3a9-282775e5d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:00.840465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836045bc-d8ca-4e5d-a3a9-282775e5d1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:00.840465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836045bc-d8ca-4e5d-a3a9-282775e5d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:00.840665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836045bc-d8ca-4e5d-a3a9-282775e5d1f9 admin admin] PATH_INFO: `/v3/projects/eefe4e40181d45e1af8637d169555d89/users/46acc37b4ffa40dd95903befb9edf641/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:00.843816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836045bc-d8ca-4e5d-a3a9-282775e5d1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eefe4e40181d45e1af8637d169555d89, user_id=46acc37b4ffa40dd95903befb9edf641, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:00.847751 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836045bc-d8ca-4e5d-a3a9-282775e5d1f9 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:00.861207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1372/2754] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:00 2022] PUT /identity/v3/projects/eefe4e40181d45e1af8637d169555d89/users/46acc37b4ffa40dd95903befb9edf641/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:00.874805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c462-49a5-4528-8d98-18145812fab0 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:00.875087 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c462-49a5-4528-8d98-18145812fab0 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:00.875427 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c462-49a5-4528-8d98-18145812fab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:00.918254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-1f13c462-49a5-4528-8d98-18145812fab0 None None] MFA Rules not processed for user `46acc37b4ffa40dd95903befb9edf641`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:00.919470 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1f13c462-49a5-4528-8d98-18145812fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:01.001232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1383/2755] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:01.016125 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836045bc-d8ca-4e5d-a3a9-282775e5d1f9 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:01.034791 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:01.074991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836045bc-d8ca-4e5d-a3a9-282775e5d1f9 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:01.080497 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7a382-d56c-4303-b818-bd5f22bda2a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:01.081112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7a382-d56c-4303-b818-bd5f22bda2a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:01.081390 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7a382-d56c-4303-b818-bd5f22bda2a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:01.081660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7a382-d56c-4303-b818-bd5f22bda2a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:01.141378 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7a382-d56c-4303-b818-bd5f22bda2a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:01.142805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7a382-d56c-4303-b818-bd5f22bda2a7 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:01.152178 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1373/2756] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:03.741658 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c462-49a5-4528-8d98-18145812fab0 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:03.743452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1f13c462-49a5-4528-8d98-18145812fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:03.773605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:03.815525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c462-49a5-4528-8d98-18145812fab0 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:03.820432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:03.821113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:03.821460 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:03.821678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] PATH_INFO: `/v3/users/346664ed01a948d6be6a34b6d6c78b5a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:03.823347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=346664ed01a948d6be6a34b6d6c78b5a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:03.825831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:04.019838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346664ed01a948d6be6a34b6d6c78b5a'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:04.020581 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346664ed01a948d6be6a34b6d6c78b5a'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:04.027763 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346664ed01a948d6be6a34b6d6c78b5a'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:04.028433 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346664ed01a948d6be6a34b6d6c78b5a'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:04.040400 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346664ed01a948d6be6a34b6d6c78b5a'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:04.189028 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1384/2757] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:03 2022] DELETE /identity/v3/users/346664ed01a948d6be6a34b6d6c78b5a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:04.193501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd1f39-36bd-4e40-9a48-b095f43269d6 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:04.193987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd1f39-36bd-4e40-9a48-b095f43269d6 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:04.194102 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd1f39-36bd-4e40-9a48-b095f43269d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:04.213882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-52fd1f39-36bd-4e40-9a48-b095f43269d6 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:04.215121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-52fd1f39-36bd-4e40-9a48-b095f43269d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:04.273885 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1374/2758] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:04.284048 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:04.285530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:04.346267 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787d409-ae8c-4d80-9627-4bcbb3b97cd2 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:04.350040 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3091630-671d-43af-bfe9-c1b976a33a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:04.350647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3091630-671d-43af-bfe9-c1b976a33a68 service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:04.350927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3091630-671d-43af-bfe9-c1b976a33a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:04.351199 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3091630-671d-43af-bfe9-c1b976a33a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:04.361328 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3091630-671d-43af-bfe9-c1b976a33a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:04.362769 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3091630-671d-43af-bfe9-c1b976a33a68 service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:04.372392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1385/2759] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:04.606556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd1f39-36bd-4e40-9a48-b095f43269d6 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:04.609096 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-52fd1f39-36bd-4e40-9a48-b095f43269d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:04.672968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd1f39-36bd-4e40-9a48-b095f43269d6 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:04.676803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57d054-208f-4621-88fb-3925d029d175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:04.677420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57d054-208f-4621-88fb-3925d029d175 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:04.677721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57d054-208f-4621-88fb-3925d029d175 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:04.677986 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b57d054-208f-4621-88fb-3925d029d175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:04.679722 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1b57d054-208f-4621-88fb-3925d029d175 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:04.708034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:04.750632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57d054-208f-4621-88fb-3925d029d175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:04.752568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b57d054-208f-4621-88fb-3925d029d175 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:04.762613 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1375/2760] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:04.872676 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3091630-671d-43af-bfe9-c1b976a33a68 service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:04.874475 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a3091630-671d-43af-bfe9-c1b976a33a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:04.897864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3091630-671d-43af-bfe9-c1b976a33a68 service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:04.905510 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:04.906095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:04.906376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:04.906647 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] PATH_INFO: `/v3/projects/3721d3c5fba9400896c65e2d9baa5806` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:04.907929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3721d3c5fba9400896c65e2d9baa5806)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:04.909911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:05.068281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:05.075629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3721d3c5fba9400896c65e2d9baa5806', 'request_id': 'req-e5141e4b-a88a-4d13-a21a-5eac52373718'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:05.142356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3721d3c5fba9400896c65e2d9baa5806', 'request_id': 'req-e5141e4b-a88a-4d13-a21a-5eac52373718'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:05.155422 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3721d3c5fba9400896c65e2d9baa5806', 'request_id': 'req-e5141e4b-a88a-4d13-a21a-5eac52373718'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:05.165204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] The token cache is being invalidate because project 3721d3c5fba9400896c65e2d9baa5806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:05.165204 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:05.166297 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-e5141e4b-a88a-4d13-a21a-5eac52373718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:05.180259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1386/2761] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:04 2022] DELETE /identity/v3/projects/3721d3c5fba9400896c65e2d9baa5806 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:14.833229 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=18 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:15.524263 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:18.335938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57d054-208f-4621-88fb-3925d029d175 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:18.337558 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1b57d054-208f-4621-88fb-3925d029d175 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:18.351557 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b57d054-208f-4621-88fb-3925d029d175 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:18.410050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:18.410747 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:18.411029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:18.411302 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] PATH_INFO: `/v3/users/23e8bfffa4534039bd3dc5a0a879d932` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:18.412444 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e8bfffa4534039bd3dc5a0a879d932)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:18.414340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:18.629822 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e8bfffa4534039bd3dc5a0a879d932'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:18.630480 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e8bfffa4534039bd3dc5a0a879d932'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:18.631085 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e8bfffa4534039bd3dc5a0a879d932'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:18.644574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e8bfffa4534039bd3dc5a0a879d932'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:18.690537 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e8bfffa4534039bd3dc5a0a879d932'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:18.703662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1376/2762] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:18 2022] DELETE /identity/v3/users/23e8bfffa4534039bd3dc5a0a879d932 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:18.708366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5524-ca79-40d9-88e4-d4564b1237f9 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:18.708853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5524-ca79-40d9-88e4-d4564b1237f9 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:18.709166 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde5524-ca79-40d9-88e4-d4564b1237f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:18.729911 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-2cde5524-ca79-40d9-88e4-d4564b1237f9 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:18.731160 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2cde5524-ca79-40d9-88e4-d4564b1237f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:18.794845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1387/2763] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:18.804783 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:18.806199 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:18.865315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2c80e-f8b3-4447-954f-38e4b3b4c0cc admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:18.868998 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1629c-580c-4a5b-972e-e3b7d0d22430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:18.869609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1629c-580c-4a5b-972e-e3b7d0d22430 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:18.869890 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1629c-580c-4a5b-972e-e3b7d0d22430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:18.870162 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1629c-580c-4a5b-972e-e3b7d0d22430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:18.881226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1629c-580c-4a5b-972e-e3b7d0d22430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:18.886323 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1629c-580c-4a5b-972e-e3b7d0d22430 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:18.892991 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1377/2764] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:19.356400 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde5524-ca79-40d9-88e4-d4564b1237f9 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:19.358257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2cde5524-ca79-40d9-88e4-d4564b1237f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:19.375790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde5524-ca79-40d9-88e4-d4564b1237f9 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:19.378362 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:19.379000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:19.379273 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:19.379612 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] PATH_INFO: `/v3/projects/d64b5d87d13f495fb09e3abefa569ded` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:19.380889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64b5d87d13f495fb09e3abefa569ded)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:19.382782 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:19.498957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64b5d87d13f495fb09e3abefa569ded', 'request_id': 'req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:19.547261 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64b5d87d13f495fb09e3abefa569ded', 'request_id': 'req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:19.554932 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64b5d87d13f495fb09e3abefa569ded', 'request_id': 'req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:19.565494 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] The token cache is being invalidate because project d64b5d87d13f495fb09e3abefa569ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:19.566595 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:19.567253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:19.568839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1388/2765] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:19 2022] DELETE /identity/v3/projects/d64b5d87d13f495fb09e3abefa569ded => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:19.573041 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1629c-580c-4a5b-972e-e3b7d0d22430 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:19.583331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1629c-580c-4a5b-972e-e3b7d0d22430 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:19.601968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:19.639207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540a4e5-be4a-4ff5-b534-11e996586ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:19.639760 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a4e5-be4a-4ff5-b534-11e996586ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:19.640038 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a4e5-be4a-4ff5-b534-11e996586ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:19.640347 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a4e5-be4a-4ff5-b534-11e996586ef1 admin admin] PATH_INFO: `/v3/users/d82fe70209174e4ba42058165f9663ea` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:19.641466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540a4e5-be4a-4ff5-b534-11e996586ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d82fe70209174e4ba42058165f9663ea)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:19.643369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540a4e5-be4a-4ff5-b534-11e996586ef1 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:19.829745 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f540a4e5-be4a-4ff5-b534-11e996586ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd82fe70209174e4ba42058165f9663ea'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:19.830401 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f540a4e5-be4a-4ff5-b534-11e996586ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd82fe70209174e4ba42058165f9663ea'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:19.831013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f540a4e5-be4a-4ff5-b534-11e996586ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd82fe70209174e4ba42058165f9663ea'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:19.843424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f540a4e5-be4a-4ff5-b534-11e996586ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd82fe70209174e4ba42058165f9663ea'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:19.913389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-f540a4e5-be4a-4ff5-b534-11e996586ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd82fe70209174e4ba42058165f9663ea'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:19.926234 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1378/2766] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:19 2022] DELETE /identity/v3/users/d82fe70209174e4ba42058165f9663ea => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:20.006976 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:20.008489 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:20.021891 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a322aaf-e9d3-4c7f-ba41-5ae3b2169dbc admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:20.081682 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:20.082955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:20.083307 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:20.083617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] PATH_INFO: `/v3/users/1ff5fa7997ed4b6285a6bb30cd6cd196` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:20.084873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff5fa7997ed4b6285a6bb30cd6cd196)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:20.086951 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:20.166736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:20.283000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff5fa7997ed4b6285a6bb30cd6cd196'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:20.283720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff5fa7997ed4b6285a6bb30cd6cd196'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:20.297604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff5fa7997ed4b6285a6bb30cd6cd196'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:20.297604 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff5fa7997ed4b6285a6bb30cd6cd196'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:20.309031 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff5fa7997ed4b6285a6bb30cd6cd196'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:20.393387 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1389/2767] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:20 2022] DELETE /identity/v3/users/1ff5fa7997ed4b6285a6bb30cd6cd196 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:20.397964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4aa9-695c-49f9-827e-31bc77f6ca4a None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:20.398250 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4aa9-695c-49f9-827e-31bc77f6ca4a None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:20.398522 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4aa9-695c-49f9-827e-31bc77f6ca4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:20.417455 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-588b4aa9-695c-49f9-827e-31bc77f6ca4a None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:20.418622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-588b4aa9-695c-49f9-827e-31bc77f6ca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:20.429966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:20.431538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:20.488159 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1379/2768] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:27:20.498466 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b4aa9-695c-49f9-827e-31bc77f6ca4a None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:20.499853 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-588b4aa9-695c-49f9-827e-31bc77f6ca4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:20.512598 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc71346-0f8a-4864-9616-87dd761864c3 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:20.517374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:20.518010 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:20.518291 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:20.518557 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] PATH_INFO: `/v3/projects/1341c1b5944e4582b7a076551951e58a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:20.519701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1341c1b5944e4582b7a076551951e58a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:20.522148 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:20.554873 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:20.566210 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b4aa9-695c-49f9-827e-31bc77f6ca4a None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:20.570419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed91ac5-10b0-45fe-8f0a-c9707b6b5d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:20.571019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91ac5-10b0-45fe-8f0a-c9707b6b5d99 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:20.571294 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91ac5-10b0-45fe-8f0a-c9707b6b5d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:20.571561 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91ac5-10b0-45fe-8f0a-c9707b6b5d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:20.581031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed91ac5-10b0-45fe-8f0a-c9707b6b5d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:20.582785 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed91ac5-10b0-45fe-8f0a-c9707b6b5d99 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:20.593525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1380/2769] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:20.709306 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1341c1b5944e4582b7a076551951e58a', 'request_id': 'req-8376b92d-a7ae-48aa-96b7-618593a90841'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:20.754206 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1341c1b5944e4582b7a076551951e58a', 'request_id': 'req-8376b92d-a7ae-48aa-96b7-618593a90841'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:20.761355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1341c1b5944e4582b7a076551951e58a', 'request_id': 'req-8376b92d-a7ae-48aa-96b7-618593a90841'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:20.774018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] The token cache is being invalidate because project 1341c1b5944e4582b7a076551951e58a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:20.774384 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:20.775090 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-8376b92d-a7ae-48aa-96b7-618593a90841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:20.776684 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1390/2770] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:20 2022] DELETE /identity/v3/projects/1341c1b5944e4582b7a076551951e58a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:20.782267 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38705e51-8161-485e-9e16-7efecfdfb40a None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:20.782609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38705e51-8161-485e-9e16-7efecfdfb40a None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:20.782886 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38705e51-8161-485e-9e16-7efecfdfb40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:20.805546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-38705e51-8161-485e-9e16-7efecfdfb40a None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:20.806821 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-38705e51-8161-485e-9e16-7efecfdfb40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:20.872100 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1381/2771] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:20.883429 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eb6ec-76eb-4003-9a86-f43161bb7f96 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:20.883707 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eb6ec-76eb-4003-9a86-f43161bb7f96 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:20.883980 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0eb6ec-76eb-4003-9a86-f43161bb7f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:20.908773 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-4b0eb6ec-76eb-4003-9a86-f43161bb7f96 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:20.910018 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4b0eb6ec-76eb-4003-9a86-f43161bb7f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:20.919055 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1391/2772] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:20.923519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38705e51-8161-485e-9e16-7efecfdfb40a None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:20.934985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38705e51-8161-485e-9e16-7efecfdfb40a None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:20.939670 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c0c2b-3d1f-47cd-8cd6-c83eef1a210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:20.940297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c0c2b-3d1f-47cd-8cd6-c83eef1a210c admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:20.940531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c0c2b-3d1f-47cd-8cd6-c83eef1a210c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:20.940805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c0c2b-3d1f-47cd-8cd6-c83eef1a210c admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:20.941452 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c0c2b-3d1f-47cd-8cd6-c83eef1a210c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:20.941800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c0c2b-3d1f-47cd-8cd6-c83eef1a210c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:20.943421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c0c2b-3d1f-47cd-8cd6-c83eef1a210c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:20.955023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1382/2773] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:20.959637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0eb6ec-76eb-4003-9a86-f43161bb7f96 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:20.969271 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0eb6ec-76eb-4003-9a86-f43161bb7f96 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:20.974761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c60dd-5d5f-4265-8c72-86efa35ecf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:20.975367 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c60dd-5d5f-4265-8c72-86efa35ecf4d admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:20.975642 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c60dd-5d5f-4265-8c72-86efa35ecf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:20.975955 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c60dd-5d5f-4265-8c72-86efa35ecf4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:20.979535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c60dd-5d5f-4265-8c72-86efa35ecf4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:20.979535 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c60dd-5d5f-4265-8c72-86efa35ecf4d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:20.981603 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c0c2b-3d1f-47cd-8cd6-c83eef1a210c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:20.985571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-421c0c2b-3d1f-47cd-8cd6-c83eef1a210c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:21.011449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c0c2b-3d1f-47cd-8cd6-c83eef1a210c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:21.014361 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:21.015472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:21.015734 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:21.016005 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] PATH_INFO: `/v3/projects/402359a6c7454acfb4c3458e90026e08` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:21.017177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] RBAC: Authorizing `identity:delete_project(project_id=402359a6c7454acfb4c3458e90026e08)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:21.019109 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:21.074410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1392/2774] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:20 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:27:21.078581 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c60dd-5d5f-4265-8c72-86efa35ecf4d admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:21.084798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:21.138804 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402359a6c7454acfb4c3458e90026e08', 'request_id': 'req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:21.153653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c60dd-5d5f-4265-8c72-86efa35ecf4d admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:21.194042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402359a6c7454acfb4c3458e90026e08', 'request_id': 'req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:21.203988 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402359a6c7454acfb4c3458e90026e08', 'request_id': 'req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:21.216921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] The token cache is being invalidate because project 402359a6c7454acfb4c3458e90026e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:21.217217 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:21.217905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:21.219458 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1383/2775] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:20 2022] DELETE /identity/v3/projects/402359a6c7454acfb4c3458e90026e08 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:21.234472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:21.235919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:21.315419 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:21.323754 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bccd8-9247-4b59-93b1-c17c1bd1762e admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:21.329004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6a0b3-bae4-46a5-9cb6-f46b0eaf577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:21.329449 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a0b3-bae4-46a5-9cb6-f46b0eaf577c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:21.329730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a0b3-bae4-46a5-9cb6-f46b0eaf577c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:21.330010 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6a0b3-bae4-46a5-9cb6-f46b0eaf577c admin admin] PATH_INFO: `/v3/users/46acc37b4ffa40dd95903befb9edf641` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:21.331226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6a0b3-bae4-46a5-9cb6-f46b0eaf577c admin admin] RBAC: Authorizing `identity:delete_user(user_id=46acc37b4ffa40dd95903befb9edf641)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:21.334004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6a0b3-bae4-46a5-9cb6-f46b0eaf577c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:21.342116 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b17da-578c-4bac-aa07-51552801ac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:21.342865 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b17da-578c-4bac-aa07-51552801ac76 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:21.343502 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b17da-578c-4bac-aa07-51552801ac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:21.343880 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b17da-578c-4bac-aa07-51552801ac76 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:21.344632 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b17da-578c-4bac-aa07-51552801ac76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:21.346995 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b17da-578c-4bac-aa07-51552801ac76 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:21.434295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1393/2776] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:21 2022] POST /identity/v3/users => generated 291 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:27:21.438439 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b17da-578c-4bac-aa07-51552801ac76 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:21.440011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-4d8b17da-578c-4bac-aa07-51552801ac76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:21.454673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b17da-578c-4bac-aa07-51552801ac76 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:21.457997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd928ba-209f-4edd-8757-bbf26f188abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:21.458596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd928ba-209f-4edd-8757-bbf26f188abb admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:21.458900 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd928ba-209f-4edd-8757-bbf26f188abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:21.459170 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd928ba-209f-4edd-8757-bbf26f188abb admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:21.459805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd928ba-209f-4edd-8757-bbf26f188abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:21.461584 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd928ba-209f-4edd-8757-bbf26f188abb admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:21.472420 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1394/2777] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:27:21.476550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd928ba-209f-4edd-8757-bbf26f188abb admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:21.486336 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd928ba-209f-4edd-8757-bbf26f188abb admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:21.491172 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437d14b-a5de-4cda-94bb-60efa189bc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:21.491762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437d14b-a5de-4cda-94bb-60efa189bc1b admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:21.492086 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437d14b-a5de-4cda-94bb-60efa189bc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:21.492411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437d14b-a5de-4cda-94bb-60efa189bc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:21.493068 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437d14b-a5de-4cda-94bb-60efa189bc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:21.494625 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437d14b-a5de-4cda-94bb-60efa189bc1b admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:21.505338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1395/2778] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:27:21.509343 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437d14b-a5de-4cda-94bb-60efa189bc1b admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:21.518847 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437d14b-a5de-4cda-94bb-60efa189bc1b admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:21.523475 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5ba6a0b3-bae4-46a5-9cb6-f46b0eaf577c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46acc37b4ffa40dd95903befb9edf641'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:21.524281 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5ba6a0b3-bae4-46a5-9cb6-f46b0eaf577c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46acc37b4ffa40dd95903befb9edf641'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:21.524405 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afb82a-960c-4030-844c-c96f772d2fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:21.524917 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5ba6a0b3-bae4-46a5-9cb6-f46b0eaf577c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46acc37b4ffa40dd95903befb9edf641'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:21.525035 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afb82a-960c-4030-844c-c96f772d2fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:21.525197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afb82a-960c-4030-844c-c96f772d2fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:21.525467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afb82a-960c-4030-844c-c96f772d2fa1 admin admin] PATH_INFO: `/v3/projects/4e9e4ad0700f4d498411ee1fc419c1cc/users/294c35bac3f2485d83b145134c2898fa/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:21.538833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5ba6a0b3-bae4-46a5-9cb6-f46b0eaf577c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46acc37b4ffa40dd95903befb9edf641'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:21.540826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afb82a-960c-4030-844c-c96f772d2fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9e4ad0700f4d498411ee1fc419c1cc, user_id=294c35bac3f2485d83b145134c2898fa, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:21.543898 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afb82a-960c-4030-844c-c96f772d2fa1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:21.656034 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5ba6a0b3-bae4-46a5-9cb6-f46b0eaf577c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46acc37b4ffa40dd95903befb9edf641'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:21.671919 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1384/2779] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:21 2022] DELETE /identity/v3/users/46acc37b4ffa40dd95903befb9edf641 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:21.692650 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1396/2780] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:21 2022] PUT /identity/v3/projects/4e9e4ad0700f4d498411ee1fc419c1cc/users/294c35bac3f2485d83b145134c2898fa/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:21.704318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4401de-8538-4d20-a1c4-d639e282aeb2 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:21.709117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4401de-8538-4d20-a1c4-d639e282aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:21.709117 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4401de-8538-4d20-a1c4-d639e282aeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:21.736568 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-7c4401de-8538-4d20-a1c4-d639e282aeb2 None None] MFA Rules not processed for user `294c35bac3f2485d83b145134c2898fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:21.737824 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7c4401de-8538-4d20-a1c4-d639e282aeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:21.807241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1385/2781] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:21.811927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afb82a-960c-4030-844c-c96f772d2fa1 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:21.813700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a0afb82a-960c-4030-844c-c96f772d2fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:21.880477 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:21.886706 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afb82a-960c-4030-844c-c96f772d2fa1 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:21.892950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc0a90-458e-4a73-a851-2de844623c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:21.892950 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0a90-458e-4a73-a851-2de844623c60 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:21.895153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0a90-458e-4a73-a851-2de844623c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:21.895153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc0a90-458e-4a73-a851-2de844623c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:21.895153 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc0a90-458e-4a73-a851-2de844623c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:21.896621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc0a90-458e-4a73-a851-2de844623c60 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.008341 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1397/2782] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:21 2022] POST /identity/v3/projects => generated 381 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:22.013078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4401de-8538-4d20-a1c4-d639e282aeb2 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.024276 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4401de-8538-4d20-a1c4-d639e282aeb2 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.077854 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc0a90-458e-4a73-a851-2de844623c60 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.079793 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-53bc0a90-458e-4a73-a851-2de844623c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:22.086758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d7f59-8ae3-47b5-bf49-d7eddac87486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.087431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7f59-8ae3-47b5-bf49-d7eddac87486 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.087928 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7f59-8ae3-47b5-bf49-d7eddac87486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.088029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d7f59-8ae3-47b5-bf49-d7eddac87486 admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.088717 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d7f59-8ae3-47b5-bf49-d7eddac87486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.090770 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4d7f59-8ae3-47b5-bf49-d7eddac87486 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.102802 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:22.149296 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc0a90-458e-4a73-a851-2de844623c60 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.154067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.154689 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.154960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.155227 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] PATH_INFO: `/v3/projects/eefe4e40181d45e1af8637d169555d89` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.156410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eefe4e40181d45e1af8637d169555d89)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.158381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.221732 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1386/2783] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:22 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:27:22.226262 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d7f59-8ae3-47b5-bf49-d7eddac87486 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.236657 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d7f59-8ae3-47b5-bf49-d7eddac87486 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.242047 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c798c4a-2388-41b3-9685-a813e89209f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.242685 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c798c4a-2388-41b3-9685-a813e89209f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.243009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c798c4a-2388-41b3-9685-a813e89209f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.243280 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c798c4a-2388-41b3-9685-a813e89209f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.243918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c798c4a-2388-41b3-9685-a813e89209f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.245559 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c798c4a-2388-41b3-9685-a813e89209f0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.256295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1387/2784] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:22.263204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c798c4a-2388-41b3-9685-a813e89209f0 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.272762 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c798c4a-2388-41b3-9685-a813e89209f0 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.277544 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5fcf1-99c4-47d4-a7f8-da4788736f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.278224 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5fcf1-99c4-47d4-a7f8-da4788736f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.278516 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5fcf1-99c4-47d4-a7f8-da4788736f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.278790 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5fcf1-99c4-47d4-a7f8-da4788736f86 admin admin] PATH_INFO: `/v3/projects/5ca6a99aa7a3439ca95e12218a0150db/users/e7cc13daad4542258dd38b3866fd81b7/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.297009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5fcf1-99c4-47d4-a7f8-da4788736f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca6a99aa7a3439ca95e12218a0150db, user_id=e7cc13daad4542258dd38b3866fd81b7, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.299673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5fcf1-99c4-47d4-a7f8-da4788736f86 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.304030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eefe4e40181d45e1af8637d169555d89', 'request_id': 'req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:22.372253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1388/2785] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:22 2022] PUT /identity/v3/projects/5ca6a99aa7a3439ca95e12218a0150db/users/e7cc13daad4542258dd38b3866fd81b7/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:22.376739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5fcf1-99c4-47d4-a7f8-da4788736f86 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.393714 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eefe4e40181d45e1af8637d169555d89', 'request_id': 'req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:22.401200 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eefe4e40181d45e1af8637d169555d89', 'request_id': 'req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:22.413027 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] The token cache is being invalidate because project eefe4e40181d45e1af8637d169555d89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:22.413319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:22.414015 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-c65a4ae5-a269-4d6d-9947-08c0cc0f4764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:22.415606 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1398/2786] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:22 2022] DELETE /identity/v3/projects/eefe4e40181d45e1af8637d169555d89 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:22.420354 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e2df1-98e3-4e58-afe9-082c2182f588 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.420641 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e2df1-98e3-4e58-afe9-082c2182f588 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.420920 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e2df1-98e3-4e58-afe9-082c2182f588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.442009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-377e2df1-98e3-4e58-afe9-082c2182f588 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:22.443301 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-377e2df1-98e3-4e58-afe9-082c2182f588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:22.444937 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5fcf1-99c4-47d4-a7f8-da4788736f86 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.449737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff50a71-f99d-486f-975a-c28270a9f919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.450350 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff50a71-f99d-486f-975a-c28270a9f919 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.450632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff50a71-f99d-486f-975a-c28270a9f919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.450912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff50a71-f99d-486f-975a-c28270a9f919 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.451556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff50a71-f99d-486f-975a-c28270a9f919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.453190 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff50a71-f99d-486f-975a-c28270a9f919 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.454979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1399/2787] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:22.463432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264340b-860b-454f-b2d3-af6116b17f66 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.463720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264340b-860b-454f-b2d3-af6116b17f66 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.463997 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264340b-860b-454f-b2d3-af6116b17f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.464786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1389/2788] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:27:22.468839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff50a71-f99d-486f-975a-c28270a9f919 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.470512 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-aff50a71-f99d-486f-975a-c28270a9f919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:22.483737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff50a71-f99d-486f-975a-c28270a9f919 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.484326 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-7264340b-860b-454f-b2d3-af6116b17f66 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:22.485538 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-7264340b-860b-454f-b2d3-af6116b17f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:22.489289 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea6754-5c4f-432e-8907-38eb5a8d48af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.489973 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea6754-5c4f-432e-8907-38eb5a8d48af admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.490255 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea6754-5c4f-432e-8907-38eb5a8d48af admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.490530 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea6754-5c4f-432e-8907-38eb5a8d48af admin admin] PATH_INFO: `/v3/projects/5ca6a99aa7a3439ca95e12218a0150db/users/e7cc13daad4542258dd38b3866fd81b7/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.492504 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea6754-5c4f-432e-8907-38eb5a8d48af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca6a99aa7a3439ca95e12218a0150db, user_id=e7cc13daad4542258dd38b3866fd81b7, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.494500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1400/2789] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:27:22.495271 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea6754-5c4f-432e-8907-38eb5a8d48af admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.506408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1390/2790] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:22 2022] PUT /identity/v3/projects/5ca6a99aa7a3439ca95e12218a0150db/users/e7cc13daad4542258dd38b3866fd81b7/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:22.507822 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264340b-860b-454f-b2d3-af6116b17f66 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.516727 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347dd3e-2a1e-4c6a-ac12-79b9cc745415 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.516945 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347dd3e-2a1e-4c6a-ac12-79b9cc745415 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.517326 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347dd3e-2a1e-4c6a-ac12-79b9cc745415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.517703 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264340b-860b-454f-b2d3-af6116b17f66 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.546277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5347dd3e-2a1e-4c6a-ac12-79b9cc745415 None None] MFA Rules not processed for user `e7cc13daad4542258dd38b3866fd81b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:22.547502 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5347dd3e-2a1e-4c6a-ac12-79b9cc745415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:22.570415 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:22.576767 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbada904-1ce5-459f-b2b7-c5db9e784ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.577458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbada904-1ce5-459f-b2b7-c5db9e784ceb admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.577818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbada904-1ce5-459f-b2b7-c5db9e784ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.596694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbada904-1ce5-459f-b2b7-c5db9e784ceb admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.596694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbada904-1ce5-459f-b2b7-c5db9e784ceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:22.596694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbada904-1ce5-459f-b2b7-c5db9e784ceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.596694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbada904-1ce5-459f-b2b7-c5db9e784ceb admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.596694 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1401/2791] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:22.600430 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbada904-1ce5-459f-b2b7-c5db9e784ceb admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.610406 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbada904-1ce5-459f-b2b7-c5db9e784ceb admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.616918 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8104d-b615-496b-a14d-9737e71436f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.617530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8104d-b615-496b-a14d-9737e71436f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.618337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8104d-b615-496b-a14d-9737e71436f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.618783 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8104d-b615-496b-a14d-9737e71436f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.619848 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8104d-b615-496b-a14d-9737e71436f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.626838 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1391/2792] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:27:22.627054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8104d-b615-496b-a14d-9737e71436f7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.634987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347dd3e-2a1e-4c6a-ac12-79b9cc745415 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.636501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5347dd3e-2a1e-4c6a-ac12-79b9cc745415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:22.671291 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:22.698441 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347dd3e-2a1e-4c6a-ac12-79b9cc745415 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.702101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ca79-365e-4de8-9fdd-8bc2b34873a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.702702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ca79-365e-4de8-9fdd-8bc2b34873a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.702975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ca79-365e-4de8-9fdd-8bc2b34873a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.703265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336ca79-365e-4de8-9fdd-8bc2b34873a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.713318 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ca79-365e-4de8-9fdd-8bc2b34873a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.714738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336ca79-365e-4de8-9fdd-8bc2b34873a1 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.724833 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1392/2793] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:27:22.739016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1402/2794] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:22 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:22.742905 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ca79-365e-4de8-9fdd-8bc2b34873a1 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.753660 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336ca79-365e-4de8-9fdd-8bc2b34873a1 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.811786 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0368034-3c46-41cc-ab84-2c8d04ee362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.812439 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0368034-3c46-41cc-ab84-2c8d04ee362f admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.813249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0368034-3c46-41cc-ab84-2c8d04ee362f admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.813249 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0368034-3c46-41cc-ab84-2c8d04ee362f admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.813662 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0368034-3c46-41cc-ab84-2c8d04ee362f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.815571 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0368034-3c46-41cc-ab84-2c8d04ee362f admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.898090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1393/2795] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:22 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:27:22.902491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8104d-b615-496b-a14d-9737e71436f7 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.913827 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8104d-b615-496b-a14d-9737e71436f7 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.918708 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd685f22-bb9c-4629-be4a-647c09844401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.919338 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd685f22-bb9c-4629-be4a-647c09844401 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.919605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd685f22-bb9c-4629-be4a-647c09844401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.919882 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd685f22-bb9c-4629-be4a-647c09844401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.920550 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd685f22-bb9c-4629-be4a-647c09844401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.922139 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd685f22-bb9c-4629-be4a-647c09844401 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.935842 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1403/2796] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:27:22.937424 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0368034-3c46-41cc-ab84-2c8d04ee362f admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.948501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0368034-3c46-41cc-ab84-2c8d04ee362f admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.955639 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb550-89d5-4a76-b6dc-b4ff39bffc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.956384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb550-89d5-4a76-b6dc-b4ff39bffc3e admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.956737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb550-89d5-4a76-b6dc-b4ff39bffc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:22.957796 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb550-89d5-4a76-b6dc-b4ff39bffc3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:22.958525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cb550-89d5-4a76-b6dc-b4ff39bffc3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:22.960184 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cb550-89d5-4a76-b6dc-b4ff39bffc3e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:22.971667 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1394/2797] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:22.983485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd685f22-bb9c-4629-be4a-647c09844401 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:22.994158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd685f22-bb9c-4629-be4a-647c09844401 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:22.999083 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652c1b-c9c3-47a6-912f-10316dee3e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:22.999695 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652c1b-c9c3-47a6-912f-10316dee3e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:22.999978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652c1b-c9c3-47a6-912f-10316dee3e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.000284 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63652c1b-c9c3-47a6-912f-10316dee3e2e admin admin] PATH_INFO: `/v3/projects/1cb480119e80409caa9b7f3f46175700/users/69640669a52a448893374096cc67f05e/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.018498 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63652c1b-c9c3-47a6-912f-10316dee3e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb480119e80409caa9b7f3f46175700, user_id=69640669a52a448893374096cc67f05e, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:23.021174 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63652c1b-c9c3-47a6-912f-10316dee3e2e admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:23.119335 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1404/2798] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:22 2022] PUT /identity/v3/projects/1cb480119e80409caa9b7f3f46175700/users/69640669a52a448893374096cc67f05e/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:23.135621 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bd6ea-a603-44db-8e6b-c611efaa2704 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.135985 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bd6ea-a603-44db-8e6b-c611efaa2704 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.136436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bd6ea-a603-44db-8e6b-c611efaa2704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.166907 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-1c3bd6ea-a603-44db-8e6b-c611efaa2704 None None] MFA Rules not processed for user `69640669a52a448893374096cc67f05e`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:23.168138 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-1c3bd6ea-a603-44db-8e6b-c611efaa2704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:23.232863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1395/2799] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:23.237509 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652c1b-c9c3-47a6-912f-10316dee3e2e admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:23.265816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bd6ea-a603-44db-8e6b-c611efaa2704 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:23.308687 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:23.313265 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63652c1b-c9c3-47a6-912f-10316dee3e2e admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:23.318657 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e158c-d3dd-4156-be23-d86c4e4304e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:23.319283 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e158c-d3dd-4156-be23-d86c4e4304e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.319560 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e158c-d3dd-4156-be23-d86c4e4304e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.319834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e158c-d3dd-4156-be23-d86c4e4304e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.320485 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e158c-d3dd-4156-be23-d86c4e4304e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:23.322404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708e158c-d3dd-4156-be23-d86c4e4304e1 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:23.330951 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bd6ea-a603-44db-8e6b-c611efaa2704 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:23.336170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680f26f-f640-4d0d-801e-23500a2daeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:23.336842 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f26f-f640-4d0d-801e-23500a2daeb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.337115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f26f-f640-4d0d-801e-23500a2daeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.337491 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f26f-f640-4d0d-801e-23500a2daeb8 admin admin] PATH_INFO: `/v3/users/294c35bac3f2485d83b145134c2898fa` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.338936 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680f26f-f640-4d0d-801e-23500a2daeb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=294c35bac3f2485d83b145134c2898fa)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:23.340524 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680f26f-f640-4d0d-801e-23500a2daeb8 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:23.406385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1405/2800] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:23 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:27:23.410547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e158c-d3dd-4156-be23-d86c4e4304e1 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:23.472983 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e158c-d3dd-4156-be23-d86c4e4304e1 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:23.477812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4142c-a310-4427-bab5-66ca9e0c133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:23.478450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4142c-a310-4427-bab5-66ca9e0c133a admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.478701 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4142c-a310-4427-bab5-66ca9e0c133a admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.478975 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4142c-a310-4427-bab5-66ca9e0c133a admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.479885 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4142c-a310-4427-bab5-66ca9e0c133a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:23.481565 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4142c-a310-4427-bab5-66ca9e0c133a admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:23.619882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7680f26f-f640-4d0d-801e-23500a2daeb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '294c35bac3f2485d83b145134c2898fa'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:23.620548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7680f26f-f640-4d0d-801e-23500a2daeb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '294c35bac3f2485d83b145134c2898fa'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:23.621183 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7680f26f-f640-4d0d-801e-23500a2daeb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '294c35bac3f2485d83b145134c2898fa'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:23.629653 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1406/2801] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:23 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:27:23.635280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4142c-a310-4427-bab5-66ca9e0c133a admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:23.635461 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7680f26f-f640-4d0d-801e-23500a2daeb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '294c35bac3f2485d83b145134c2898fa'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:23.637046 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1ef4142c-a310-4427-bab5-66ca9e0c133a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:23.649811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4142c-a310-4427-bab5-66ca9e0c133a admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:23.654519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24096-500e-4b60-9d2a-cbacf1110db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:23.655124 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24096-500e-4b60-9d2a-cbacf1110db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.655450 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24096-500e-4b60-9d2a-cbacf1110db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.655726 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d24096-500e-4b60-9d2a-cbacf1110db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.656412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d24096-500e-4b60-9d2a-cbacf1110db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:23.657991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d24096-500e-4b60-9d2a-cbacf1110db7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:23.661712 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:23.669948 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1407/2802] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:27:23.674295 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24096-500e-4b60-9d2a-cbacf1110db7 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:23.685819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d24096-500e-4b60-9d2a-cbacf1110db7 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:23.691215 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257922d7-7cf2-447b-adbd-b98131fc6c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:23.691981 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257922d7-7cf2-447b-adbd-b98131fc6c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.692547 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257922d7-7cf2-447b-adbd-b98131fc6c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.692949 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257922d7-7cf2-447b-adbd-b98131fc6c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.693690 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257922d7-7cf2-447b-adbd-b98131fc6c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:23.696100 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257922d7-7cf2-447b-adbd-b98131fc6c99 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:23.707333 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1408/2803] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:27:23.711293 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257922d7-7cf2-447b-adbd-b98131fc6c99 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:23.720915 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257922d7-7cf2-447b-adbd-b98131fc6c99 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:23.726123 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82b405-af5f-4ab2-bee6-73b4731e61c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:23.726748 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b405-af5f-4ab2-bee6-73b4731e61c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.727021 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b405-af5f-4ab2-bee6-73b4731e61c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.727285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b405-af5f-4ab2-bee6-73b4731e61c8 admin admin] PATH_INFO: `/v3/projects/b76f92a17bab444b8b3688db7c71b597/users/abf4aedb712d43ef98da7ee6fbf84378/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.730331 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7680f26f-f640-4d0d-801e-23500a2daeb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '294c35bac3f2485d83b145134c2898fa'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:23.743374 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82b405-af5f-4ab2-bee6-73b4731e61c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76f92a17bab444b8b3688db7c71b597, user_id=abf4aedb712d43ef98da7ee6fbf84378, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:23.745313 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1396/2804] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:23 2022] DELETE /identity/v3/users/294c35bac3f2485d83b145134c2898fa => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:23.746019 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82b405-af5f-4ab2-bee6-73b4731e61c8 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:23.749581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0052cd-8bad-43b0-9335-4a57fe474228 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.749947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0052cd-8bad-43b0-9335-4a57fe474228 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.750221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0052cd-8bad-43b0-9335-4a57fe474228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.769725 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-9e0052cd-8bad-43b0-9335-4a57fe474228 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:23.771274 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9e0052cd-8bad-43b0-9335-4a57fe474228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:23.829636 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1397/2805] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:27:23.839315 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0052cd-8bad-43b0-9335-4a57fe474228 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:23.840776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9e0052cd-8bad-43b0-9335-4a57fe474228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:23.845056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1409/2806] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:23 2022] PUT /identity/v3/projects/b76f92a17bab444b8b3688db7c71b597/users/abf4aedb712d43ef98da7ee6fbf84378/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:23.856155 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed077ad-fd9f-4cff-9644-793a3874aada None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.856458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed077ad-fd9f-4cff-9644-793a3874aada None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.856724 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed077ad-fd9f-4cff-9644-793a3874aada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.887572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-1ed077ad-fd9f-4cff-9644-793a3874aada None None] MFA Rules not processed for user `abf4aedb712d43ef98da7ee6fbf84378`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:23.888747 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-1ed077ad-fd9f-4cff-9644-793a3874aada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:23.902487 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0052cd-8bad-43b0-9335-4a57fe474228 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:23.912013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:23.951888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9795d-6345-4d74-a624-31100b441b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:23.952759 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9795d-6345-4d74-a624-31100b441b93 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:23.953280 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9795d-6345-4d74-a624-31100b441b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:23.953941 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9795d-6345-4d74-a624-31100b441b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:23.956212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1410/2807] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:27:23.960569 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed077ad-fd9f-4cff-9644-793a3874aada None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:24.016483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9795d-6345-4d74-a624-31100b441b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:24.017932 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9795d-6345-4d74-a624-31100b441b93 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:24.027327 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed077ad-fd9f-4cff-9644-793a3874aada None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:24.028710 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1398/2808] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:27:24.031996 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814acaa-d43d-4e6f-a14f-0a5762bdfe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:24.032648 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814acaa-d43d-4e6f-a14f-0a5762bdfe2f admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:24.032961 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814acaa-d43d-4e6f-a14f-0a5762bdfe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:24.033236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814acaa-d43d-4e6f-a14f-0a5762bdfe2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:24.033986 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814acaa-d43d-4e6f-a14f-0a5762bdfe2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:24.036347 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814acaa-d43d-4e6f-a14f-0a5762bdfe2f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:24.157108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1411/2809] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:23 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:27:24.159580 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9795d-6345-4d74-a624-31100b441b93 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:24.170454 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9795d-6345-4d74-a624-31100b441b93 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:24.229764 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905f63-1100-4d0f-bf0b-1e3283f1741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:24.230380 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905f63-1100-4d0f-bf0b-1e3283f1741b admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:24.230661 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905f63-1100-4d0f-bf0b-1e3283f1741b admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:24.230969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905f63-1100-4d0f-bf0b-1e3283f1741b admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:24.233018 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8905f63-1100-4d0f-bf0b-1e3283f1741b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:24.235048 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8905f63-1100-4d0f-bf0b-1e3283f1741b admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:24.308494 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1399/2810] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:24 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:24.312409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814acaa-d43d-4e6f-a14f-0a5762bdfe2f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:24.323315 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814acaa-d43d-4e6f-a14f-0a5762bdfe2f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:24.328316 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f8b0e-feb7-4ac5-b0a9-ee74eb8a4d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:24.329073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f8b0e-feb7-4ac5-b0a9-ee74eb8a4d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:24.329411 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f8b0e-feb7-4ac5-b0a9-ee74eb8a4d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:24.329621 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f8b0e-feb7-4ac5-b0a9-ee74eb8a4d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:24.330270 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f8b0e-feb7-4ac5-b0a9-ee74eb8a4d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:24.331859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f8b0e-feb7-4ac5-b0a9-ee74eb8a4d94 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:24.343597 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1412/2811] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:24.351983 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905f63-1100-4d0f-bf0b-1e3283f1741b admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:24.362817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905f63-1100-4d0f-bf0b-1e3283f1741b admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:24.367716 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1899b59-57dc-4a2e-aa5f-84da8d92a5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:24.368409 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1899b59-57dc-4a2e-aa5f-84da8d92a5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:24.368704 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1899b59-57dc-4a2e-aa5f-84da8d92a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:24.368975 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1899b59-57dc-4a2e-aa5f-84da8d92a5ec admin admin] PATH_INFO: `/v3/projects/e0e44df71964442292605a6f91eadd38/users/dc454f168b974e2db4a4a23a1b2ba1f6/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:24.384984 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1899b59-57dc-4a2e-aa5f-84da8d92a5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e44df71964442292605a6f91eadd38, user_id=dc454f168b974e2db4a4a23a1b2ba1f6, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:24.387663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1899b59-57dc-4a2e-aa5f-84da8d92a5ec admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:24.515751 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f8b0e-feb7-4ac5-b0a9-ee74eb8a4d94 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:24.516807 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1400/2812] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:24 2022] PUT /identity/v3/projects/e0e44df71964442292605a6f91eadd38/users/dc454f168b974e2db4a4a23a1b2ba1f6/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:24.518273 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ef0f8b0e-feb7-4ac5-b0a9-ee74eb8a4d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:24.520645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1899b59-57dc-4a2e-aa5f-84da8d92a5ec admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:24.535294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f8b0e-feb7-4ac5-b0a9-ee74eb8a4d94 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:24.557632 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:24.569754 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:24.589442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1899b59-57dc-4a2e-aa5f-84da8d92a5ec admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:24.594888 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7370-e94a-48ec-bb4a-b906555ae8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:24.595506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7370-e94a-48ec-bb4a-b906555ae8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:24.595789 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7370-e94a-48ec-bb4a-b906555ae8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:24.596065 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7370-e94a-48ec-bb4a-b906555ae8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:24.596843 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a7370-e94a-48ec-bb4a-b906555ae8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:24.598459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a7370-e94a-48ec-bb4a-b906555ae8f3 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:24.604103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:24.604819 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:24.605120 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:24.605390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] PATH_INFO: `/v3/projects/4e9e4ad0700f4d498411ee1fc419c1cc` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:24.606542 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9e4ad0700f4d498411ee1fc419c1cc)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:24.608491 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:24.609779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1401/2813] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:27:24.613897 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7370-e94a-48ec-bb4a-b906555ae8f3 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:24.624014 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7370-e94a-48ec-bb4a-b906555ae8f3 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:24.629171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34b145-147e-4dcc-a81a-8aaa30e7c566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:24.629817 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34b145-147e-4dcc-a81a-8aaa30e7c566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:24.630091 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34b145-147e-4dcc-a81a-8aaa30e7c566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:24.630357 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34b145-147e-4dcc-a81a-8aaa30e7c566 admin admin] PATH_INFO: `/v3/projects/e0e44df71964442292605a6f91eadd38/users/dc454f168b974e2db4a4a23a1b2ba1f6/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:24.633776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34b145-147e-4dcc-a81a-8aaa30e7c566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0e44df71964442292605a6f91eadd38, user_id=dc454f168b974e2db4a4a23a1b2ba1f6, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:24.636435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34b145-147e-4dcc-a81a-8aaa30e7c566 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:24.647825 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1402/2814] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:24 2022] PUT /identity/v3/projects/e0e44df71964442292605a6f91eadd38/users/dc454f168b974e2db4a4a23a1b2ba1f6/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:24.658223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391be14-26a3-4402-9ea2-a5730a9258f8 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:24.658555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391be14-26a3-4402-9ea2-a5730a9258f8 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:24.658837 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391be14-26a3-4402-9ea2-a5730a9258f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:24.690443 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-9391be14-26a3-4402-9ea2-a5730a9258f8 None None] MFA Rules not processed for user `dc454f168b974e2db4a4a23a1b2ba1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:24.692044 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9391be14-26a3-4402-9ea2-a5730a9258f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:24.718759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9e4ad0700f4d498411ee1fc419c1cc', 'request_id': 'req-a1767c0e-ba06-4ea1-8439-624eee49e988'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:24.768697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1403/2815] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:27:24.780367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391be14-26a3-4402-9ea2-a5730a9258f8 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:24.781765 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-9391be14-26a3-4402-9ea2-a5730a9258f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:24.810329 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9e4ad0700f4d498411ee1fc419c1cc', 'request_id': 'req-a1767c0e-ba06-4ea1-8439-624eee49e988'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:24.817160 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9e4ad0700f4d498411ee1fc419c1cc', 'request_id': 'req-a1767c0e-ba06-4ea1-8439-624eee49e988'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:24.827939 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] The token cache is being invalidate because project 4e9e4ad0700f4d498411ee1fc419c1cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:24.828256 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:24.828987 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:24.830553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1413/2816] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:24 2022] DELETE /identity/v3/projects/4e9e4ad0700f4d498411ee1fc419c1cc => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:24.835381 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:24.836820 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:24.843215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391be14-26a3-4402-9ea2-a5730a9258f8 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:24.893909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c30ca-fb48-47c0-8d5a-2242341f7c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:24.899517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c30ca-fb48-47c0-8d5a-2242341f7c29 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:24.899517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c30ca-fb48-47c0-8d5a-2242341f7c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:24.899517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c30ca-fb48-47c0-8d5a-2242341f7c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:24.899517 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ef0c30ca-fb48-47c0-8d5a-2242341f7c29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:24.904398 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:24.904935 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1767c0e-ba06-4ea1-8439-624eee49e988 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:24.910049 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac810126-ea85-4d93-a8bf-fd2d125fc4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:24.910720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac810126-ea85-4d93-a8bf-fd2d125fc4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:24.910989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac810126-ea85-4d93-a8bf-fd2d125fc4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:24.911257 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac810126-ea85-4d93-a8bf-fd2d125fc4a8 admin admin] PATH_INFO: `/v3/users/e7cc13daad4542258dd38b3866fd81b7` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:24.913234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac810126-ea85-4d93-a8bf-fd2d125fc4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7cc13daad4542258dd38b3866fd81b7)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:24.915201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac810126-ea85-4d93-a8bf-fd2d125fc4a8 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:24.967802 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c30ca-fb48-47c0-8d5a-2242341f7c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:24.969278 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c30ca-fb48-47c0-8d5a-2242341f7c29 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:24.979601 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1404/2817] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:27:25.076481 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c30ca-fb48-47c0-8d5a-2242341f7c29 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:25.077980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-ef0c30ca-fb48-47c0-8d5a-2242341f7c29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:25.089268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c30ca-fb48-47c0-8d5a-2242341f7c29 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:25.092987 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901385d7-e1a9-4ec8-a8b7-6daee28ea8a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:25.093583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901385d7-e1a9-4ec8-a8b7-6daee28ea8a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:25.093862 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901385d7-e1a9-4ec8-a8b7-6daee28ea8a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:25.094132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901385d7-e1a9-4ec8-a8b7-6daee28ea8a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:25.095867 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-901385d7-e1a9-4ec8-a8b7-6daee28ea8a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:25.139729 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ac810126-ea85-4d93-a8bf-fd2d125fc4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7cc13daad4542258dd38b3866fd81b7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:25.140415 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ac810126-ea85-4d93-a8bf-fd2d125fc4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7cc13daad4542258dd38b3866fd81b7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:25.147977 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ac810126-ea85-4d93-a8bf-fd2d125fc4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7cc13daad4542258dd38b3866fd81b7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:25.148645 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ac810126-ea85-4d93-a8bf-fd2d125fc4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7cc13daad4542258dd38b3866fd81b7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:25.150530 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:25.157738 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901385d7-e1a9-4ec8-a8b7-6daee28ea8a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:25.159172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901385d7-e1a9-4ec8-a8b7-6daee28ea8a6 service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:25.160771 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-ac810126-ea85-4d93-a8bf-fd2d125fc4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7cc13daad4542258dd38b3866fd81b7'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:25.169943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1405/2818] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:27:25.238623 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1414/2819] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:24 2022] DELETE /identity/v3/users/e7cc13daad4542258dd38b3866fd81b7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:25.709592 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901385d7-e1a9-4ec8-a8b7-6daee28ea8a6 service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:25.720800 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901385d7-e1a9-4ec8-a8b7-6daee28ea8a6 service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:25.781758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:25.782506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:25.782664 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:25.782933 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] PATH_INFO: `/v3/projects/5ca6a99aa7a3439ca95e12218a0150db` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:25.784036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca6a99aa7a3439ca95e12218a0150db)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:25.786127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:25.905341 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:25.913268 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca6a99aa7a3439ca95e12218a0150db', 'request_id': 'req-994b3fa8-8f13-4004-a15c-06a24893e173'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:25.994021 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca6a99aa7a3439ca95e12218a0150db', 'request_id': 'req-994b3fa8-8f13-4004-a15c-06a24893e173'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:26.001857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca6a99aa7a3439ca95e12218a0150db', 'request_id': 'req-994b3fa8-8f13-4004-a15c-06a24893e173'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:26.013057 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] The token cache is being invalidate because project 5ca6a99aa7a3439ca95e12218a0150db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:26.013414 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:26.014163 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-994b3fa8-8f13-4004-a15c-06a24893e173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:26.015829 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1406/2820] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:25 2022] DELETE /identity/v3/projects/5ca6a99aa7a3439ca95e12218a0150db => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:26.020886 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15556b32-ff5e-4c88-9ee8-030768878e38 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:26.021232 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15556b32-ff5e-4c88-9ee8-030768878e38 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:26.021452 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15556b32-ff5e-4c88-9ee8-030768878e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:26.041903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-15556b32-ff5e-4c88-9ee8-030768878e38 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:26.043132 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-15556b32-ff5e-4c88-9ee8-030768878e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:26.104090 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1415/2821] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:26.113050 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb647a-5e3c-4db5-b427-28c58a2002ec None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:26.114071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb647a-5e3c-4db5-b427-28c58a2002ec None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:26.114071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb647a-5e3c-4db5-b427-28c58a2002ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:26.136042 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-5adb647a-5e3c-4db5-b427-28c58a2002ec None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:26.137360 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-5adb647a-5e3c-4db5-b427-28c58a2002ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:26.145169 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1407/2822] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:26.149453 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15556b32-ff5e-4c88-9ee8-030768878e38 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:26.159145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15556b32-ff5e-4c88-9ee8-030768878e38 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:26.164263 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196a1f6-a504-421c-96a0-060725d90209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:26.164859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196a1f6-a504-421c-96a0-060725d90209 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:26.165135 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196a1f6-a504-421c-96a0-060725d90209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:26.165404 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196a1f6-a504-421c-96a0-060725d90209 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:26.166113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196a1f6-a504-421c-96a0-060725d90209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:26.166346 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196a1f6-a504-421c-96a0-060725d90209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:26.167933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196a1f6-a504-421c-96a0-060725d90209 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:26.180750 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1416/2823] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:26.185071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb647a-5e3c-4db5-b427-28c58a2002ec None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:26.194697 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb647a-5e3c-4db5-b427-28c58a2002ec None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:26.199431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf61bc-3f3c-4419-93ef-d7f33b3afc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:26.200031 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf61bc-3f3c-4419-93ef-d7f33b3afc05 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:26.200343 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf61bc-3f3c-4419-93ef-d7f33b3afc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:26.200615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf61bc-3f3c-4419-93ef-d7f33b3afc05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:26.201251 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf61bc-3f3c-4419-93ef-d7f33b3afc05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:26.203182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf61bc-3f3c-4419-93ef-d7f33b3afc05 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:26.268832 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1408/2824] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:26 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:26.273720 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196a1f6-a504-421c-96a0-060725d90209 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:26.283757 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196a1f6-a504-421c-96a0-060725d90209 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:26.342412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b9809-c97d-4f3e-ac7d-99b53d67887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:26.343050 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b9809-c97d-4f3e-ac7d-99b53d67887c admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:26.343364 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b9809-c97d-4f3e-ac7d-99b53d67887c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:26.343635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b9809-c97d-4f3e-ac7d-99b53d67887c admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:26.344309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b9809-c97d-4f3e-ac7d-99b53d67887c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:26.346217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b9809-c97d-4f3e-ac7d-99b53d67887c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:26.427992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1417/2825] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:26 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:26.432406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf61bc-3f3c-4419-93ef-d7f33b3afc05 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:26.443803 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf61bc-3f3c-4419-93ef-d7f33b3afc05 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:26.448510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf485f0-3385-4164-b0fe-1d125c575ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:26.449150 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf485f0-3385-4164-b0fe-1d125c575ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:26.449431 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf485f0-3385-4164-b0fe-1d125c575ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:26.449708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf485f0-3385-4164-b0fe-1d125c575ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:26.450352 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf485f0-3385-4164-b0fe-1d125c575ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:26.451956 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf485f0-3385-4164-b0fe-1d125c575ea1 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:26.462863 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1409/2826] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:27:26.467144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b9809-c97d-4f3e-ac7d-99b53d67887c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:26.478113 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b9809-c97d-4f3e-ac7d-99b53d67887c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:26.483500 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3031320-1e82-4ad1-9314-55e86a586fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:26.484122 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3031320-1e82-4ad1-9314-55e86a586fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:26.484432 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3031320-1e82-4ad1-9314-55e86a586fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:26.484705 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3031320-1e82-4ad1-9314-55e86a586fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:26.485376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3031320-1e82-4ad1-9314-55e86a586fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:26.486954 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3031320-1e82-4ad1-9314-55e86a586fb7 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:26.497761 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1418/2827] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:26.502472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf485f0-3385-4164-b0fe-1d125c575ea1 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:26.512567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf485f0-3385-4164-b0fe-1d125c575ea1 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:26.517241 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ac50a-0bdc-481f-842b-f6d2349ea9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:26.517884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ac50a-0bdc-481f-842b-f6d2349ea9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:26.518160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ac50a-0bdc-481f-842b-f6d2349ea9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:26.518429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ac50a-0bdc-481f-842b-f6d2349ea9ac admin admin] PATH_INFO: `/v3/projects/55904e9176474c9fad6e835f1c01cddb/users/5be706b9887c47e3b3ca44a1d8c81784/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:26.533297 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ac50a-0bdc-481f-842b-f6d2349ea9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=55904e9176474c9fad6e835f1c01cddb, user_id=5be706b9887c47e3b3ca44a1d8c81784, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:26.535904 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ac50a-0bdc-481f-842b-f6d2349ea9ac admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:26.605769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1410/2828] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:26 2022] PUT /identity/v3/projects/55904e9176474c9fad6e835f1c01cddb/users/5be706b9887c47e3b3ca44a1d8c81784/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:26.616844 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d89db-f78b-419b-a418-384b9dcd3e3e None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:26.617130 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d89db-f78b-419b-a418-384b9dcd3e3e None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:26.617401 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d89db-f78b-419b-a418-384b9dcd3e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:26.645125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-cd7d89db-f78b-419b-a418-384b9dcd3e3e None None] MFA Rules not processed for user `5be706b9887c47e3b3ca44a1d8c81784`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:26.647108 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-cd7d89db-f78b-419b-a418-384b9dcd3e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:26.676439 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:26.712041 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1419/2829] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:27:26.724761 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ac50a-0bdc-481f-842b-f6d2349ea9ac admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:26.726474 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-c73ac50a-0bdc-481f-842b-f6d2349ea9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:26.785052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ac50a-0bdc-481f-842b-f6d2349ea9ac admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:26.788671 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b4e84-8652-438c-aa80-3b8dcd8ab8dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:26.789303 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b4e84-8652-438c-aa80-3b8dcd8ab8dd service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:26.789582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b4e84-8652-438c-aa80-3b8dcd8ab8dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:26.789852 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b4e84-8652-438c-aa80-3b8dcd8ab8dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:26.798629 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b4e84-8652-438c-aa80-3b8dcd8ab8dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:26.800090 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b4e84-8652-438c-aa80-3b8dcd8ab8dd service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:26.819542 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1411/2830] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:26.839856 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d89db-f78b-419b-a418-384b9dcd3e3e None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:26.906112 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d89db-f78b-419b-a418-384b9dcd3e3e None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:26.911011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:26.911728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:26.912012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:26.912390 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] PATH_INFO: `/v3/users/5be706b9887c47e3b3ca44a1d8c81784` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:26.913568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be706b9887c47e3b3ca44a1d8c81784)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:26.915522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:27.223548 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be706b9887c47e3b3ca44a1d8c81784'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:27.224392 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be706b9887c47e3b3ca44a1d8c81784'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:27.231522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be706b9887c47e3b3ca44a1d8c81784'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:27.232212 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be706b9887c47e3b3ca44a1d8c81784'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:27.244864 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be706b9887c47e3b3ca44a1d8c81784'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:27.322835 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1420/2831] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:26 2022] DELETE /identity/v3/users/5be706b9887c47e3b3ca44a1d8c81784 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:27.324560 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce426a-9ce9-4311-922b-b4788e64dfb8 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:27.324844 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce426a-9ce9-4311-922b-b4788e64dfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:27.325142 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce426a-9ce9-4311-922b-b4788e64dfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:27.345492 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-72ce426a-9ce9-4311-922b-b4788e64dfb8 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:27.346698 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-72ce426a-9ce9-4311-922b-b4788e64dfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:27.408094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1412/2832] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:27.418811 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:27.420115 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:27.482410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe7f16-852a-4dbd-a050-48b0c97ec117 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:27.486076 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6fc47-5eda-4bd2-b146-d14a4e75bf0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:27.486686 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6fc47-5eda-4bd2-b146-d14a4e75bf0d service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:27.486966 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6fc47-5eda-4bd2-b146-d14a4e75bf0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:27.487240 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6fc47-5eda-4bd2-b146-d14a4e75bf0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:27.494062 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:27.498009 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6fc47-5eda-4bd2-b146-d14a4e75bf0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:27.499443 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6fc47-5eda-4bd2-b146-d14a4e75bf0d service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:27.509957 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1421/2833] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:27.966884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce426a-9ce9-4311-922b-b4788e64dfb8 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:27.969619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-72ce426a-9ce9-4311-922b-b4788e64dfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:27.983602 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce426a-9ce9-4311-922b-b4788e64dfb8 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:27.989093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:27.991736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:27.991736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:27.991736 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] PATH_INFO: `/v3/projects/55904e9176474c9fad6e835f1c01cddb` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:27.992293 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55904e9176474c9fad6e835f1c01cddb)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:27.994359 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:28.001099 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:28.147912 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55904e9176474c9fad6e835f1c01cddb', 'request_id': 'req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:28.227589 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55904e9176474c9fad6e835f1c01cddb', 'request_id': 'req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:28.234968 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55904e9176474c9fad6e835f1c01cddb', 'request_id': 'req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:28.246884 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] The token cache is being invalidate because project 55904e9176474c9fad6e835f1c01cddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:28.247177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:28.247869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-5ad60c3a-efef-43a6-b5d5-d46d0cdb7335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:28.249420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1413/2834] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:27 2022] DELETE /identity/v3/projects/55904e9176474c9fad6e835f1c01cddb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:28.259234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cd3e5-15d2-4f81-bdcc-acec7e62e655 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.259234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cd3e5-15d2-4f81-bdcc-acec7e62e655 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.259234 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cd3e5-15d2-4f81-bdcc-acec7e62e655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.276978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-680cd3e5-15d2-4f81-bdcc-acec7e62e655 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:28.278211 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-680cd3e5-15d2-4f81-bdcc-acec7e62e655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:28.339366 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1422/2835] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:28.347567 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431ffd-8454-4460-883e-81d493cb7fa7 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.347851 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431ffd-8454-4460-883e-81d493cb7fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.348134 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51431ffd-8454-4460-883e-81d493cb7fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.368467 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-51431ffd-8454-4460-883e-81d493cb7fa7 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:28.369683 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-51431ffd-8454-4460-883e-81d493cb7fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:28.377921 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1414/2836] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:28.382339 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cd3e5-15d2-4f81-bdcc-acec7e62e655 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:28.391951 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cd3e5-15d2-4f81-bdcc-acec7e62e655 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:28.397553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a17ba7-091d-4f43-a121-006a96c6ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:28.398357 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a17ba7-091d-4f43-a121-006a96c6ad2f admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.398631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a17ba7-091d-4f43-a121-006a96c6ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.398918 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a17ba7-091d-4f43-a121-006a96c6ad2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.399568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a17ba7-091d-4f43-a121-006a96c6ad2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:28.399869 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a17ba7-091d-4f43-a121-006a96c6ad2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:28.401537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a17ba7-091d-4f43-a121-006a96c6ad2f admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:28.414128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1423/2837] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:28.418529 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51431ffd-8454-4460-883e-81d493cb7fa7 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:28.428779 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51431ffd-8454-4460-883e-81d493cb7fa7 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:28.433673 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e463e-8c61-4f67-a1e5-227257804314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:28.434275 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e463e-8c61-4f67-a1e5-227257804314 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.434556 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e463e-8c61-4f67-a1e5-227257804314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.434830 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e463e-8c61-4f67-a1e5-227257804314 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.444665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e463e-8c61-4f67-a1e5-227257804314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:28.444665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e463e-8c61-4f67-a1e5-227257804314 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:28.552501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1415/2838] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:28 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:28.553832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a17ba7-091d-4f43-a121-006a96c6ad2f admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:28.564162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a17ba7-091d-4f43-a121-006a96c6ad2f admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:28.623061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103a232-6143-418e-88a7-7375d2714c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:28.623683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103a232-6143-418e-88a7-7375d2714c78 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.623960 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103a232-6143-418e-88a7-7375d2714c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.624280 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103a232-6143-418e-88a7-7375d2714c78 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.624921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103a232-6143-418e-88a7-7375d2714c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:28.627375 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103a232-6143-418e-88a7-7375d2714c78 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:28.715834 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1424/2839] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:28 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:28.720402 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e463e-8c61-4f67-a1e5-227257804314 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:28.731483 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e463e-8c61-4f67-a1e5-227257804314 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:28.736518 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756896ec-f074-444c-b8cc-503badebb82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:28.739004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756896ec-f074-444c-b8cc-503badebb82c admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.739004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756896ec-f074-444c-b8cc-503badebb82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.739004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756896ec-f074-444c-b8cc-503badebb82c admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.739004 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756896ec-f074-444c-b8cc-503badebb82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:28.740195 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756896ec-f074-444c-b8cc-503badebb82c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:28.750615 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1416/2840] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:28.754947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103a232-6143-418e-88a7-7375d2714c78 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:28.765355 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103a232-6143-418e-88a7-7375d2714c78 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:28.769930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc994c-6d8a-4cbd-84d4-46f73f64dc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:28.770561 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc994c-6d8a-4cbd-84d4-46f73f64dc25 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.771317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc994c-6d8a-4cbd-84d4-46f73f64dc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.771614 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc994c-6d8a-4cbd-84d4-46f73f64dc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.772631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc994c-6d8a-4cbd-84d4-46f73f64dc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:28.774210 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc994c-6d8a-4cbd-84d4-46f73f64dc25 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:28.784922 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1425/2841] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:28.789966 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756896ec-f074-444c-b8cc-503badebb82c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:28.800106 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756896ec-f074-444c-b8cc-503badebb82c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:28.805130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e459f-ab57-4c57-8460-3315faebfc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:28.805813 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e459f-ab57-4c57-8460-3315faebfc45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.806094 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e459f-ab57-4c57-8460-3315faebfc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.806368 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e459f-ab57-4c57-8460-3315faebfc45 admin admin] PATH_INFO: `/v3/projects/eedd69a3242b4327a60a0942c993161f/users/afe8633f7d6540068ad23ac8a22931bb/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.821188 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e459f-ab57-4c57-8460-3315faebfc45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eedd69a3242b4327a60a0942c993161f, user_id=afe8633f7d6540068ad23ac8a22931bb, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:28.823807 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e459f-ab57-4c57-8460-3315faebfc45 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:28.907775 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1417/2842] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:28 2022] PUT /identity/v3/projects/eedd69a3242b4327a60a0942c993161f/users/afe8633f7d6540068ad23ac8a22931bb/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:27:28.926883 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef814-a5fe-41ec-a1d3-e1a4616cb1d5 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:28.927213 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef814-a5fe-41ec-a1d3-e1a4616cb1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:28.927497 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef814-a5fe-41ec-a1d3-e1a4616cb1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:28.955103 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ef8ef814-a5fe-41ec-a1d3-e1a4616cb1d5 None None] MFA Rules not processed for user `afe8633f7d6540068ad23ac8a22931bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:28.956376 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ef8ef814-a5fe-41ec-a1d3-e1a4616cb1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:29.004337 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:29.023325 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1426/2843] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:29.034144 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e459f-ab57-4c57-8460-3315faebfc45 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:29.035897 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-de0e459f-ab57-4c57-8460-3315faebfc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:29.093265 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e459f-ab57-4c57-8460-3315faebfc45 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:29.096868 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f59d-e34a-4758-b165-bc2c9bde3a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:29.097473 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f59d-e34a-4758-b165-bc2c9bde3a1a service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:29.097753 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f59d-e34a-4758-b165-bc2c9bde3a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:29.098027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f59d-e34a-4758-b165-bc2c9bde3a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:29.107054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71f59d-e34a-4758-b165-bc2c9bde3a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:29.108543 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71f59d-e34a-4758-b165-bc2c9bde3a1a service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:29.117769 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1418/2844] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:29.419258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef814-a5fe-41ec-a1d3-e1a4616cb1d5 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:29.420702 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ef8ef814-a5fe-41ec-a1d3-e1a4616cb1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:29.486765 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef814-a5fe-41ec-a1d3-e1a4616cb1d5 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:29.491831 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:29.492572 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:29.492853 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:29.493129 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] PATH_INFO: `/v3/users/69640669a52a448893374096cc67f05e` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:29.494259 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69640669a52a448893374096cc67f05e)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:29.496162 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:29.716845 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69640669a52a448893374096cc67f05e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:29.717414 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69640669a52a448893374096cc67f05e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:29.726377 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69640669a52a448893374096cc67f05e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:29.727056 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69640669a52a448893374096cc67f05e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:29.739607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69640669a52a448893374096cc67f05e'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:29.867889 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1427/2845] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:29 2022] DELETE /identity/v3/users/69640669a52a448893374096cc67f05e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:29.872599 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dec1a3-f3e2-433b-ade3-c2e37bb04ebf None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:29.872891 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dec1a3-f3e2-433b-ade3-c2e37bb04ebf None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:29.873682 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dec1a3-f3e2-433b-ade3-c2e37bb04ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:29.893388 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-76dec1a3-f3e2-433b-ade3-c2e37bb04ebf None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:29.894665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-76dec1a3-f3e2-433b-ade3-c2e37bb04ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:29.925546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:29.958020 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1419/2846] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:29.968655 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:29.970073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:30.027158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184e47-72eb-4e10-9120-7d39d24e5e51 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:30.030826 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73943b-800d-4275-a150-5dc4c476c91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:30.031434 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73943b-800d-4275-a150-5dc4c476c91e service neutron] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:30.037436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73943b-800d-4275-a150-5dc4c476c91e service neutron] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:30.037436 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73943b-800d-4275-a150-5dc4c476c91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:30.041743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73943b-800d-4275-a150-5dc4c476c91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:30.043409 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73943b-800d-4275-a150-5dc4c476c91e service neutron] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:30.055564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1428/2847] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:30.538122 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dec1a3-f3e2-433b-ade3-c2e37bb04ebf None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:30.539618 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-76dec1a3-f3e2-433b-ade3-c2e37bb04ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:30.554675 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dec1a3-f3e2-433b-ade3-c2e37bb04ebf None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:30.560001 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:30.560847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:30.561130 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:30.561406 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] PATH_INFO: `/v3/projects/1cb480119e80409caa9b7f3f46175700` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:30.562583 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb480119e80409caa9b7f3f46175700)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:30.564588 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:30.663011 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb480119e80409caa9b7f3f46175700', 'request_id': 'req-96795670-6ad6-49fc-a3b9-9f8d2131c41d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:30.718628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb480119e80409caa9b7f3f46175700', 'request_id': 'req-96795670-6ad6-49fc-a3b9-9f8d2131c41d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:30.726182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb480119e80409caa9b7f3f46175700', 'request_id': 'req-96795670-6ad6-49fc-a3b9-9f8d2131c41d'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:30.737056 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] The token cache is being invalidate because project 1cb480119e80409caa9b7f3f46175700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:30.737350 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:30.738023 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:30.740277 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1420/2848] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:30 2022] DELETE /identity/v3/projects/1cb480119e80409caa9b7f3f46175700 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:30.745797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73943b-800d-4275-a150-5dc4c476c91e service neutron] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:30.756158 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73943b-800d-4275-a150-5dc4c476c91e service neutron] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:30.764133 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:30.814823 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:30.815456 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:30.815736 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:30.816011 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] PATH_INFO: `/v3/users/abf4aedb712d43ef98da7ee6fbf84378` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:30.820039 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf4aedb712d43ef98da7ee6fbf84378)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:30.821985 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:30.996175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf4aedb712d43ef98da7ee6fbf84378'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:30.996901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf4aedb712d43ef98da7ee6fbf84378'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:31.005674 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf4aedb712d43ef98da7ee6fbf84378'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:31.006373 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf4aedb712d43ef98da7ee6fbf84378'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:31.020435 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf4aedb712d43ef98da7ee6fbf84378'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:31.090798 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1429/2849] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:30 2022] DELETE /identity/v3/users/abf4aedb712d43ef98da7ee6fbf84378 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:31.531548 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:31.533135 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:31.546619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96795670-6ad6-49fc-a3b9-9f8d2131c41d admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:31.605369 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:31.605914 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:31.606192 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:31.606464 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] PATH_INFO: `/v3/projects/b76f92a17bab444b8b3688db7c71b597` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:31.607594 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76f92a17bab444b8b3688db7c71b597)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:31.609527 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:31.708792 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76f92a17bab444b8b3688db7c71b597', 'request_id': 'req-d0c1aa14-707a-433b-8d3b-5069aed93122'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:31.895597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76f92a17bab444b8b3688db7c71b597', 'request_id': 'req-d0c1aa14-707a-433b-8d3b-5069aed93122'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:31.895597 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:31.898294 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76f92a17bab444b8b3688db7c71b597', 'request_id': 'req-d0c1aa14-707a-433b-8d3b-5069aed93122'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:31.910172 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] The token cache is being invalidate because project b76f92a17bab444b8b3688db7c71b597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:31.910644 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:31.912104 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:31.913938 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1421/2850] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:31 2022] DELETE /identity/v3/projects/b76f92a17bab444b8b3688db7c71b597 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:31.931571 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:31.933089 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:31.947132 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b60b33-7182-4be3-a656-b0c422b34537 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:32.005901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0ea42-48e8-4fcc-ba8a-cda9e7ad02ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:32.006520 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0ea42-48e8-4fcc-ba8a-cda9e7ad02ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:32.006797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0ea42-48e8-4fcc-ba8a-cda9e7ad02ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:32.007069 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0ea42-48e8-4fcc-ba8a-cda9e7ad02ea admin admin] PATH_INFO: `/v3/users/dc454f168b974e2db4a4a23a1b2ba1f6` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:32.008273 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0ea42-48e8-4fcc-ba8a-cda9e7ad02ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc454f168b974e2db4a4a23a1b2ba1f6)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:32.010250 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0ea42-48e8-4fcc-ba8a-cda9e7ad02ea admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:32.189000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:32.201078 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-28d0ea42-48e8-4fcc-ba8a-cda9e7ad02ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc454f168b974e2db4a4a23a1b2ba1f6'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:32.201737 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-28d0ea42-48e8-4fcc-ba8a-cda9e7ad02ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc454f168b974e2db4a4a23a1b2ba1f6'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:32.208687 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-28d0ea42-48e8-4fcc-ba8a-cda9e7ad02ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc454f168b974e2db4a4a23a1b2ba1f6'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:32.212525 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-28d0ea42-48e8-4fcc-ba8a-cda9e7ad02ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc454f168b974e2db4a4a23a1b2ba1f6'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:32.221285 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-28d0ea42-48e8-4fcc-ba8a-cda9e7ad02ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc454f168b974e2db4a4a23a1b2ba1f6'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:32.301906 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1430/2851] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:31 2022] DELETE /identity/v3/users/dc454f168b974e2db4a4a23a1b2ba1f6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:32.705264 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:32.706776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:32.721252 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1aa14-707a-433b-8d3b-5069aed93122 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:32.785127 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:32.785758 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:32.786036 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:32.786335 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] PATH_INFO: `/v3/projects/e0e44df71964442292605a6f91eadd38` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:32.787479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0e44df71964442292605a6f91eadd38)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:32.789435 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:32.909032 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0e44df71964442292605a6f91eadd38', 'request_id': 'req-330c948e-55d8-48a8-92af-5a880c9f5f13'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:32.976375 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0e44df71964442292605a6f91eadd38', 'request_id': 'req-330c948e-55d8-48a8-92af-5a880c9f5f13'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:32.983935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0e44df71964442292605a6f91eadd38', 'request_id': 'req-330c948e-55d8-48a8-92af-5a880c9f5f13'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:32.994699 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] The token cache is being invalidate because project e0e44df71964442292605a6f91eadd38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81946) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:32.994992 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:32.995646 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-330c948e-55d8-48a8-92af-5a880c9f5f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:32.997284 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1422/2852] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:32 2022] DELETE /identity/v3/projects/e0e44df71964442292605a6f91eadd38 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:33.003710 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfac28-79c7-49cc-bba6-4f68364a6576 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:33.008795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfac28-79c7-49cc-bba6-4f68364a6576 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:33.008795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfac28-79c7-49cc-bba6-4f68364a6576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:33.026916 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-adbfac28-79c7-49cc-bba6-4f68364a6576 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:33.031818 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-adbfac28-79c7-49cc-bba6-4f68364a6576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:33.087336 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1431/2853] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:27:33.097221 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8ca90-e4dd-4be9-8a7a-b60e11f98909 None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:33.097507 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8ca90-e4dd-4be9-8a7a-b60e11f98909 None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:33.097789 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8ca90-e4dd-4be9-8a7a-b60e11f98909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:33.118438 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-a9e8ca90-e4dd-4be9-8a7a-b60e11f98909 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:33.119658 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-a9e8ca90-e4dd-4be9-8a7a-b60e11f98909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:33.127855 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1423/2854] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:33.133094 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbfac28-79c7-49cc-bba6-4f68364a6576 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:33.142956 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbfac28-79c7-49cc-bba6-4f68364a6576 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:33.148007 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00453-bc88-4d25-b761-98ee80a9fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:33.148633 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00453-bc88-4d25-b761-98ee80a9fc21 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:33.148907 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00453-bc88-4d25-b761-98ee80a9fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:33.149236 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb00453-bc88-4d25-b761-98ee80a9fc21 admin admin] PATH_INFO: `/v3/domains` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:33.149999 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb00453-bc88-4d25-b761-98ee80a9fc21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81947) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:33.150361 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb00453-bc88-4d25-b761-98ee80a9fc21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:33.151933 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb00453-bc88-4d25-b761-98ee80a9fc21 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:33.163760 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1432/2855] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:27:33.168479 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8ca90-e4dd-4be9-8a7a-b60e11f98909 None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:33.178367 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8ca90-e4dd-4be9-8a7a-b60e11f98909 None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:33.183295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910e1a8-cab5-49d4-926e-1e55a2bdade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:33.183895 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e1a8-cab5-49d4-926e-1e55a2bdade0 admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:33.184170 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e1a8-cab5-49d4-926e-1e55a2bdade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:33.184468 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e1a8-cab5-49d4-926e-1e55a2bdade0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:33.185098 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910e1a8-cab5-49d4-926e-1e55a2bdade0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:33.187079 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910e1a8-cab5-49d4-926e-1e55a2bdade0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:33.314442 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1424/2856] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:33 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:27:33.316102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00453-bc88-4d25-b761-98ee80a9fc21 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:33.326412 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb00453-bc88-4d25-b761-98ee80a9fc21 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:33.383629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396b47-464c-4641-a3b5-906243301af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:33.384253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396b47-464c-4641-a3b5-906243301af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:33.384544 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396b47-464c-4641-a3b5-906243301af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:33.384817 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78396b47-464c-4641-a3b5-906243301af6 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:33.385451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78396b47-464c-4641-a3b5-906243301af6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:33.387402 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78396b47-464c-4641-a3b5-906243301af6 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:33.461790 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1433/2857] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:33 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:27:33.465999 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910e1a8-cab5-49d4-926e-1e55a2bdade0 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:33.477413 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910e1a8-cab5-49d4-926e-1e55a2bdade0 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:33.481970 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a86e4-2a5a-4122-a491-48005e771a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:33.482669 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a86e4-2a5a-4122-a491-48005e771a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:33.483039 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a86e4-2a5a-4122-a491-48005e771a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:33.483309 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a86e4-2a5a-4122-a491-48005e771a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:33.483946 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a86e4-2a5a-4122-a491-48005e771a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:33.485565 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a86e4-2a5a-4122-a491-48005e771a3a admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:33.496506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1425/2858] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:33.500762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396b47-464c-4641-a3b5-906243301af6 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:33.512660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78396b47-464c-4641-a3b5-906243301af6 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:33.517516 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd36a32-0619-4c28-93ac-89be2539c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:33.518125 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd36a32-0619-4c28-93ac-89be2539c143 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:33.518403 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd36a32-0619-4c28-93ac-89be2539c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:33.518678 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd36a32-0619-4c28-93ac-89be2539c143 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:33.519324 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd36a32-0619-4c28-93ac-89be2539c143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:33.521000 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd36a32-0619-4c28-93ac-89be2539c143 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:33.531749 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1434/2859] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:33.536136 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a86e4-2a5a-4122-a491-48005e771a3a admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:33.547071 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a86e4-2a5a-4122-a491-48005e771a3a admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:33.551668 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f30a72-d649-41d3-bc96-2486381dd0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:33.553070 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f30a72-d649-41d3-bc96-2486381dd0de admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:33.553354 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f30a72-d649-41d3-bc96-2486381dd0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:33.553631 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f30a72-d649-41d3-bc96-2486381dd0de admin admin] PATH_INFO: `/v3/projects/ac7c1d8ee4534e28bbe2c0715b3196ab/users/64b5244b5a0441f1acf96f238cf33336/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:33.569552 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f30a72-d649-41d3-bc96-2486381dd0de admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7c1d8ee4534e28bbe2c0715b3196ab, user_id=64b5244b5a0441f1acf96f238cf33336, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:33.572253 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f30a72-d649-41d3-bc96-2486381dd0de admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:33.685372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1426/2860] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:33 2022] PUT /identity/v3/projects/ac7c1d8ee4534e28bbe2c0715b3196ab/users/64b5244b5a0441f1acf96f238cf33336/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:33.696971 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77db9bc-cbfc-4a5b-a25b-54aa660e185c None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:33.697281 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77db9bc-cbfc-4a5b-a25b-54aa660e185c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:33.697846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77db9bc-cbfc-4a5b-a25b-54aa660e185c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:33.730759 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-c77db9bc-cbfc-4a5b-a25b-54aa660e185c None None] MFA Rules not processed for user `64b5244b5a0441f1acf96f238cf33336`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:33.731992 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-c77db9bc-cbfc-4a5b-a25b-54aa660e185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:33.735914 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:33.801979 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1435/2861] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:33.806799 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f30a72-d649-41d3-bc96-2486381dd0de admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:33.820569 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:33.868397 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f30a72-d649-41d3-bc96-2486381dd0de admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:33.873067 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45ef4d-82b8-427b-896f-dcddf0e6120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:33.873674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ef4d-82b8-427b-896f-dcddf0e6120c admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:33.873951 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ef4d-82b8-427b-896f-dcddf0e6120c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:33.874225 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ef4d-82b8-427b-896f-dcddf0e6120c admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:33.874846 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45ef4d-82b8-427b-896f-dcddf0e6120c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:33.877052 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45ef4d-82b8-427b-896f-dcddf0e6120c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:34.001586 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1427/2862] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:33 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:34.005630 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77db9bc-cbfc-4a5b-a25b-54aa660e185c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:34.016519 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77db9bc-cbfc-4a5b-a25b-54aa660e185c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:34.074537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300c156-9e35-4875-b773-67131758375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:34.075097 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300c156-9e35-4875-b773-67131758375c admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:34.075389 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300c156-9e35-4875-b773-67131758375c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:34.075664 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300c156-9e35-4875-b773-67131758375c admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:34.076342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300c156-9e35-4875-b773-67131758375c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:34.078294 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300c156-9e35-4875-b773-67131758375c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:34.175455 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1436/2863] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:34 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:34.179582 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45ef4d-82b8-427b-896f-dcddf0e6120c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:34.190521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45ef4d-82b8-427b-896f-dcddf0e6120c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:34.196739 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495714f-d32e-475b-a47a-79f32f0aa228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:34.197501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495714f-d32e-475b-a47a-79f32f0aa228 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:34.197782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495714f-d32e-475b-a47a-79f32f0aa228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:34.198101 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495714f-d32e-475b-a47a-79f32f0aa228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:34.198755 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495714f-d32e-475b-a47a-79f32f0aa228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:34.200387 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495714f-d32e-475b-a47a-79f32f0aa228 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:34.212501 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1428/2864] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:34.216636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300c156-9e35-4875-b773-67131758375c admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:34.226832 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300c156-9e35-4875-b773-67131758375c admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:34.256196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a3267-65fd-4e8c-8f80-f6261b8cf950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:34.256196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a3267-65fd-4e8c-8f80-f6261b8cf950 admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:34.256196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a3267-65fd-4e8c-8f80-f6261b8cf950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:34.256196 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a3267-65fd-4e8c-8f80-f6261b8cf950 admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:34.256662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a3267-65fd-4e8c-8f80-f6261b8cf950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:34.256662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a3267-65fd-4e8c-8f80-f6261b8cf950 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:34.256662 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1437/2865] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:27:34.259408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495714f-d32e-475b-a47a-79f32f0aa228 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:34.269471 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495714f-d32e-475b-a47a-79f32f0aa228 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:34.274994 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f1a85-fb68-42ba-8fa4-f286a0afc6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:34.275665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f1a85-fb68-42ba-8fa4-f286a0afc6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:34.275943 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f1a85-fb68-42ba-8fa4-f286a0afc6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:34.276216 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f1a85-fb68-42ba-8fa4-f286a0afc6e8 admin admin] PATH_INFO: `/v3/projects/6ddbd215f07e48a9a0c61a991bdd714d/users/19ebf8d499d6420085e2a2fdbd8ebb49/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:34.291768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f1a85-fb68-42ba-8fa4-f286a0afc6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ddbd215f07e48a9a0c61a991bdd714d, user_id=19ebf8d499d6420085e2a2fdbd8ebb49, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:34.294510 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f1a85-fb68-42ba-8fa4-f286a0afc6e8 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:34.432963 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1429/2866] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:34 2022] PUT /identity/v3/projects/6ddbd215f07e48a9a0c61a991bdd714d/users/19ebf8d499d6420085e2a2fdbd8ebb49/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:34.444451 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7ece-a16b-403c-825d-1a216b5ec85c None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:34.444743 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7ece-a16b-403c-825d-1a216b5ec85c None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:34.445022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7ece-a16b-403c-825d-1a216b5ec85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:34.474479 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-2b8c7ece-a16b-403c-825d-1a216b5ec85c None None] MFA Rules not processed for user `19ebf8d499d6420085e2a2fdbd8ebb49`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:34.475731 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-2b8c7ece-a16b-403c-825d-1a216b5ec85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:34.540857 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1438/2867] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:34.545357 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f1a85-fb68-42ba-8fa4-f286a0afc6e8 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:34.606949 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f1a85-fb68-42ba-8fa4-f286a0afc6e8 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:34.611742 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153ef99-e4ff-4fe8-9a8a-5155451e015c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:34.612372 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153ef99-e4ff-4fe8-9a8a-5155451e015c admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:34.612650 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153ef99-e4ff-4fe8-9a8a-5155451e015c admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:34.612918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153ef99-e4ff-4fe8-9a8a-5155451e015c admin admin] PATH_INFO: `/v3/projects` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:34.613546 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153ef99-e4ff-4fe8-9a8a-5155451e015c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:34.616013 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153ef99-e4ff-4fe8-9a8a-5155451e015c admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:34.718078 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1430/2868] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:34 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:34.719190 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c7ece-a16b-403c-825d-1a216b5ec85c None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:34.730424 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c7ece-a16b-403c-825d-1a216b5ec85c None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:34.739073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:34.788064 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8581238-48e2-430f-bd83-a1064a706c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:34.788711 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581238-48e2-430f-bd83-a1064a706c70 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:34.788991 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581238-48e2-430f-bd83-a1064a706c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:34.789305 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581238-48e2-430f-bd83-a1064a706c70 admin admin] PATH_INFO: `/v3/users` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:34.789947 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8581238-48e2-430f-bd83-a1064a706c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:34.791852 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8581238-48e2-430f-bd83-a1064a706c70 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:34.879070 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1439/2869] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:34 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:34.883708 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153ef99-e4ff-4fe8-9a8a-5155451e015c admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:34.894574 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153ef99-e4ff-4fe8-9a8a-5155451e015c admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:34.899525 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394139d4-d1f1-49d9-b9c8-a68ddc627ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:34.900177 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394139d4-d1f1-49d9-b9c8-a68ddc627ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:34.900500 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394139d4-d1f1-49d9-b9c8-a68ddc627ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:34.900774 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394139d4-d1f1-49d9-b9c8-a68ddc627ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:34.901429 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394139d4-d1f1-49d9-b9c8-a68ddc627ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:34.903022 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394139d4-d1f1-49d9-b9c8-a68ddc627ee3 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:34.914606 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1431/2870] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:34.918929 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8581238-48e2-430f-bd83-a1064a706c70 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:34.930073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8581238-48e2-430f-bd83-a1064a706c70 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:34.934903 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317513c4-5175-4cf6-ac1e-f5d883fb1317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:34.935566 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317513c4-5175-4cf6-ac1e-f5d883fb1317 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:34.935850 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317513c4-5175-4cf6-ac1e-f5d883fb1317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:34.936128 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317513c4-5175-4cf6-ac1e-f5d883fb1317 admin admin] PATH_INFO: `/v3/projects/5fb168261122490d982a968ee4b695a6/users/e9ef96608c8f47e184afc17f4d1dd847/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:34.951635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317513c4-5175-4cf6-ac1e-f5d883fb1317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb168261122490d982a968ee4b695a6, user_id=e9ef96608c8f47e184afc17f4d1dd847, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:34.954309 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317513c4-5175-4cf6-ac1e-f5d883fb1317 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:35.015575 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1440/2871] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:34 2022] PUT /identity/v3/projects/5fb168261122490d982a968ee4b695a6/users/e9ef96608c8f47e184afc17f4d1dd847/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:35.019645 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394139d4-d1f1-49d9-b9c8-a68ddc627ee3 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:35.030030 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394139d4-d1f1-49d9-b9c8-a68ddc627ee3 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:35.063953 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:35.086640 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658b46e-b6e8-44ff-a172-f468824c9696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:35.087247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658b46e-b6e8-44ff-a172-f468824c9696 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:35.087528 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658b46e-b6e8-44ff-a172-f468824c9696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:35.087808 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658b46e-b6e8-44ff-a172-f468824c9696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:35.088540 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658b46e-b6e8-44ff-a172-f468824c9696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:35.090647 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4658b46e-b6e8-44ff-a172-f468824c9696 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:35.101204 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1432/2872] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:35.105313 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317513c4-5175-4cf6-ac1e-f5d883fb1317 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:35.116410 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317513c4-5175-4cf6-ac1e-f5d883fb1317 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:35.121230 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e874efc-ef55-482d-aa5c-3e5c050f9edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:35.121876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e874efc-ef55-482d-aa5c-3e5c050f9edf admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:35.122175 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e874efc-ef55-482d-aa5c-3e5c050f9edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:35.122425 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e874efc-ef55-482d-aa5c-3e5c050f9edf admin admin] PATH_INFO: `/v3/projects/5fb168261122490d982a968ee4b695a6/users/e9ef96608c8f47e184afc17f4d1dd847/roles/2dbeed762d0548c7b6b68d61ad7ddc4b` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:35.124356 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e874efc-ef55-482d-aa5c-3e5c050f9edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb168261122490d982a968ee4b695a6, user_id=e9ef96608c8f47e184afc17f4d1dd847, role_id=2dbeed762d0548c7b6b68d61ad7ddc4b)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:35.127229 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e874efc-ef55-482d-aa5c-3e5c050f9edf admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:35.138102 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1441/2873] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:35 2022] PUT /identity/v3/projects/5fb168261122490d982a968ee4b695a6/users/e9ef96608c8f47e184afc17f4d1dd847/roles/2dbeed762d0548c7b6b68d61ad7ddc4b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:35.207233 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec259f-2af2-42ad-87bc-905cd3feecbc None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:35.207730 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec259f-2af2-42ad-87bc-905cd3feecbc None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:35.208009 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec259f-2af2-42ad-87bc-905cd3feecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:35.239239 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-44ec259f-2af2-42ad-87bc-905cd3feecbc None None] MFA Rules not processed for user `e9ef96608c8f47e184afc17f4d1dd847`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:35.241049 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-44ec259f-2af2-42ad-87bc-905cd3feecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:35.316531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1433/2874] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:35.328637 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e874efc-ef55-482d-aa5c-3e5c050f9edf admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:35.330319 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-3e874efc-ef55-482d-aa5c-3e5c050f9edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:35.391838 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e874efc-ef55-482d-aa5c-3e5c050f9edf admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:35.395568 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec143b0f-cebc-45d7-9baa-c3c1adff3667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:35.396631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec143b0f-cebc-45d7-9baa-c3c1adff3667 service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:35.397197 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec143b0f-cebc-45d7-9baa-c3c1adff3667 service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:35.397467 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec143b0f-cebc-45d7-9baa-c3c1adff3667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:35.457074 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec143b0f-cebc-45d7-9baa-c3c1adff3667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:35.459163 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec143b0f-cebc-45d7-9baa-c3c1adff3667 service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:35.469616 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1442/2875] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:37.440046 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec259f-2af2-42ad-87bc-905cd3feecbc None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:37.450558 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec259f-2af2-42ad-87bc-905cd3feecbc None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:37.454389 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31945b-bee7-4281-80e2-be75ba883cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:37.455066 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31945b-bee7-4281-80e2-be75ba883cec service cinder] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:37.455346 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31945b-bee7-4281-80e2-be75ba883cec service cinder] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:37.455619 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31945b-bee7-4281-80e2-be75ba883cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:37.519305 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31945b-bee7-4281-80e2-be75ba883cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:37.521295 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31945b-bee7-4281-80e2-be75ba883cec service cinder] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:37.530656 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1434/2876] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:39.021923 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec143b0f-cebc-45d7-9baa-c3c1adff3667 service cinder] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:39.031289 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec143b0f-cebc-45d7-9baa-c3c1adff3667 service cinder] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:39.034902 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81ad15-94da-471a-a40f-d422431bbf0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:39.035496 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ad15-94da-471a-a40f-d422431bbf0d service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:39.035776 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ad15-94da-471a-a40f-d422431bbf0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:39.036047 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81ad15-94da-471a-a40f-d422431bbf0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:39.045928 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81ad15-94da-471a-a40f-d422431bbf0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:39.047340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81ad15-94da-471a-a40f-d422431bbf0d service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:39.057073 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1443/2877] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:40.612768 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31945b-bee7-4281-80e2-be75ba883cec service cinder] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:40.616721 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-4b31945b-bee7-4281-80e2-be75ba883cec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:40.677311 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=100 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:40.683116 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31945b-bee7-4281-80e2-be75ba883cec service cinder] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:40.688081 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:40.688749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:40.689029 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:40.689301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] PATH_INFO: `/v3/users/afe8633f7d6540068ad23ac8a22931bb` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:40.690472 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe8633f7d6540068ad23ac8a22931bb)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:40.692436 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:40.821244 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe8633f7d6540068ad23ac8a22931bb'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:40.822093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe8633f7d6540068ad23ac8a22931bb'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:40.822816 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe8633f7d6540068ad23ac8a22931bb'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:40.836628 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe8633f7d6540068ad23ac8a22931bb'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:40.901457 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe8633f7d6540068ad23ac8a22931bb'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:40.915459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1435/2878] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:40 2022] DELETE /identity/v3/users/afe8633f7d6540068ad23ac8a22931bb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:40.920173 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8104-d75a-4a58-b8f6-e1a33978b6e2 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:40.920693 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8104-d75a-4a58-b8f6-e1a33978b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:40.920792 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd8104-d75a-4a58-b8f6-e1a33978b6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:40.934629 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:40.942715 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-22dd8104-d75a-4a58-b8f6-e1a33978b6e2 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:40.942715 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-22dd8104-d75a-4a58-b8f6-e1a33978b6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:41.000143 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1444/2879] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:27:41.010292 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:41.011728 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:41.071732 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104306-458f-48e6-b821-529b88258f84 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:41.075490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffa563-835b-4238-970f-e80370f139fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:41.076093 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffa563-835b-4238-970f-e80370f139fc service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:41.076405 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffa563-835b-4238-970f-e80370f139fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:41.076681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffa563-835b-4238-970f-e80370f139fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:41.085909 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffa563-835b-4238-970f-e80370f139fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:41.087320 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffa563-835b-4238-970f-e80370f139fc service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:41.096857 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1436/2880] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:41.515317 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8104-d75a-4a58-b8f6-e1a33978b6e2 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:41.516794 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-22dd8104-d75a-4a58-b8f6-e1a33978b6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:41.531012 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd8104-d75a-4a58-b8f6-e1a33978b6e2 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:41.535901 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:41.536683 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:41.537201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:41.537573 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] PATH_INFO: `/v3/projects/eedd69a3242b4327a60a0942c993161f` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:41.538816 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eedd69a3242b4327a60a0942c993161f)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:41.540948 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:41.702014 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eedd69a3242b4327a60a0942c993161f', 'request_id': 'req-a4894a94-6585-463d-b102-09c7de58a164'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:41.798599 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eedd69a3242b4327a60a0942c993161f', 'request_id': 'req-a4894a94-6585-463d-b102-09c7de58a164'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:41.807072 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eedd69a3242b4327a60a0942c993161f', 'request_id': 'req-a4894a94-6585-463d-b102-09c7de58a164'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:41.817873 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] The token cache is being invalidate because project eedd69a3242b4327a60a0942c993161f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:41.818157 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:41.818816 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-a4894a94-6585-463d-b102-09c7de58a164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:41.820388 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1445/2881] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:41 2022] DELETE /identity/v3/projects/eedd69a3242b4327a60a0942c993161f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:43.601053 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffa563-835b-4238-970f-e80370f139fc service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:43.602555 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-d5ffa563-835b-4238-970f-e80370f139fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:43.615945 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffa563-835b-4238-970f-e80370f139fc service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:43.672496 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:43.673123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:43.673408 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:43.673681 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] PATH_INFO: `/v3/users/64b5244b5a0441f1acf96f238cf33336` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:43.674854 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b5244b5a0441f1acf96f238cf33336)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:43.676782 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:43.699663 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:43.868577 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b5244b5a0441f1acf96f238cf33336'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:43.869965 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b5244b5a0441f1acf96f238cf33336'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:43.870591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b5244b5a0441f1acf96f238cf33336'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:43.883420 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b5244b5a0441f1acf96f238cf33336'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:43.929702 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b5244b5a0441f1acf96f238cf33336'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:43.943622 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1437/2882] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:43 2022] DELETE /identity/v3/users/64b5244b5a0441f1acf96f238cf33336 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:43.949967 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19aa53-24bf-4a23-a9fb-8b4787f37776 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:43.950472 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19aa53-24bf-4a23-a9fb-8b4787f37776 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:43.950605 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19aa53-24bf-4a23-a9fb-8b4787f37776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:43.969119 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-fb19aa53-24bf-4a23-a9fb-8b4787f37776 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:43.970311 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fb19aa53-24bf-4a23-a9fb-8b4787f37776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:44.028217 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1446/2883] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:44.037918 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:44.039333 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:44.097499 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d23648-4b15-4e44-9d2a-f7ab696283e4 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:44.101061 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785629ac-7c15-4a66-89fd-546f065332b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:44.101665 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785629ac-7c15-4a66-89fd-546f065332b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:44.101947 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785629ac-7c15-4a66-89fd-546f065332b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:44.102351 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785629ac-7c15-4a66-89fd-546f065332b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:44.111839 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785629ac-7c15-4a66-89fd-546f065332b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:44.113290 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785629ac-7c15-4a66-89fd-546f065332b7 service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:44.123379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1438/2884] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:44.532446 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19aa53-24bf-4a23-a9fb-8b4787f37776 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:44.534058 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-fb19aa53-24bf-4a23-a9fb-8b4787f37776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:44.546017 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19aa53-24bf-4a23-a9fb-8b4787f37776 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:44.550617 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:44.551237 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:44.551575 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:44.551847 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] PATH_INFO: `/v3/projects/ac7c1d8ee4534e28bbe2c0715b3196ab` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:44.553700 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7c1d8ee4534e28bbe2c0715b3196ab)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:44.555797 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:44.685943 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:44.703353 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7c1d8ee4534e28bbe2c0715b3196ab', 'request_id': 'req-79d34add-9dff-4189-8640-34ae306a06bd'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:44.780627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7c1d8ee4534e28bbe2c0715b3196ab', 'request_id': 'req-79d34add-9dff-4189-8640-34ae306a06bd'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:44.787537 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7c1d8ee4534e28bbe2c0715b3196ab', 'request_id': 'req-79d34add-9dff-4189-8640-34ae306a06bd'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:44.798492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] The token cache is being invalidate because project ac7c1d8ee4534e28bbe2c0715b3196ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:44.802795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:44.802795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:44.802795 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1447/2885] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:44 2022] DELETE /identity/v3/projects/ac7c1d8ee4534e28bbe2c0715b3196ab => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:44.805403 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785629ac-7c15-4a66-89fd-546f065332b7 service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:44.815896 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785629ac-7c15-4a66-89fd-546f065332b7 service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:44.873384 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:44.874019 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:44.874299 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:44.874570 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] PATH_INFO: `/v3/users/19ebf8d499d6420085e2a2fdbd8ebb49` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:44.875959 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ebf8d499d6420085e2a2fdbd8ebb49)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:44.877926 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:45.106506 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:45.109075 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ebf8d499d6420085e2a2fdbd8ebb49'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:45.109819 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ebf8d499d6420085e2a2fdbd8ebb49'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:45.110421 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ebf8d499d6420085e2a2fdbd8ebb49'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:45.123653 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ebf8d499d6420085e2a2fdbd8ebb49'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:45.198689 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ebf8d499d6420085e2a2fdbd8ebb49'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:45.212892 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1439/2886] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:44 2022] DELETE /identity/v3/users/19ebf8d499d6420085e2a2fdbd8ebb49 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:45.690921 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:45.692416 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:45.706927 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d34add-9dff-4189-8640-34ae306a06bd admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:45.767090 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:45.767728 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:45.768008 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:45.768312 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] PATH_INFO: `/v3/projects/6ddbd215f07e48a9a0c61a991bdd714d` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:45.769483 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ddbd215f07e48a9a0c61a991bdd714d)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:45.775438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:45.879837 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ddbd215f07e48a9a0c61a991bdd714d', 'request_id': 'req-f348ed66-8cee-455d-8650-dbae73d5da3d'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:45.940872 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ddbd215f07e48a9a0c61a991bdd714d', 'request_id': 'req-f348ed66-8cee-455d-8650-dbae73d5da3d'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:45.947930 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ddbd215f07e48a9a0c61a991bdd714d', 'request_id': 'req-f348ed66-8cee-455d-8650-dbae73d5da3d'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:45.958341 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] The token cache is being invalidate because project 6ddbd215f07e48a9a0c61a991bdd714d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:45.958631 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:45.959258 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:45.960775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1448/2887] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:45 2022] DELETE /identity/v3/projects/6ddbd215f07e48a9a0c61a991bdd714d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:45.965611 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:45.967054 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:45.980780 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f105da-9f3b-41ab-9204-404876155742 admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:46.039247 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba3225-fe4f-4946-956a-0ee280f82705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:46.039882 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3225-fe4f-4946-956a-0ee280f82705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:46.040160 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3225-fe4f-4946-956a-0ee280f82705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:46.040490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba3225-fe4f-4946-956a-0ee280f82705 admin admin] PATH_INFO: `/v3/users/e9ef96608c8f47e184afc17f4d1dd847` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:46.041743 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba3225-fe4f-4946-956a-0ee280f82705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ef96608c8f47e184afc17f4d1dd847)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:46.043723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba3225-fe4f-4946-956a-0ee280f82705 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:46.219132 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-dbba3225-fe4f-4946-956a-0ee280f82705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ef96608c8f47e184afc17f4d1dd847'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:46.219935 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-dbba3225-fe4f-4946-956a-0ee280f82705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ef96608c8f47e184afc17f4d1dd847'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:46.220549 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-dbba3225-fe4f-4946-956a-0ee280f82705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ef96608c8f47e184afc17f4d1dd847'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:46.232944 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-dbba3225-fe4f-4946-956a-0ee280f82705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ef96608c8f47e184afc17f4d1dd847'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:46.318226 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-dbba3225-fe4f-4946-956a-0ee280f82705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ef96608c8f47e184afc17f4d1dd847'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:46.332152 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1440/2888] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:27:45 2022] DELETE /identity/v3/users/e9ef96608c8f47e184afc17f4d1dd847 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:46.766564 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:46.768399 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:46.783228 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348ed66-8cee-455d-8650-dbae73d5da3d admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:46.827274 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:46.842067 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:46.842775 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:46.843057 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:46.843332 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] PATH_INFO: `/v3/projects/5fb168261122490d982a968ee4b695a6` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:46.844518 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb168261122490d982a968ee4b695a6)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:46.846458 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:46.942278 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb168261122490d982a968ee4b695a6', 'request_id': 'req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:47.060688 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb168261122490d982a968ee4b695a6', 'request_id': 'req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:47.067673 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb168261122490d982a968ee4b695a6', 'request_id': 'req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:47.078079 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] The token cache is being invalidate because project 5fb168261122490d982a968ee4b695a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:27:47.078370 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:47.079095 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-5ee969d5-7629-4969-86f1-e9bd3f3ef71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:27:47.080607 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1449/2889] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:27:46 2022] DELETE /identity/v3/projects/5fb168261122490d982a968ee4b695a6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:47.085620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c574e-2ce2-45de-ae3d-e1388ddd13fe None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:47.086112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c574e-2ce2-45de-ae3d-e1388ddd13fe None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:47.086301 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c574e-2ce2-45de-ae3d-e1388ddd13fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:47.108112 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-746c574e-2ce2-45de-ae3d-e1388ddd13fe None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:47.109469 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-746c574e-2ce2-45de-ae3d-e1388ddd13fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:47.144547 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:47.171201 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1441/2890] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:47.178963 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab05f-0ecd-431c-8909-75e074386274 None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:47.179254 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab05f-0ecd-431c-8909-75e074386274 None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:47.179531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab05f-0ecd-431c-8909-75e074386274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:47.200438 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-07cab05f-0ecd-431c-8909-75e074386274 None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:47.201666 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-07cab05f-0ecd-431c-8909-75e074386274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:47.209635 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1450/2891] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:47.214523 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c574e-2ce2-45de-ae3d-e1388ddd13fe None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:47.224047 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c574e-2ce2-45de-ae3d-e1388ddd13fe None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:47.229916 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bdc82-c138-4736-9eea-6e0b9eb81dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:47.230503 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bdc82-c138-4736-9eea-6e0b9eb81dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:47.230776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bdc82-c138-4736-9eea-6e0b9eb81dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:47.231041 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bdc82-c138-4736-9eea-6e0b9eb81dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:47.231674 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bdc82-c138-4736-9eea-6e0b9eb81dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81946) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:27:47.231969 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bdc82-c138-4736-9eea-6e0b9eb81dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:47.233620 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bdc82-c138-4736-9eea-6e0b9eb81dbe admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:47.245072 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1442/2892] 10.222.0.20 () {58 vars in 1153 bytes} [Wed Aug 24 17:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:27:47.249588 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cab05f-0ecd-431c-8909-75e074386274 None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:47.259340 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cab05f-0ecd-431c-8909-75e074386274 None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:47.263973 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd47e-8a6e-4144-875a-d89e1c988bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:47.264596 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd47e-8a6e-4144-875a-d89e1c988bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:47.264876 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd47e-8a6e-4144-875a-d89e1c988bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:47.265145 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbd47e-8a6e-4144-875a-d89e1c988bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:47.265805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbd47e-8a6e-4144-875a-d89e1c988bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:47.267699 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbd47e-8a6e-4144-875a-d89e1c988bb0 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:47.382989 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1451/2893] 10.222.0.20 () {60 vars in 1153 bytes} [Wed Aug 24 17:27:47 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:47.387210 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bdc82-c138-4736-9eea-6e0b9eb81dbe admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:47.397152 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bdc82-c138-4736-9eea-6e0b9eb81dbe admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:47.452849 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a89d-5561-4c43-a8fe-0295eae78ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:47.453536 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a89d-5561-4c43-a8fe-0295eae78ead admin admin] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:47.453836 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a89d-5561-4c43-a8fe-0295eae78ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:47.454115 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74a89d-5561-4c43-a8fe-0295eae78ead admin admin] PATH_INFO: `/v3/users` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:47.454749 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a89d-5561-4c43-a8fe-0295eae78ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:47.456793 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74a89d-5561-4c43-a8fe-0295eae78ead admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:47.576482 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1443/2894] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Aug 24 17:27:47 2022] POST /identity/v3/users => generated 282 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:27:47.580656 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd47e-8a6e-4144-875a-d89e1c988bb0 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:47.591839 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbd47e-8a6e-4144-875a-d89e1c988bb0 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:47.596648 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5195776-48de-49f2-8269-256ecd1c5aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:47.597251 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5195776-48de-49f2-8269-256ecd1c5aac admin admin] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:47.597531 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5195776-48de-49f2-8269-256ecd1c5aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:47.597858 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5195776-48de-49f2-8269-256ecd1c5aac admin admin] PATH_INFO: `/v3/roles` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:47.598505 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5195776-48de-49f2-8269-256ecd1c5aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:47.600092 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5195776-48de-49f2-8269-256ecd1c5aac admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:47.610697 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1452/2895] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:47.614748 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a89d-5561-4c43-a8fe-0295eae78ead admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:47.624735 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74a89d-5561-4c43-a8fe-0295eae78ead admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:47.629581 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6593f-5e7f-4d38-8a3e-4a792c07c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:47.630182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6593f-5e7f-4d38-8a3e-4a792c07c4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:47.630459 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6593f-5e7f-4d38-8a3e-4a792c07c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:47.630723 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6593f-5e7f-4d38-8a3e-4a792c07c4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:47.631374 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6593f-5e7f-4d38-8a3e-4a792c07c4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:47.633296 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6593f-5e7f-4d38-8a3e-4a792c07c4e0 admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:47.645027 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1444/2896] 10.222.0.20 () {58 vars in 1122 bytes} [Wed Aug 24 17:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:27:47.649182 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5195776-48de-49f2-8269-256ecd1c5aac admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:47.660022 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5195776-48de-49f2-8269-256ecd1c5aac admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:47.664636 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b736-0350-4c9d-861b-35d8b78e9987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:47.665299 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b736-0350-4c9d-861b-35d8b78e9987 admin admin] REQUEST_METHOD: `PUT` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:47.665600 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b736-0350-4c9d-861b-35d8b78e9987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:47.665878 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b736-0350-4c9d-861b-35d8b78e9987 admin admin] PATH_INFO: `/v3/projects/4f0edb3cdce14852b5123c6f2df0ab34/users/d782826faf9c4068ac491cfe8c94ff00/roles/24cce6d670834e3ba65b942574313d0a` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:47.684846 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839b736-0350-4c9d-861b-35d8b78e9987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0edb3cdce14852b5123c6f2df0ab34, user_id=d782826faf9c4068ac491cfe8c94ff00, role_id=24cce6d670834e3ba65b942574313d0a)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:47.687553 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839b736-0350-4c9d-861b-35d8b78e9987 admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:47.786350 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1453/2897] 10.222.0.20 () {60 vars in 1483 bytes} [Wed Aug 24 17:27:47 2022] PUT /identity/v3/projects/4f0edb3cdce14852b5123c6f2df0ab34/users/d782826faf9c4068ac491cfe8c94ff00/roles/24cce6d670834e3ba65b942574313d0a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:27:47.798182 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b994b-aa01-4c17-bcaf-1b5d993680ab None None] REQUEST_METHOD: `POST` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:47.798465 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b994b-aa01-4c17-bcaf-1b5d993680ab None None] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:47.798737 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b994b-aa01-4c17-bcaf-1b5d993680ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:47.826379 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.auth.core [None req-e10b994b-aa01-4c17-bcaf-1b5d993680ab None None] MFA Rules not processed for user `d782826faf9c4068ac491cfe8c94ff00`. Rule list: `[]` (Enabled: `True`). {{(pid=81946) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:27:47.827576 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-e10b994b-aa01-4c17-bcaf-1b5d993680ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:47.891872 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1445/2898] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:27:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:27:47.904020 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b736-0350-4c9d-861b-35d8b78e9987 admin admin] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:27:47.905762 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-b839b736-0350-4c9d-861b-35d8b78e9987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:27:47.962522 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b736-0350-4c9d-861b-35d8b78e9987 admin admin] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:27:47.966226 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8486d9-18e4-4852-8ad5-105d7d55d68b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '009e5ad7d256449495c74dad67741f3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:27:47.966829 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8486d9-18e4-4852-8ad5-105d7d55d68b service cinder] REQUEST_METHOD: `GET` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:27:47.967111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8486d9-18e4-4852-8ad5-105d7d55d68b service cinder] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:27:47.967385 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8486d9-18e4-4852-8ad5-105d7d55d68b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:27:47.975660 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8486d9-18e4-4852-8ad5-105d7d55d68b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:27:47.977111 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8486d9-18e4-4852-8ad5-105d7d55d68b service cinder] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:27:47.985859 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1454/2899] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:27:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:27:57.888609 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:27:57.981805 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:26.040596 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b994b-aa01-4c17-bcaf-1b5d993680ab None None] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:26.101580 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b994b-aa01-4c17-bcaf-1b5d993680ab None None] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:26.106059 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:26.106676 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:26.106950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:26.107218 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] PATH_INFO: `/v3/users/d782826faf9c4068ac491cfe8c94ff00` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:26.108340 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d782826faf9c4068ac491cfe8c94ff00)` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:26.110223 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:26.271531 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd782826faf9c4068ac491cfe8c94ff00'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:28:26.272325 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd782826faf9c4068ac491cfe8c94ff00'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:28:26.273123 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd782826faf9c4068ac491cfe8c94ff00'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:28:26.285485 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd782826faf9c4068ac491cfe8c94ff00'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:28:26.334212 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.notifications [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd782826faf9c4068ac491cfe8c94ff00'} {{(pid=81946) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:28:26.347121 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1446/2900] 10.222.0.20 () {58 vars in 1224 bytes} [Wed Aug 24 17:28:26 2022] DELETE /identity/v3/users/d782826faf9c4068ac491cfe8c94ff00 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:28:26.352447 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cf104-e4e6-4b9c-819b-54bb2b2ab4ee None None] REQUEST_METHOD: `POST` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:26.353061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cf104-e4e6-4b9c-819b-54bb2b2ab4ee None None] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:26.353061 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cf104-e4e6-4b9c-819b-54bb2b2ab4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:26.372201 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.auth.core [None req-ca1cf104-e4e6-4b9c-819b-54bb2b2ab4ee None None] MFA Rules not processed for user `d69fc1cd23224254975fe218cabc2f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81947) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:28:26.373492 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ca1cf104-e4e6-4b9c-819b-54bb2b2ab4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:28:26.436054 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1455/2901] 10.222.0.20 () {58 vars in 958 bytes} [Wed Aug 24 17:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:28:26.445964 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:26.447798 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:28:26.507521 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d873095-ac33-49f4-9a41-faa1026ab51e admin admin] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:26.511207 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068c8c6-28f4-48eb-8002-f411bdd2ac1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e303777e78b7499fbff457254d14d360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:26.511805 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068c8c6-28f4-48eb-8002-f411bdd2ac1b service neutron] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:26.512077 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068c8c6-28f4-48eb-8002-f411bdd2ac1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:26.512382 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068c8c6-28f4-48eb-8002-f411bdd2ac1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:26.521490 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068c8c6-28f4-48eb-8002-f411bdd2ac1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:26.522950 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068c8c6-28f4-48eb-8002-f411bdd2ac1b service neutron] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:26.532171 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1447/2902] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:28:26.938877 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cf104-e4e6-4b9c-819b-54bb2b2ab4ee None None] Authenticating user token {{(pid=81947) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:28:26.940342 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.fernet_utils [None req-ca1cf104-e4e6-4b9c-819b-54bb2b2ab4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81947) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:28:26.952978 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cf104-e4e6-4b9c-819b-54bb2b2ab4ee None None] Validating token access rules against request {{(pid=81947) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:28:26.957627 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd69fc1cd23224254975fe218cabc2f20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79cea13f947a4452b851eb72104e1d0d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81947) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:28:26.958253 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:28:26.958579 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:28:26.959016 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] PATH_INFO: `/v3/projects/4f0edb3cdce14852b5123c6f2df0ab34` {{(pid=81947) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:28:26.960144 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0edb3cdce14852b5123c6f2df0ab34)` {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:28:26.966812 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] RBAC: Authorization granted {{(pid=81947) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:28:27.128619 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0edb3cdce14852b5123c6f2df0ab34', 'request_id': 'req-1c20e746-c1d5-4543-96c3-211f3efc59cb'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:28:27.236486 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0edb3cdce14852b5123c6f2df0ab34', 'request_id': 'req-1c20e746-c1d5-4543-96c3-211f3efc59cb'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:28:27.243386 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0edb3cdce14852b5123c6f2df0ab34', 'request_id': 'req-1c20e746-c1d5-4543-96c3-211f3efc59cb'} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:28:27.254030 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] The token cache is being invalidate because project 4f0edb3cdce14852b5123c6f2df0ab34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81947) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:28:27.258400 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:28:27.258400 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG keystone.notifications [None req-1c20e746-c1d5-4543-96c3-211f3efc59cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81947) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:28:27.258400 dv-cinder-851640-4-smb devstack@keystone.service[81947]: [pid: 81947|app: 0|req: 1456/2903] 10.222.0.20 () {58 vars in 1233 bytes} [Wed Aug 24 17:28:26 2022] DELETE /identity/v3/projects/4f0edb3cdce14852b5123c6f2df0ab34 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:28:36.528149 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:28:37.250994 dv-cinder-851640-4-smb devstack@keystone.service[81947]: DEBUG dbcounter [-] [81947] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81947) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:49.146776 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068c8c6-28f4-48eb-8002-f411bdd2ac1b service neutron] Authenticating user token {{(pid=81946) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:49.148215 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-8068c8c6-28f4-48eb-8002-f411bdd2ac1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:49.218181 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068c8c6-28f4-48eb-8002-f411bdd2ac1b service neutron] Validating token access rules against request {{(pid=81946) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:49.276980 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd0769-2bfc-4ee4-803d-e1e109c7f266 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a698e566a46841cf83aa1711e83f8829', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf4f3d778a84980bb9b4bfdd2b26c3c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81946) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:49.277591 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd0769-2bfc-4ee4-803d-e1e109c7f266 service placement] REQUEST_METHOD: `GET` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:49.277869 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd0769-2bfc-4ee4-803d-e1e109c7f266 service placement] SCRIPT_NAME: `/identity` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:49.278141 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd0769-2bfc-4ee4-803d-e1e109c7f266 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81946) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:49.280610 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.fernet_utils [None req-fbcd0769-2bfc-4ee4-803d-e1e109c7f266 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81946) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:49.292519 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd0769-2bfc-4ee4-803d-e1e109c7f266 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:49.294118 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd0769-2bfc-4ee4-803d-e1e109c7f266 service placement] RBAC: Authorization granted {{(pid=81946) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:49.304847 dv-cinder-851640-4-smb devstack@keystone.service[81946]: [pid: 81946|app: 0|req: 1448/2904] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Aug 24 17:29:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:29:59.300484 dv-cinder-851640-4-smb devstack@keystone.service[81946]: DEBUG dbcounter [-] [81946] Writing DB stats keystone:SELECT=58 {{(pid=81946) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}